Jul 27 21:54:15.117628 ip-10-0-140-114 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 21:54:15.621449 ip-10-0-140-114 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 21:54:15.621449 ip-10-0-140-114 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 21:54:15.621449 ip-10-0-140-114 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 21:54:15.621449 ip-10-0-140-114 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 21:54:15.621449 ip-10-0-140-114 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 21:54:15.622798 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.622685    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 21:54:15.628404 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628388    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 21:54:15.628404 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628404    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 21:54:15.628476 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628408    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 21:54:15.628476 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628411    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 21:54:15.628476 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628414    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 21:54:15.628476 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628417    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 21:54:15.628476 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628421    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 21:54:15.628476 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628430    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 21:54:15.628476 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628434    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 21:54:15.628476 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628437    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 21:54:15.628476 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628439    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 21:54:15.628476 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628442    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 21:54:15.628476 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628445    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 21:54:15.628476 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628447    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 21:54:15.628476 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628450    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 21:54:15.628476 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628452    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 21:54:15.628476 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628455    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 21:54:15.628476 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628457    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 21:54:15.628476 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628460    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 21:54:15.628476 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628462    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 21:54:15.628476 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628465    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 21:54:15.628476 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628468    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 21:54:15.629000 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628470    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 21:54:15.629000 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628473    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 21:54:15.629000 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628477    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 21:54:15.629000 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628482    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 21:54:15.629000 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628485    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 21:54:15.629000 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628488    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 21:54:15.629000 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628491    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 21:54:15.629000 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628494    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 21:54:15.629000 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628497    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 21:54:15.629000 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628499    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 21:54:15.629000 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628502    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 21:54:15.629000 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628505    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 21:54:15.629000 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628508    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 21:54:15.629000 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628510    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 21:54:15.629000 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628513    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 21:54:15.629000 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628515    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 21:54:15.629000 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628517    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 21:54:15.629000 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628521    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 21:54:15.629000 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628524    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 21:54:15.629729 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628527    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 21:54:15.629729 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628530    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 21:54:15.629729 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628533    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 21:54:15.629729 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628535    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 21:54:15.629729 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628538    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 21:54:15.629729 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628540    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 21:54:15.629729 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628543    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 21:54:15.629729 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628545    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 21:54:15.629729 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628548    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 21:54:15.629729 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628550    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 21:54:15.629729 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628552    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 21:54:15.629729 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628555    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 21:54:15.629729 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628557    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 21:54:15.629729 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628560    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 21:54:15.629729 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628563    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 21:54:15.629729 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628566    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 21:54:15.629729 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628568    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 21:54:15.629729 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628571    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 21:54:15.629729 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628575    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 21:54:15.630227 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628579    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 21:54:15.630227 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628582    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 21:54:15.630227 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628585    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 21:54:15.630227 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628587    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 21:54:15.630227 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628590    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 21:54:15.630227 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628593    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 21:54:15.630227 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628595    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 21:54:15.630227 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628598    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 21:54:15.630227 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628601    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 21:54:15.630227 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628605    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 21:54:15.630227 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628607    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 21:54:15.630227 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628610    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 21:54:15.630227 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628613    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 21:54:15.630227 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628615    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 21:54:15.630227 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628618    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 21:54:15.630227 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628620    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 21:54:15.630227 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628623    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 21:54:15.630227 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628625    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 21:54:15.630227 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628627    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 21:54:15.630227 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628630    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 21:54:15.630728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628632    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 21:54:15.630728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628635    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 21:54:15.630728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628637    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 21:54:15.630728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628640    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 21:54:15.630728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628642    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 21:54:15.630728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628644    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 21:54:15.630728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628648    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 21:54:15.630728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628652    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 21:54:15.630728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628655    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 21:54:15.630728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628657    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 21:54:15.630728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628660    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 21:54:15.630728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628663    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 21:54:15.630728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628665    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 21:54:15.630728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628669    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 21:54:15.630728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628671    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 21:54:15.630728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628674    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 21:54:15.630728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628676    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 21:54:15.630728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628679    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 21:54:15.630728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.628681    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 21:54:15.630728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630373    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 21:54:15.631194 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630383    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 21:54:15.631194 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630387    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 21:54:15.631194 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630390    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 21:54:15.631194 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630393    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 21:54:15.631194 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630396    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 21:54:15.631194 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630399    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 21:54:15.631194 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630402    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 21:54:15.631194 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630405    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 21:54:15.631194 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630407    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 21:54:15.631194 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630410    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 21:54:15.631194 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630412    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 21:54:15.631194 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630415    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 21:54:15.631194 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630418    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 21:54:15.631194 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630420    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 21:54:15.631194 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630423    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 21:54:15.631194 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630426    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 21:54:15.631194 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630428    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 21:54:15.631194 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630431    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 21:54:15.631194 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630433    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 21:54:15.631194 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630436    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 21:54:15.631691 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630438    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 21:54:15.631691 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630441    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 21:54:15.631691 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630443    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 21:54:15.631691 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630446    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 21:54:15.631691 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630448    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 21:54:15.631691 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630451    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 21:54:15.631691 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630453    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 21:54:15.631691 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630456    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 21:54:15.631691 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630458    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 21:54:15.631691 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630461    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 21:54:15.631691 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630464    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 21:54:15.631691 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630467    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 21:54:15.631691 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630470    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 21:54:15.631691 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630474    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 21:54:15.631691 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630478    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 21:54:15.631691 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630480    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 21:54:15.631691 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630483    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 21:54:15.631691 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630487    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 21:54:15.631691 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630491    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 21:54:15.632144 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630494    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 21:54:15.632144 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630496    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 21:54:15.632144 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630499    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 21:54:15.632144 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630501    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 21:54:15.632144 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630504    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 21:54:15.632144 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630506    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 21:54:15.632144 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630509    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 21:54:15.632144 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630512    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 21:54:15.632144 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630514    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 21:54:15.632144 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630517    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 21:54:15.632144 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630519    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 21:54:15.632144 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630522    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 21:54:15.632144 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630525    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 21:54:15.632144 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630527    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 21:54:15.632144 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630530    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 21:54:15.632144 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630532    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 21:54:15.632144 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630536    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 21:54:15.632144 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630539    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 21:54:15.632144 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630542    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 21:54:15.632607 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630546    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 21:54:15.632607 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630549    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 21:54:15.632607 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630551    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 21:54:15.632607 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630554    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 21:54:15.632607 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630557    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 21:54:15.632607 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630559    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 21:54:15.632607 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630562    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 21:54:15.632607 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630565    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 21:54:15.632607 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630568    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 21:54:15.632607 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630571    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 21:54:15.632607 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630573    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 21:54:15.632607 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630576    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 21:54:15.632607 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630579    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 21:54:15.632607 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630581    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 21:54:15.632607 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630583    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 21:54:15.632607 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630586    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 21:54:15.632607 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630588    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 21:54:15.632607 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630592    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 21:54:15.632607 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630594    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 21:54:15.632607 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630597    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 21:54:15.633084 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630599    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 21:54:15.633084 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630601    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 21:54:15.633084 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630604    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 21:54:15.633084 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630606    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 21:54:15.633084 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630610    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 21:54:15.633084 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630612    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 21:54:15.633084 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630615    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 21:54:15.633084 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630617    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 21:54:15.633084 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630620    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 21:54:15.633084 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630623    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 21:54:15.633084 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630625    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 21:54:15.633084 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630628    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 21:54:15.633084 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630630    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 21:54:15.633084 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630633    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 21:54:15.633084 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630635    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 21:54:15.633084 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630637    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 21:54:15.633084 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630640    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 21:54:15.633084 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630643    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 21:54:15.633084 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630646    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 21:54:15.633084 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.630649    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 21:54:15.633587 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631014    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 21:54:15.633587 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631020    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 21:54:15.633587 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631024    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 21:54:15.633587 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631028    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 21:54:15.633587 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631031    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 21:54:15.633587 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631033    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 21:54:15.633587 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631036    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 21:54:15.633587 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631038    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 21:54:15.633587 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631041    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 21:54:15.633587 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631044    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 21:54:15.633587 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631047    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 21:54:15.633587 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631050    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 21:54:15.633587 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631052    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 21:54:15.633587 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631055    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 21:54:15.633587 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631058    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 21:54:15.633587 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631060    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 21:54:15.633587 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631064    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 21:54:15.633587 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631066    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 21:54:15.633587 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631068    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 21:54:15.634047 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631072    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 21:54:15.634047 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631074    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 21:54:15.634047 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631077    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 21:54:15.634047 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631079    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 21:54:15.634047 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631081    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 21:54:15.634047 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631084    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 21:54:15.634047 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631086    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 21:54:15.634047 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631088    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 21:54:15.634047 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631092    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 21:54:15.634047 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631094    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 21:54:15.634047 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631098    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 21:54:15.634047 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631100    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 21:54:15.634047 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631103    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 21:54:15.634047 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631105    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 21:54:15.634047 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631107    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 21:54:15.634047 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631110    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 21:54:15.634047 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631112    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 21:54:15.634047 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631115    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 21:54:15.634047 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631117    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 21:54:15.634047 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631120    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 21:54:15.634576 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631122    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 21:54:15.634576 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631125    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 21:54:15.634576 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631127    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 21:54:15.634576 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631129    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 21:54:15.634576 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631132    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 21:54:15.634576 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631134    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 21:54:15.634576 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631136    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 21:54:15.634576 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631139    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 21:54:15.634576 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631141    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 21:54:15.634576 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631143    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 21:54:15.634576 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631146    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 21:54:15.634576 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631148    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 21:54:15.634576 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631151    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 21:54:15.634576 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631153    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 21:54:15.634576 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631155    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 21:54:15.634576 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631157    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 21:54:15.634576 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631160    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 21:54:15.634576 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631162    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 21:54:15.634576 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631164    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 21:54:15.634576 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631167    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 21:54:15.635035 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631169    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 21:54:15.635035 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631172    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 21:54:15.635035 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631175    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 21:54:15.635035 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631178    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 21:54:15.635035 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631180    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 21:54:15.635035 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631182    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 21:54:15.635035 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631185    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 21:54:15.635035 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631187    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 21:54:15.635035 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631190    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 21:54:15.635035 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631193    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 21:54:15.635035 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631195    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 21:54:15.635035 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631197    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 21:54:15.635035 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631200    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 21:54:15.635035 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631204    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 21:54:15.635035 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631208    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 21:54:15.635035 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631210    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 21:54:15.635035 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631213    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 21:54:15.635035 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631215    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 21:54:15.635035 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631218    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 21:54:15.635035 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631220    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 21:54:15.635530 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631223    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 21:54:15.635530 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631225    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 21:54:15.635530 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631227    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 21:54:15.635530 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631230    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 21:54:15.635530 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631233    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 21:54:15.635530 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631236    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 21:54:15.635530 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631238    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 21:54:15.635530 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631240    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 21:54:15.635530 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631243    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 21:54:15.635530 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631245    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 21:54:15.635530 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631248    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 21:54:15.635530 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631250    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 21:54:15.635530 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631254    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 21:54:15.635530 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631257    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 21:54:15.635530 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631260    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 21:54:15.635530 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631263    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 21:54:15.635530 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631266    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 21:54:15.635530 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631268    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 21:54:15.635530 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631271    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631274    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631351    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631361    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631386    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631391    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631395    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631398    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631402    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631406    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631409    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631412    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631415    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631418    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631421    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631424    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631427    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631430    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631434    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631437    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631443    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631446    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631449    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631452    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 21:54:15.636022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631455    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631459    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631462    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631465    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631468    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631471    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631473    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631476    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631479    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631482    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631485    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631488    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631491    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631494    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631496    2565 flags.go:64] FLAG: --enable-server="true"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631499    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631506    2565 flags.go:64] FLAG: --event-burst="100"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631509    2565 flags.go:64] FLAG: --event-qps="50"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631512    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631515    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631517    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631521    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631523    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631526    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631529    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 27 21:54:15.636586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631532    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631535    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631538    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631541    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631544    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631547    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631549    2565 flags.go:64] FLAG: --feature-gates=""
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631557    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631560    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631563    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631566    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631569    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631572    2565 flags.go:64] FLAG: --help="false"
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631575    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-140-114.ec2.internal"
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631578    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631581    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631584    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631587    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631590    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631593    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631595    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631598    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631601    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 21:54:15.637185 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631603    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631606    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631609    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631612    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631614    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631617    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631620    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631623    2565 flags.go:64] FLAG: --lock-file=""
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631626    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631628    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631631    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631636    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631641    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631644    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631646    2565 flags.go:64] FLAG: --logging-format="text"
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631649    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631653    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631656    2565 flags.go:64] FLAG: --manifest-url=""
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631659    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631663    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631666    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631670    2565 flags.go:64] FLAG: --max-pods="110"
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631673    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631676    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631679    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 21:54:15.637769 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631682    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631684    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631687    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631690    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631698    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631701    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631704    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631707    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631710    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631716    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631719    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631722    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631725    2565 flags.go:64] FLAG: --port="10250"
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631728    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631731    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e02343a425304374"
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631734    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631738    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631741    2565 flags.go:64] FLAG: --register-node="true"
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631744    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631747    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631750    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631753    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631756    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631759    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631764    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 21:54:15.638378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631767    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631769    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631772    2565 flags.go:64] FLAG: --runonce="false"
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631775    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631778    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631780    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631783    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631786    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631789    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631792    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631795    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631798    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631800    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631803    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631806    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631809    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631811    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631814    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631819    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631822    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631824    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631831    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631833    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631838    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631841    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 21:54:15.638981 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631844    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631854    2565 flags.go:64] FLAG: --v="2"
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631859    2565 flags.go:64] FLAG: --version="false"
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631863    2565 flags.go:64] FLAG: --vmodule=""
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631867    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.631870    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631981    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631985    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631988    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631991    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631994    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631997    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.631999    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632002    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632005    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632007    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632010    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632012    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632015    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632017    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632020    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 21:54:15.639634 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632022    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 21:54:15.640157 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632025    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 21:54:15.640157 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632027    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 21:54:15.640157 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632030    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 21:54:15.640157 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632032    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 21:54:15.640157 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632035    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 21:54:15.640157 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632037    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 21:54:15.640157 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632040    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 21:54:15.640157 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632042    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 21:54:15.640157 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632047    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 21:54:15.640157 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632049    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 21:54:15.640157 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632052    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 21:54:15.640157 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632054    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 21:54:15.640157 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632057    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 21:54:15.640157 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632059    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 21:54:15.640157 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632062    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 21:54:15.640157 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632065    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 21:54:15.640157 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632069    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 21:54:15.640157 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632072    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 21:54:15.640157 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632074    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 21:54:15.640633 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632077    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 21:54:15.640633 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632079    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 21:54:15.640633 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632082    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 21:54:15.640633 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632085    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 21:54:15.640633 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632087    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 21:54:15.640633 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632090    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 21:54:15.640633 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632092    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 21:54:15.640633 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632095    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 21:54:15.640633 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632097    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 21:54:15.640633 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632100    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 21:54:15.640633 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632102    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 21:54:15.640633 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632106    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 21:54:15.640633 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632110    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 21:54:15.640633 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632113    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 21:54:15.640633 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632117    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 21:54:15.640633 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632120    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 21:54:15.640633 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632122    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 21:54:15.640633 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632125    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 21:54:15.640633 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632128    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 21:54:15.641162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632130    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 21:54:15.641162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632133    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 21:54:15.641162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632137    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 21:54:15.641162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632139    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 21:54:15.641162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632142    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 21:54:15.641162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632145    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 21:54:15.641162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632147    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 21:54:15.641162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632150    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 21:54:15.641162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632153    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 21:54:15.641162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632156    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 21:54:15.641162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632160    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 21:54:15.641162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632163    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 21:54:15.641162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632165    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 21:54:15.641162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632168    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 21:54:15.641162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632170    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 21:54:15.641162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632173    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 21:54:15.641162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632175    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 21:54:15.641162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632178    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 21:54:15.641162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632181    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 21:54:15.641162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632183    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 21:54:15.641667 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632185    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 21:54:15.641667 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632188    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 21:54:15.641667 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632190    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 21:54:15.641667 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632193    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 21:54:15.641667 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632195    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 21:54:15.641667 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632198    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 21:54:15.641667 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632201    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 21:54:15.641667 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632203    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 21:54:15.641667 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632206    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 21:54:15.641667 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632208    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 21:54:15.641667 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632210    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 21:54:15.641667 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632213    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 21:54:15.641667 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632215    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 21:54:15.641667 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632218    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 21:54:15.641667 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632222    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 21:54:15.641667 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632224    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 21:54:15.641667 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632227    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 21:54:15.641667 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632229    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 21:54:15.641667 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632232    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 21:54:15.641667 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632234    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 21:54:15.642138 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632238    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 21:54:15.642138 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632241    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 21:54:15.642138 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632246    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 21:54:15.642138 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632249    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 21:54:15.642138 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.632251    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 21:54:15.642138 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.633508    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 21:54:15.642138 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.640049    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 21:54:15.642138 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.640064    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 21:54:15.642138 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.640083    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 21:54:15.642138 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.640092    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 21:54:15.642138 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640153    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 21:54:15.642138 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640158    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 21:54:15.642138 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640161    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 21:54:15.642138 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640164    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 21:54:15.642138 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640168    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 21:54:15.642520 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640171    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 21:54:15.642520 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640174    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 21:54:15.642520 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640177    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 21:54:15.642520 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640180    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 21:54:15.642520 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640183    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 21:54:15.642520 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640186    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 21:54:15.642520 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640189    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 21:54:15.642520 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640191    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 21:54:15.642520 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640194    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 21:54:15.642520 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640197    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 21:54:15.642520 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640199    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 21:54:15.642520 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640202    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 21:54:15.642520 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640204    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 21:54:15.642520 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640207    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 21:54:15.642520 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640209    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 21:54:15.642520 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640212    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 21:54:15.642520 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640214    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 21:54:15.642520 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640216    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 21:54:15.642520 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640219    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 21:54:15.642520 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640222    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 21:54:15.642992 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640224    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 21:54:15.642992 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640227    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 21:54:15.642992 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640229    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 21:54:15.642992 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640232    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 21:54:15.642992 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640235    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 21:54:15.642992 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640238    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 21:54:15.642992 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640241    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 21:54:15.642992 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640244    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 21:54:15.642992 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640246    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 21:54:15.642992 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640248    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 21:54:15.642992 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640251    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 21:54:15.642992 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640253    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 21:54:15.642992 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640256    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 21:54:15.642992 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640258    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 21:54:15.642992 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640261    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 21:54:15.642992 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640263    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 21:54:15.642992 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640266    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 21:54:15.642992 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640268    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 21:54:15.642992 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640272    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 21:54:15.642992 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640275    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 21:54:15.643472 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640278    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 21:54:15.643472 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640280    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 21:54:15.643472 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640283    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 21:54:15.643472 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640285    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 21:54:15.643472 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640288    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 21:54:15.643472 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640290    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 21:54:15.643472 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640292    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 21:54:15.643472 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640295    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 21:54:15.643472 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640298    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 21:54:15.643472 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640300    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 21:54:15.643472 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640303    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 21:54:15.643472 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640307    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 21:54:15.643472 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640310    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 21:54:15.643472 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640313    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 21:54:15.643472 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640315    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 21:54:15.643472 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640318    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 21:54:15.643472 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640321    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 21:54:15.643472 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640325    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 21:54:15.643472 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640329    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 21:54:15.643941 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640349    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 21:54:15.643941 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640352    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 21:54:15.643941 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640356    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 21:54:15.643941 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640358    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 21:54:15.643941 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640361    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 21:54:15.643941 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640364    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 21:54:15.643941 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640366    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 21:54:15.643941 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640369    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 21:54:15.643941 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640371    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 21:54:15.643941 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640374    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 21:54:15.643941 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640376    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 21:54:15.643941 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640379    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 21:54:15.643941 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640381    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 21:54:15.643941 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640383    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 21:54:15.643941 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640386    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 21:54:15.643941 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640389    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 21:54:15.643941 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640391    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 21:54:15.643941 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640394    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 21:54:15.643941 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640396    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 21:54:15.644414 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640399    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 21:54:15.644414 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640402    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 21:54:15.644414 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640405    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 21:54:15.644414 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640407    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 21:54:15.644414 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640410    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 21:54:15.644414 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640412    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 21:54:15.644414 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640415    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 21:54:15.644414 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640417    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 21:54:15.644414 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640420    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 21:54:15.644414 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640422    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 21:54:15.644414 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640425    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 21:54:15.644414 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640427    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 21:54:15.644414 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640436    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 21:54:15.644414 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640439    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 21:54:15.644414 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640441    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 21:54:15.644414 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640444    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 21:54:15.644803 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.640449    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 21:54:15.644803 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640589    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 21:54:15.644803 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640595    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 21:54:15.644803 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640598    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 21:54:15.644803 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640601    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 21:54:15.644803 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640604    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 21:54:15.644803 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640607    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 21:54:15.644803 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640610    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 21:54:15.644803 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640613    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 21:54:15.644803 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640616    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 21:54:15.644803 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640619    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 21:54:15.644803 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640622    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 21:54:15.644803 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640624    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 21:54:15.644803 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640627    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 21:54:15.645147 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640629    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 21:54:15.645147 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640631    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 21:54:15.645147 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640634    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 21:54:15.645147 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640637    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 21:54:15.645147 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640639    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 21:54:15.645147 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640642    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 21:54:15.645147 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640644    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 21:54:15.645147 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640647    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 21:54:15.645147 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640650    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 21:54:15.645147 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640652    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 21:54:15.645147 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640654    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 21:54:15.645147 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640657    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 21:54:15.645147 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640659    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 21:54:15.645147 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640662    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 21:54:15.645147 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640665    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 21:54:15.645147 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640673    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 21:54:15.645147 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640676    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 21:54:15.645147 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640678    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 21:54:15.645147 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640681    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 21:54:15.645147 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640684    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 21:54:15.645769 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640686    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 21:54:15.645769 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640689    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 21:54:15.645769 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640691    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 21:54:15.645769 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640693    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 21:54:15.645769 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640696    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 21:54:15.645769 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640698    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 21:54:15.645769 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640700    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 21:54:15.645769 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640703    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 21:54:15.645769 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640706    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 21:54:15.645769 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640708    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 21:54:15.645769 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640711    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 21:54:15.645769 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640713    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 21:54:15.645769 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640715    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 21:54:15.645769 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640718    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 21:54:15.645769 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640721    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 21:54:15.645769 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640723    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 21:54:15.645769 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640726    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 21:54:15.645769 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640728    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 21:54:15.645769 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640730    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 21:54:15.645769 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640733    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 21:54:15.646230 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640735    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 21:54:15.646230 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640737    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 21:54:15.646230 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640740    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 21:54:15.646230 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640742    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 21:54:15.646230 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640745    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 21:54:15.646230 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640748    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 21:54:15.646230 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640750    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 21:54:15.646230 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640753    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 21:54:15.646230 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640761    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 21:54:15.646230 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640763    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 21:54:15.646230 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640765    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 21:54:15.646230 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640768    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 21:54:15.646230 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640770    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 21:54:15.646230 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640774    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 21:54:15.646230 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640777    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 21:54:15.646230 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640780    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 21:54:15.646230 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640783    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 21:54:15.646230 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640785    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 21:54:15.646230 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640788    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 21:54:15.646230 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640791    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 21:54:15.646728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640793    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 21:54:15.646728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640795    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 21:54:15.646728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640798    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 21:54:15.646728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640801    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 21:54:15.646728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640803    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 21:54:15.646728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640805    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 21:54:15.646728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640808    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 21:54:15.646728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640810    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 21:54:15.646728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640813    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 21:54:15.646728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640815    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 21:54:15.646728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640817    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 21:54:15.646728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640820    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 21:54:15.646728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640822    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 21:54:15.646728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640825    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 21:54:15.646728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640827    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 21:54:15.646728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640830    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 21:54:15.646728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640832    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 21:54:15.646728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640835    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 21:54:15.646728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640837    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 21:54:15.646728 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640840    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 21:54:15.647192 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640842    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 21:54:15.647192 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640850    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 21:54:15.647192 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640853    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 21:54:15.647192 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640855    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 21:54:15.647192 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640858    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 21:54:15.647192 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:15.640860    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 21:54:15.647192 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.640866    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 21:54:15.647192 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.640996    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 21:54:15.647192 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.643536    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 21:54:15.647192 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.644793    2565 server.go:1019] "Starting client certificate rotation"
Jul 27 21:54:15.647192 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.644886    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 21:54:15.647192 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.644915    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 21:54:15.648812 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.648797    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 21:54:15.650690 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.650677    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 21:54:15.659129 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.659106    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 27 21:54:15.661592 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.661577    2565 log.go:25] "Validated CRI v1 image API"
Jul 27 21:54:15.665904 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.665884    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 21:54:15.668558 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.668533    2565 fs.go:135] Filesystem UUIDs: map[18c16471-c91f-4b2d-8160-b87fc93f7938:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ab504f31-a10a-4b07-9f04-0f317c25f9e1:/dev/nvme0n1p3]
Jul 27 21:54:15.668638 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.668557    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 21:54:15.674219 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.674106    2565 manager.go:216] Machine: {Timestamp:2026-07-27 21:54:15.672795733 +0000 UTC m=+0.413930491 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3198265 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2932676e891195f959206922fdf939 SystemUUID:ec293267-6e89-1195-f959-206922fdf939 BootID:f10657d7-fa52-403c-920b-552ec264b17a Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2a:d2:f9:74:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2a:d2:f9:74:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:c7:76:f3:90:c2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 21:54:15.674219 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.674210    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 21:54:15.674354 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.674288    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 21:54:15.675879 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.675863    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 21:54:15.677530 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.677506    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 21:54:15.677734 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.677540    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-114.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 21:54:15.678224 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.678214    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 21:54:15.678253 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.678227    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 21:54:15.678253 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.678234    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 21:54:15.678991 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.678981    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 21:54:15.680651 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.680640    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 21:54:15.683753 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.683741    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 21:54:15.683881 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.683870    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 21:54:15.683912 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.683900    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 21:54:15.683912 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.683912    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 21:54:15.683964 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.683925    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 21:54:15.683964 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.683934    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 27 21:54:15.683964 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.683943    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 21:54:15.684325 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.684314    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 21:54:15.684401 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.684346    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 21:54:15.686487 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.686463    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 21:54:15.688179 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.688165    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 21:54:15.688232 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.688196    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 21:54:15.688833 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.688821    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 21:54:15.688885 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.688837    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 21:54:15.688885 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.688843    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 21:54:15.688885 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.688849    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 21:54:15.688885 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.688858    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 21:54:15.688885 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.688863    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 21:54:15.688885 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.688877    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 21:54:15.688885 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.688884    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 21:54:15.689057 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.688891    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 21:54:15.689057 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.688896    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 21:54:15.689057 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.688904    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 21:54:15.689057 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.688910    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 21:54:15.690100 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.690089    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 21:54:15.690100 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.690100    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 21:54:15.696404 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.696382    2565 server.go:1268] "Started kubelet"
Jul 27 21:54:15.697473 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.696998    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 21:54:15.697473 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.697420    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 21:54:15.697404 ip-10-0-140-114 systemd[1]: Started Kubernetes Kubelet.
Jul 27 21:54:15.697783 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.697521    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 21:54:15.700000 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.699967    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 21:54:15.700203 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.700185    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-114.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 21:54:15.700290 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:15.700227    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-114.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 21:54:15.700430 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:15.700399    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 21:54:15.700728 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.700714    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 21:54:15.701330 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:15.701313    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 21:54:15.706967 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.706948    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 21:54:15.707046 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.706950    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 21:54:15.707103 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:15.707045    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found"
Jul 27 21:54:15.707820 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.707803    2565 factory.go:55] Registering systemd factory
Jul 27 21:54:15.707906 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.707824    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 27 21:54:15.708000 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.707989    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 21:54:15.708040 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.707996    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 21:54:15.708040 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.708013    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 21:54:15.708122 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.708113    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 21:54:15.708171 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.708124    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 21:54:15.709143 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.709003    2565 factory.go:153] Registering CRI-O factory
Jul 27 21:54:15.709143 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.709016    2565 factory.go:223] Registration of the crio container factory successfully
Jul 27 21:54:15.709143 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.709053    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 21:54:15.709143 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.709070    2565 factory.go:103] Registering Raw factory
Jul 27 21:54:15.709143 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.709082    2565 manager.go:1196] Started watching for new ooms in manager
Jul 27 21:54:15.710494 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.709514    2565 manager.go:349] Starting recovery of all containers
Jul 27 21:54:15.717675 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.717657    2565 manager.go:354] Recovery completed
Jul 27 21:54:15.718242 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:15.718205    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 21:54:15.718533 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:15.718491    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-114.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 21:54:15.719194 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:15.718255    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-114.ec2.internal.18c6442b72959a87  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-114.ec2.internal,UID:ip-10-0-140-114.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-114.ec2.internal,},FirstTimestamp:2026-07-27 21:54:15.695669895 +0000 UTC m=+0.436804662,LastTimestamp:2026-07-27 21:54:15.695669895 +0000 UTC m=+0.436804662,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-114.ec2.internal,}"
Jul 27 21:54:15.722483 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.722471    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 21:54:15.724717 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.724701    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 21:54:15.724755 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.724736    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 21:54:15.724755 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.724746    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientPID"
Jul 27 21:54:15.725255 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.725244    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 21:54:15.725314 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.725255    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 21:54:15.725314 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.725273    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 21:54:15.725314 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.725290    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 21:54:15.726019 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.726005    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 21:54:15.726084 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.726031    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 21:54:15.726084 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.726044    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientPID"
Jul 27 21:54:15.726420 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.726398    2565 policy_none.go:49] "None policy: Start"
Jul 27 21:54:15.726420 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.726415    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 21:54:15.726485 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.726428    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 21:54:15.727456 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:15.727366    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-114.ec2.internal.18c6442b7450e4ef  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-114.ec2.internal,UID:ip-10-0-140-114.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-114.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-114.ec2.internal,},FirstTimestamp:2026-07-27 21:54:15.724721391 +0000 UTC m=+0.465856149,LastTimestamp:2026-07-27 21:54:15.724721391 +0000 UTC m=+0.465856149,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-114.ec2.internal,}"
Jul 27 21:54:15.727550 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.727539    2565 policy_none.go:47] "Start"
Jul 27 21:54:15.738297 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.738275    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tljp7"
Jul 27 21:54:15.738429 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:15.738355    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-114.ec2.internal.18c6442b7451300c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-114.ec2.internal,UID:ip-10-0-140-114.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-114.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-114.ec2.internal,},FirstTimestamp:2026-07-27 21:54:15.72474062 +0000 UTC m=+0.465875378,LastTimestamp:2026-07-27 21:54:15.72474062 +0000 UTC m=+0.465875378,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-114.ec2.internal,}"
Jul 27 21:54:15.746164 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.746144    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tljp7"
Jul 27 21:54:15.748288 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:15.748204    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-114.ec2.internal.18c6442b7451542a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-114.ec2.internal,UID:ip-10-0-140-114.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-114.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-114.ec2.internal,},FirstTimestamp:2026-07-27 21:54:15.724749866 +0000 UTC m=+0.465884623,LastTimestamp:2026-07-27 21:54:15.724749866 +0000 UTC m=+0.465884623,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-114.ec2.internal,}"
Jul 27 21:54:15.760047 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.759892    2565 manager.go:337] "Starting Device Plugin manager"
Jul 27 21:54:15.760136 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:15.760068    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 21:54:15.760136 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.760079    2565 server.go:87] "Starting device plugin registration server"
Jul 27 21:54:15.760272 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.760262    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 21:54:15.760312 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.760273    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 21:54:15.760408 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.760387    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 21:54:15.760496 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.760475    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 21:54:15.760496 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.760486    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 21:54:15.760940 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:15.760924    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 21:54:15.761005 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:15.760969    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-114.ec2.internal\" not found"
Jul 27 21:54:15.809000 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.808966    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 21:54:15.810148 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.810128    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 21:54:15.810231 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.810167    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 21:54:15.810231 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.810193    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 21:54:15.810323 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:15.810230    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 21:54:15.812629 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.812613    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 21:54:15.860804 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.860773    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 21:54:15.861848 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.861832    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 21:54:15.861902 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.861862    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 21:54:15.861902 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.861872    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientPID"
Jul 27 21:54:15.861902 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.861894    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-114.ec2.internal"
Jul 27 21:54:15.871955 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.871913    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-114.ec2.internal"
Jul 27 21:54:15.871955 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:15.871934    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-114.ec2.internal\": node \"ip-10-0-140-114.ec2.internal\" not found"
Jul 27 21:54:15.897408 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:15.897388    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found"
Jul 27 21:54:15.910607 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.910589    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal"]
Jul 27 21:54:15.910652 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.910638    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 21:54:15.912398 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.912386    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 21:54:15.912465 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.912410    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 21:54:15.912465 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.912419    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientPID"
Jul 27 21:54:15.913597 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.913586    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 21:54:15.913712 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.913698    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal"
Jul 27 21:54:15.913745 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.913728    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 21:54:15.914380 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.914366    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 21:54:15.914448 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.914384    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 21:54:15.914448 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.914393    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientPID"
Jul 27 21:54:15.914448 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.914369    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 21:54:15.914448 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.914449    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 21:54:15.914554 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.914457    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientPID"
Jul 27 21:54:15.915525 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.915513    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal"
Jul 27 21:54:15.915589 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.915533    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 21:54:15.916176 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.916161    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 21:54:15.916267 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.916189    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 21:54:15.916267 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:15.916201    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientPID"
Jul 27 21:54:15.936849 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:15.936822    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-114.ec2.internal\" not found" node="ip-10-0-140-114.ec2.internal"
Jul 27 21:54:15.939857 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:15.939841    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-114.ec2.internal\" not found" node="ip-10-0-140-114.ec2.internal"
Jul 27 21:54:15.997506 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:15.997469    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found"
Jul 27 21:54:16.009827 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.009803    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a755af5e74d549c2ee35a96b8fe147c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal\" (UID: \"6a755af5e74d549c2ee35a96b8fe147c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal"
Jul 27 21:54:16.009890 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.009832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a755af5e74d549c2ee35a96b8fe147c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal\" (UID: \"6a755af5e74d549c2ee35a96b8fe147c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal"
Jul 27 21:54:16.009890 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.009847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7963463b045c47d8fc8e02283f628750-config\") pod \"kube-apiserver-proxy-ip-10-0-140-114.ec2.internal\" (UID: \"7963463b045c47d8fc8e02283f628750\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal"
Jul 27 21:54:16.098172 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:16.098140    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found"
Jul 27 21:54:16.110482 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.110451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a755af5e74d549c2ee35a96b8fe147c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal\" (UID: \"6a755af5e74d549c2ee35a96b8fe147c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal"
Jul 27 21:54:16.110535 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.110487    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a755af5e74d549c2ee35a96b8fe147c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal\" (UID: \"6a755af5e74d549c2ee35a96b8fe147c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal"
Jul 27 21:54:16.110535 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.110503    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7963463b045c47d8fc8e02283f628750-config\") pod \"kube-apiserver-proxy-ip-10-0-140-114.ec2.internal\" (UID: \"7963463b045c47d8fc8e02283f628750\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal"
Jul 27 21:54:16.110593 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.110547    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a755af5e74d549c2ee35a96b8fe147c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal\" (UID: \"6a755af5e74d549c2ee35a96b8fe147c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal"
Jul 27 21:54:16.110593 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.110554    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a755af5e74d549c2ee35a96b8fe147c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal\" (UID: \"6a755af5e74d549c2ee35a96b8fe147c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal"
Jul 27 21:54:16.110647 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.110600    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7963463b045c47d8fc8e02283f628750-config\") pod \"kube-apiserver-proxy-ip-10-0-140-114.ec2.internal\" (UID: \"7963463b045c47d8fc8e02283f628750\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal"
Jul 27 21:54:16.198855 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:16.198802    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found"
Jul 27 21:54:16.239201 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.239170    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal"
Jul 27 21:54:16.243491 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.243154    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal"
Jul 27 21:54:16.299778 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:16.299747    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found"
Jul 27 21:54:16.400191 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:16.400166    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found"
Jul 27 21:54:16.500695 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:16.500638    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found"
Jul 27 21:54:16.601078 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:16.601052    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found"
Jul 27 21:54:16.644449 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.644426    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 21:54:16.644825 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.644538    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 21:54:16.681913 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.681894    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 21:54:16.701936 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:16.701915    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found"
Jul 27 21:54:16.751512 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.751436    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 21:49:15 +0000 UTC" deadline="2028-04-30 02:19:11.359809446 +0000 UTC"
Jul 27 21:54:16.751512 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.751473    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15412h24m54.608339787s"
Jul 27 21:54:16.756533 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.756514    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 21:54:16.757698 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.757683    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 21:54:16.757779 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.757710    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 21:54:16.757779 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.757719    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeHasSufficientPID"
Jul 27 21:54:16.802607 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:16.802585    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found"
Jul 27 21:54:16.818032 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:16.818007    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a755af5e74d549c2ee35a96b8fe147c.slice/crio-c293527c3ee7f2b7befc6bc63817fa4204d742a089c7780bcb87cab4a7860a33 WatchSource:0}: Error finding container c293527c3ee7f2b7befc6bc63817fa4204d742a089c7780bcb87cab4a7860a33: Status 404 returned error can't find the container with id c293527c3ee7f2b7befc6bc63817fa4204d742a089c7780bcb87cab4a7860a33
Jul 27 21:54:16.825465 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:16.825449    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:54:16.835379 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:16.835356    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7963463b045c47d8fc8e02283f628750.slice/crio-69ce986c0febefd1dd1af8401658ab19185b44fe32e4a9000edad8af1e07b2c4 WatchSource:0}: Error finding container 69ce986c0febefd1dd1af8401658ab19185b44fe32e4a9000edad8af1e07b2c4: Status 404 returned error can't find the container with id 69ce986c0febefd1dd1af8401658ab19185b44fe32e4a9000edad8af1e07b2c4
Jul 27 21:54:16.903598 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:16.903558    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found"
Jul 27 21:54:17.004185 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:17.004102    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found"
Jul 27 21:54:17.082736 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.082705    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 21:54:17.104722 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:17.104697    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found"
Jul 27 21:54:17.205540 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:17.205510    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-114.ec2.internal\" not found"
Jul 27 21:54:17.250744 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.250722    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 21:54:17.307930 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.307858    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal"
Jul 27 21:54:17.324585 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.324557    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 21:54:17.325391 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.325368    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal"
Jul 27 21:54:17.335895 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.335869    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 21:54:17.567226 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.567144    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 21:54:17.684898 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.684860    2565 apiserver.go:52] "Watching apiserver"
Jul 27 21:54:17.692370 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.692327    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 21:54:17.692729 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.692700    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7","openshift-cluster-node-tuning-operator/tuned-vskvb","openshift-dns/node-resolver-pxjs5","openshift-image-registry/node-ca-f82sq","openshift-multus/multus-2l4n7","openshift-multus/multus-additional-cni-plugins-792l4","kube-system/konnectivity-agent-dttzh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal","openshift-multus/network-metrics-daemon-lgt8f","openshift-network-diagnostics/network-check-target-btrhh","openshift-network-operator/iptables-alerter-82r4r","openshift-ovn-kubernetes/ovnkube-node-lgj5w","kube-system/global-pull-secret-syncer-kg8x5"]
Jul 27 21:54:17.695328 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.695311    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:17.695436 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:17.695401    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btrhh" podUID="eefb4933-08a8-4afb-a044-33331c4074b6"
Jul 27 21:54:17.697318 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.697290    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.699548 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.699500    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 21:54:17.699652 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.699568    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.699652 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.699586    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 21:54:17.699760 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.699738    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 21:54:17.700008 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.699989    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wktfj\""
Jul 27 21:54:17.701719 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.701698    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pxjs5"
Jul 27 21:54:17.701909 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.701887    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 21:54:17.702141 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.702121    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 21:54:17.702216 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.702175    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2b7dr\""
Jul 27 21:54:17.703833 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.703746    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f82sq"
Jul 27 21:54:17.703941 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.703890    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 21:54:17.704116 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.704101    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 21:54:17.704191 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.704141    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wdn2g\""
Jul 27 21:54:17.706351 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.705964    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 21:54:17.706351 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.706062    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 21:54:17.706351 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.706094    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.706351 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.706117    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x5s22\""
Jul 27 21:54:17.707315 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.707287    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 21:54:17.707315 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.707306    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 21:54:17.708200 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.708184    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 21:54:17.708510 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.708459    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 21:54:17.708593 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.708524    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jrdj5\""
Jul 27 21:54:17.708659 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.708643    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.709884 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.709861    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 21:54:17.710037 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.710020    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 21:54:17.710037 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.710030    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 21:54:17.710346 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.710298    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 21:54:17.711980 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.711959    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dttzh"
Jul 27 21:54:17.714388 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.714304    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 21:54:17.714476 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.714458    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 21:54:17.714709 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.714690    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:17.714791 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:17.714763    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgt8f" podUID="807200be-220e-4e07-8641-8b0bd2788381"
Jul 27 21:54:17.714846 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.714812    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 21:54:17.714890 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.714840    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 21:54:17.714890 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.714857    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 21:54:17.715555 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.715540    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x57hn\""
Jul 27 21:54:17.715650 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.715557    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 21:54:17.715706 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.715650    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 21:54:17.715819 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.715784    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9pvkt\""
Jul 27 21:54:17.717081 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.717055    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-82r4r"
Jul 27 21:54:17.717608 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.717591    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89949e5c-3381-42ac-a650-5bc1994464b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.717682 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.717616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb157c02-c15b-478b-995d-c42405aff70e-hosts-file\") pod \"node-resolver-pxjs5\" (UID: \"eb157c02-c15b-478b-995d-c42405aff70e\") " pod="openshift-dns/node-resolver-pxjs5"
Jul 27 21:54:17.717682 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.717631    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-kubelet\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.717682 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.717653    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f82f51e4-ec5e-405e-97f1-8b12129dff3c-system-cni-dir\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.717809 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.717685    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jnnf\" (UniqueName: \"kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf\") pod \"network-check-target-btrhh\" (UID: \"eefb4933-08a8-4afb-a044-33331c4074b6\") " pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:17.717809 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.717716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e9e76fd-a285-4410-b6c3-4247ba933efa-tmp\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.717809 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.717742    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-var-lib-openvswitch\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.717809 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.717765    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e5b27b10-c331-4eb3-afa0-f8af1ff913b2-agent-certs\") pod \"konnectivity-agent-dttzh\" (UID: \"e5b27b10-c331-4eb3-afa0-f8af1ff913b2\") " pod="kube-system/konnectivity-agent-dttzh"
Jul 27 21:54:17.717809 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.717802    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-run\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.718030 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.717830    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-tuned\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.718030 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.717860    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89949e5c-3381-42ac-a650-5bc1994464b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.718030 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.717882    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgr8r\" (UniqueName: \"kubernetes.io/projected/eb157c02-c15b-478b-995d-c42405aff70e-kube-api-access-pgr8r\") pod \"node-resolver-pxjs5\" (UID: \"eb157c02-c15b-478b-995d-c42405aff70e\") " pod="openshift-dns/node-resolver-pxjs5"
Jul 27 21:54:17.718030 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.717900    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f8lj\" (UniqueName: \"kubernetes.io/projected/89949e5c-3381-42ac-a650-5bc1994464b9-kube-api-access-7f8lj\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.718030 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.717936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb157c02-c15b-478b-995d-c42405aff70e-tmp-dir\") pod \"node-resolver-pxjs5\" (UID: \"eb157c02-c15b-478b-995d-c42405aff70e\") " pod="openshift-dns/node-resolver-pxjs5"
Jul 27 21:54:17.718030 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.717963    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-node-log\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.718030 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.717981    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/436e16da-313f-4334-bf1d-738922f32b0e-env-overrides\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.718030 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718016    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f82f51e4-ec5e-405e-97f1-8b12129dff3c-cnibin\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.718388 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f82f51e4-ec5e-405e-97f1-8b12129dff3c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.718388 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89949e5c-3381-42ac-a650-5bc1994464b9-device-dir\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.718388 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-sysconfig\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.718388 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718132    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-sysctl-conf\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.718388 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718159    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/436e16da-313f-4334-bf1d-738922f32b0e-ovnkube-script-lib\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.718388 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkfz9\" (UniqueName: \"kubernetes.io/projected/436e16da-313f-4334-bf1d-738922f32b0e-kube-api-access-rkfz9\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.718388 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718196    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-slash\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.718388 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718229    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-run-systemd\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.718388 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718258    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-etc-openvswitch\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.718388 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f82f51e4-ec5e-405e-97f1-8b12129dff3c-cni-binary-copy\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.718388 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718373    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/881ffdfa-9a29-42e3-828d-23523dd11af5-host\") pod \"node-ca-f82sq\" (UID: \"881ffdfa-9a29-42e3-828d-23523dd11af5\") " pod="openshift-image-registry/node-ca-f82sq"
Jul 27 21:54:17.718863 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718394    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-run-netns\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.718863 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718427    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f82f51e4-ec5e-405e-97f1-8b12129dff3c-os-release\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.718863 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718452    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-kubernetes\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.718863 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-sysctl-d\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.718863 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718505    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-run-ovn\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.718863 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718521    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f82f51e4-ec5e-405e-97f1-8b12129dff3c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.718863 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-modprobe-d\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.718863 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718553    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f82f51e4-ec5e-405e-97f1-8b12129dff3c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.718863 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718578    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-run-ovn-kubernetes\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.718863 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718614    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-cni-bin\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.718863 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718660    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/881ffdfa-9a29-42e3-828d-23523dd11af5-serviceca\") pod \"node-ca-f82sq\" (UID: \"881ffdfa-9a29-42e3-828d-23523dd11af5\") " pod="openshift-image-registry/node-ca-f82sq"
Jul 27 21:54:17.718863 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718698    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-log-socket\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.718863 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718730    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-run-openvswitch\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.718863 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718757    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/436e16da-313f-4334-bf1d-738922f32b0e-ovn-node-metrics-cert\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.718863 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718781    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsxzw\" (UniqueName: \"kubernetes.io/projected/881ffdfa-9a29-42e3-828d-23523dd11af5-kube-api-access-tsxzw\") pod \"node-ca-f82sq\" (UID: \"881ffdfa-9a29-42e3-828d-23523dd11af5\") " pod="openshift-image-registry/node-ca-f82sq"
Jul 27 21:54:17.718863 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718803    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8vbn\" (UniqueName: \"kubernetes.io/projected/f82f51e4-ec5e-405e-97f1-8b12129dff3c-kube-api-access-z8vbn\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.719600 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89949e5c-3381-42ac-a650-5bc1994464b9-registration-dir\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.719600 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718856    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-lib-modules\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.719600 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718877    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/436e16da-313f-4334-bf1d-738922f32b0e-ovnkube-config\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.719600 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718900    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e5b27b10-c331-4eb3-afa0-f8af1ff913b2-konnectivity-ca\") pod \"konnectivity-agent-dttzh\" (UID: \"e5b27b10-c331-4eb3-afa0-f8af1ff913b2\") " pod="kube-system/konnectivity-agent-dttzh"
Jul 27 21:54:17.719600 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89949e5c-3381-42ac-a650-5bc1994464b9-socket-dir\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.719600 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.718968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-sys\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.719600 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.719008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-var-lib-kubelet\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.719600 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.719031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-host\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.719600 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.719053    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98ffm\" (UniqueName: \"kubernetes.io/projected/3e9e76fd-a285-4410-b6c3-4247ba933efa-kube-api-access-98ffm\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.719600 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.719086    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89949e5c-3381-42ac-a650-5bc1994464b9-sys-fs\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.719600 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.719107    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-systemd\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.719600 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.719129    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-systemd-units\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.719600 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.719164    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-cni-netd\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.719600 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.719210    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.719600 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.719442    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.720278 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.719701    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 21:54:17.720278 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.719701    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 21:54:17.720278 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.719757    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wvqfm\""
Jul 27 21:54:17.720420 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.720324    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 21:54:17.721606 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.721586    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6xcrd\""
Jul 27 21:54:17.721606 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.721599    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 21:54:17.721771 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.721754    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:17.721842 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:17.721823    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kg8x5" podUID="0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0"
Jul 27 21:54:17.722609 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.722465    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 21:54:17.747045 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.747023    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vzvc4"
Jul 27 21:54:17.755855 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.755832    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vzvc4"
Jul 27 21:54:17.813568 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.811368    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 21:54:17.817191 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.817102    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal" event={"ID":"7963463b045c47d8fc8e02283f628750","Type":"ContainerStarted","Data":"69ce986c0febefd1dd1af8401658ab19185b44fe32e4a9000edad8af1e07b2c4"}
Jul 27 21:54:17.818688 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.818629    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal" event={"ID":"6a755af5e74d549c2ee35a96b8fe147c","Type":"ContainerStarted","Data":"c293527c3ee7f2b7befc6bc63817fa4204d742a089c7780bcb87cab4a7860a33"}
Jul 27 21:54:17.820310 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820288    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89949e5c-3381-42ac-a650-5bc1994464b9-sys-fs\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.820310 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820315    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-systemd\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.820492 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820355    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-systemd-units\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.820492 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-cni-netd\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.820492 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820404    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.820492 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820415    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89949e5c-3381-42ac-a650-5bc1994464b9-sys-fs\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.820492 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret\") pod \"global-pull-secret-syncer-kg8x5\" (UID: \"0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0\") " pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:17.820492 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820460    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89949e5c-3381-42ac-a650-5bc1994464b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.820492 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820479    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-systemd-units\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.820492 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820483    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb157c02-c15b-478b-995d-c42405aff70e-hosts-file\") pod \"node-resolver-pxjs5\" (UID: \"eb157c02-c15b-478b-995d-c42405aff70e\") " pod="openshift-dns/node-resolver-pxjs5"
Jul 27 21:54:17.820864 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-kubelet\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.820864 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820540    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-cni-netd\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.820864 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f82f51e4-ec5e-405e-97f1-8b12129dff3c-system-cni-dir\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.820864 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820571    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-host-var-lib-cni-multus\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.820864 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.820864 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-host-run-multus-certs\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.820864 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820658    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-systemd\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.820864 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jnnf\" (UniqueName: \"kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf\") pod \"network-check-target-btrhh\" (UID: \"eefb4933-08a8-4afb-a044-33331c4074b6\") " pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:17.820864 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820704    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89949e5c-3381-42ac-a650-5bc1994464b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.820864 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820724    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb157c02-c15b-478b-995d-c42405aff70e-hosts-file\") pod \"node-resolver-pxjs5\" (UID: \"eb157c02-c15b-478b-995d-c42405aff70e\") " pod="openshift-dns/node-resolver-pxjs5"
Jul 27 21:54:17.820864 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820709    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e9e76fd-a285-4410-b6c3-4247ba933efa-tmp\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.820864 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820754    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f82f51e4-ec5e-405e-97f1-8b12129dff3c-system-cni-dir\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.820864 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820759    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-var-lib-openvswitch\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.820864 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820784    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e5b27b10-c331-4eb3-afa0-f8af1ff913b2-agent-certs\") pod \"konnectivity-agent-dttzh\" (UID: \"e5b27b10-c331-4eb3-afa0-f8af1ff913b2\") " pod="kube-system/konnectivity-agent-dttzh"
Jul 27 21:54:17.820864 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820802    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-var-lib-openvswitch\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.820864 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820810    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-host-run-netns\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.820864 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820756    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-kubelet\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.821604 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820845    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-run\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.821604 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820867    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-tuned\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.821604 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820891    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89949e5c-3381-42ac-a650-5bc1994464b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.821604 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820912    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgr8r\" (UniqueName: \"kubernetes.io/projected/eb157c02-c15b-478b-995d-c42405aff70e-kube-api-access-pgr8r\") pod \"node-resolver-pxjs5\" (UID: \"eb157c02-c15b-478b-995d-c42405aff70e\") " pod="openshift-dns/node-resolver-pxjs5"
Jul 27 21:54:17.821604 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820938    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f8lj\" (UniqueName: \"kubernetes.io/projected/89949e5c-3381-42ac-a650-5bc1994464b9-kube-api-access-7f8lj\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.821604 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820960    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb157c02-c15b-478b-995d-c42405aff70e-tmp-dir\") pod \"node-resolver-pxjs5\" (UID: \"eb157c02-c15b-478b-995d-c42405aff70e\") " pod="openshift-dns/node-resolver-pxjs5"
Jul 27 21:54:17.821604 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.820981    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-node-log\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.821604 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/436e16da-313f-4334-bf1d-738922f32b0e-env-overrides\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.821604 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821005    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-run\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.821604 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821019    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 21:54:17.821604 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f82f51e4-ec5e-405e-97f1-8b12129dff3c-cnibin\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.821604 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821064    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f82f51e4-ec5e-405e-97f1-8b12129dff3c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.821604 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821066    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89949e5c-3381-42ac-a650-5bc1994464b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.821604 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821099    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwkdd\" (UniqueName: \"kubernetes.io/projected/3611ede8-5415-4ada-8800-39d88377ec13-kube-api-access-zwkdd\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.821604 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89949e5c-3381-42ac-a650-5bc1994464b9-device-dir\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.821604 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821151    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-sysconfig\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.821604 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821174    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-sysctl-conf\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.822280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821197    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/436e16da-313f-4334-bf1d-738922f32b0e-ovnkube-script-lib\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.822280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821211    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89949e5c-3381-42ac-a650-5bc1994464b9-device-dir\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.822280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821221    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkfz9\" (UniqueName: \"kubernetes.io/projected/436e16da-313f-4334-bf1d-738922f32b0e-kube-api-access-rkfz9\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.822280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821260    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-multus-cni-dir\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.822280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821285    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-os-release\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.822280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821287    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb157c02-c15b-478b-995d-c42405aff70e-tmp-dir\") pod \"node-resolver-pxjs5\" (UID: \"eb157c02-c15b-478b-995d-c42405aff70e\") " pod="openshift-dns/node-resolver-pxjs5"
Jul 27 21:54:17.822280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821324    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3611ede8-5415-4ada-8800-39d88377ec13-cni-binary-copy\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.822280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821370    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-slash\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.822280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821404    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-run-systemd\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.822280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-etc-openvswitch\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.822280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821467    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f82f51e4-ec5e-405e-97f1-8b12129dff3c-cni-binary-copy\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.822280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821479    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-sysconfig\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.822280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/881ffdfa-9a29-42e3-828d-23523dd11af5-host\") pod \"node-ca-f82sq\" (UID: \"881ffdfa-9a29-42e3-828d-23523dd11af5\") " pod="openshift-image-registry/node-ca-f82sq"
Jul 27 21:54:17.822280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821527    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-multus-socket-dir-parent\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.822280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821533    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/881ffdfa-9a29-42e3-828d-23523dd11af5-host\") pod \"node-ca-f82sq\" (UID: \"881ffdfa-9a29-42e3-828d-23523dd11af5\") " pod="openshift-image-registry/node-ca-f82sq"
Jul 27 21:54:17.822280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821590    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-host-var-lib-cni-bin\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.822280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821606    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f82f51e4-ec5e-405e-97f1-8b12129dff3c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.823086 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-multus-conf-dir\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.823086 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821639    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-run-netns\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.823086 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821662    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-sysctl-conf\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.823086 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821666    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f82f51e4-ec5e-405e-97f1-8b12129dff3c-cnibin\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.823086 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-node-log\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.823086 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821709    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/436e16da-313f-4334-bf1d-738922f32b0e-env-overrides\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.823086 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f82f51e4-ec5e-405e-97f1-8b12129dff3c-os-release\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.823086 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821755    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs\") pod \"network-metrics-daemon-lgt8f\" (UID: \"807200be-220e-4e07-8641-8b0bd2788381\") " pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:17.823086 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821772    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-run-systemd\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.823086 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821782    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f82f51e4-ec5e-405e-97f1-8b12129dff3c-os-release\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.823086 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821785    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-hostroot\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.823086 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821810    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-run-netns\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.823086 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821813    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-etc-openvswitch\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.823086 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821845    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-kubernetes\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.823086 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-sysctl-d\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.823086 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-run-ovn\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.823086 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821918    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-kubernetes\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.823868 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821943    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f82f51e4-ec5e-405e-97f1-8b12129dff3c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.823868 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.821984    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37fa0583-e8c9-4e69-aeb6-aa38a78e4be4-host-slash\") pod \"iptables-alerter-82r4r\" (UID: \"37fa0583-e8c9-4e69-aeb6-aa38a78e4be4\") " pod="openshift-network-operator/iptables-alerter-82r4r"
Jul 27 21:54:17.823868 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822011    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-host-var-lib-kubelet\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.823868 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822039    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-sysctl-d\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.823868 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-etc-kubernetes\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.823868 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822079    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-slash\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.823868 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822088    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-modprobe-d\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.823868 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822112    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-run-ovn\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.823868 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822112    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f82f51e4-ec5e-405e-97f1-8b12129dff3c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.823868 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822156    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhttz\" (UniqueName: \"kubernetes.io/projected/37fa0583-e8c9-4e69-aeb6-aa38a78e4be4-kube-api-access-fhttz\") pod \"iptables-alerter-82r4r\" (UID: \"37fa0583-e8c9-4e69-aeb6-aa38a78e4be4\") " pod="openshift-network-operator/iptables-alerter-82r4r"
Jul 27 21:54:17.823868 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822180    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-cnibin\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.823868 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822204    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/436e16da-313f-4334-bf1d-738922f32b0e-ovnkube-script-lib\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.823868 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822206    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-run-ovn-kubernetes\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.823868 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822242    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-run-ovn-kubernetes\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.823868 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822246    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f82f51e4-ec5e-405e-97f1-8b12129dff3c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.823868 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-cni-bin\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.823868 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822324    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/881ffdfa-9a29-42e3-828d-23523dd11af5-serviceca\") pod \"node-ca-f82sq\" (UID: \"881ffdfa-9a29-42e3-828d-23523dd11af5\") " pod="openshift-image-registry/node-ca-f82sq"
Jul 27 21:54:17.824660 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822367    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-modprobe-d\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.824660 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822368    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f82f51e4-ec5e-405e-97f1-8b12129dff3c-cni-binary-copy\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.824660 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822384    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-host-cni-bin\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.824660 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822413    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-host-run-k8s-cni-cncf-io\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.824660 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822453    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-log-socket\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.824660 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37fa0583-e8c9-4e69-aeb6-aa38a78e4be4-iptables-alerter-script\") pod \"iptables-alerter-82r4r\" (UID: \"37fa0583-e8c9-4e69-aeb6-aa38a78e4be4\") " pod="openshift-network-operator/iptables-alerter-82r4r"
Jul 27 21:54:17.824660 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822490    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-system-cni-dir\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.824660 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822524    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-dbus\") pod \"global-pull-secret-syncer-kg8x5\" (UID: \"0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0\") " pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:17.824660 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822530    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-log-socket\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.824660 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822555    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-run-openvswitch\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.824660 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822589    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/436e16da-313f-4334-bf1d-738922f32b0e-ovn-node-metrics-cert\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.824660 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822597    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f82f51e4-ec5e-405e-97f1-8b12129dff3c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.824660 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822629    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/436e16da-313f-4334-bf1d-738922f32b0e-run-openvswitch\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.824660 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsxzw\" (UniqueName: \"kubernetes.io/projected/881ffdfa-9a29-42e3-828d-23523dd11af5-kube-api-access-tsxzw\") pod \"node-ca-f82sq\" (UID: \"881ffdfa-9a29-42e3-828d-23523dd11af5\") " pod="openshift-image-registry/node-ca-f82sq"
Jul 27 21:54:17.824660 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822678    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3611ede8-5415-4ada-8800-39d88377ec13-multus-daemon-config\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.824660 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822696    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/881ffdfa-9a29-42e3-828d-23523dd11af5-serviceca\") pod \"node-ca-f82sq\" (UID: \"881ffdfa-9a29-42e3-828d-23523dd11af5\") " pod="openshift-image-registry/node-ca-f82sq"
Jul 27 21:54:17.824660 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822729    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8vbn\" (UniqueName: \"kubernetes.io/projected/f82f51e4-ec5e-405e-97f1-8b12129dff3c-kube-api-access-z8vbn\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.825460 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89949e5c-3381-42ac-a650-5bc1994464b9-registration-dir\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.825460 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-lib-modules\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.825460 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/436e16da-313f-4334-bf1d-738922f32b0e-ovnkube-config\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.825460 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822903    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89949e5c-3381-42ac-a650-5bc1994464b9-registration-dir\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.825460 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822907    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e5b27b10-c331-4eb3-afa0-f8af1ff913b2-konnectivity-ca\") pod \"konnectivity-agent-dttzh\" (UID: \"e5b27b10-c331-4eb3-afa0-f8af1ff913b2\") " pod="kube-system/konnectivity-agent-dttzh"
Jul 27 21:54:17.825460 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822958    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tbrk\" (UniqueName: \"kubernetes.io/projected/807200be-220e-4e07-8641-8b0bd2788381-kube-api-access-6tbrk\") pod \"network-metrics-daemon-lgt8f\" (UID: \"807200be-220e-4e07-8641-8b0bd2788381\") " pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:17.825460 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822959    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-lib-modules\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.825460 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.822990    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89949e5c-3381-42ac-a650-5bc1994464b9-socket-dir\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.825460 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.823013    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-sys\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.825460 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.823069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-var-lib-kubelet\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.825460 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.823094    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89949e5c-3381-42ac-a650-5bc1994464b9-socket-dir\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.825460 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.823112    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-host\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.825460 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.823151    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-var-lib-kubelet\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.825460 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.823165    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-host\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.825460 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.823176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98ffm\" (UniqueName: \"kubernetes.io/projected/3e9e76fd-a285-4410-b6c3-4247ba933efa-kube-api-access-98ffm\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.825460 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.823207    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e9e76fd-a285-4410-b6c3-4247ba933efa-sys\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.825460 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.823239    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-kubelet-config\") pod \"global-pull-secret-syncer-kg8x5\" (UID: \"0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0\") " pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:17.826261 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.823505    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e5b27b10-c331-4eb3-afa0-f8af1ff913b2-konnectivity-ca\") pod \"konnectivity-agent-dttzh\" (UID: \"e5b27b10-c331-4eb3-afa0-f8af1ff913b2\") " pod="kube-system/konnectivity-agent-dttzh"
Jul 27 21:54:17.826261 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.823575    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/436e16da-313f-4334-bf1d-738922f32b0e-ovnkube-config\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.826261 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.824287    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e9e76fd-a285-4410-b6c3-4247ba933efa-tmp\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.826261 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.825137    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3e9e76fd-a285-4410-b6c3-4247ba933efa-etc-tuned\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.826261 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.825561    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/436e16da-313f-4334-bf1d-738922f32b0e-ovn-node-metrics-cert\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.826916 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.826884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e5b27b10-c331-4eb3-afa0-f8af1ff913b2-agent-certs\") pod \"konnectivity-agent-dttzh\" (UID: \"e5b27b10-c331-4eb3-afa0-f8af1ff913b2\") " pod="kube-system/konnectivity-agent-dttzh"
Jul 27 21:54:17.830475 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:17.830451    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 21:54:17.830587 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:17.830483    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 21:54:17.830587 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:17.830502    2565 projected.go:196] Error preparing data for projected volume kube-api-access-5jnnf for pod openshift-network-diagnostics/network-check-target-btrhh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:54:17.830587 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:17.830572    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf podName:eefb4933-08a8-4afb-a044-33331c4074b6 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:18.330544476 +0000 UTC m=+3.071679227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5jnnf" (UniqueName: "kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf") pod "network-check-target-btrhh" (UID: "eefb4933-08a8-4afb-a044-33331c4074b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:54:17.835884 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.835346    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsxzw\" (UniqueName: \"kubernetes.io/projected/881ffdfa-9a29-42e3-828d-23523dd11af5-kube-api-access-tsxzw\") pod \"node-ca-f82sq\" (UID: \"881ffdfa-9a29-42e3-828d-23523dd11af5\") " pod="openshift-image-registry/node-ca-f82sq"
Jul 27 21:54:17.835884 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.835837    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8vbn\" (UniqueName: \"kubernetes.io/projected/f82f51e4-ec5e-405e-97f1-8b12129dff3c-kube-api-access-z8vbn\") pod \"multus-additional-cni-plugins-792l4\" (UID: \"f82f51e4-ec5e-405e-97f1-8b12129dff3c\") " pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:17.835884 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.835842    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f8lj\" (UniqueName: \"kubernetes.io/projected/89949e5c-3381-42ac-a650-5bc1994464b9-kube-api-access-7f8lj\") pod \"aws-ebs-csi-driver-node-7xkx7\" (UID: \"89949e5c-3381-42ac-a650-5bc1994464b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:17.836245 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.836222    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkfz9\" (UniqueName: \"kubernetes.io/projected/436e16da-313f-4334-bf1d-738922f32b0e-kube-api-access-rkfz9\") pod \"ovnkube-node-lgj5w\" (UID: \"436e16da-313f-4334-bf1d-738922f32b0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:17.836922 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.836902    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98ffm\" (UniqueName: \"kubernetes.io/projected/3e9e76fd-a285-4410-b6c3-4247ba933efa-kube-api-access-98ffm\") pod \"tuned-vskvb\" (UID: \"3e9e76fd-a285-4410-b6c3-4247ba933efa\") " pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:17.837690 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.837651    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgr8r\" (UniqueName: \"kubernetes.io/projected/eb157c02-c15b-478b-995d-c42405aff70e-kube-api-access-pgr8r\") pod \"node-resolver-pxjs5\" (UID: \"eb157c02-c15b-478b-995d-c42405aff70e\") " pod="openshift-dns/node-resolver-pxjs5"
Jul 27 21:54:17.925691 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924063    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-multus-cni-dir\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.925691 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924106    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-os-release\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.925691 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924130    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3611ede8-5415-4ada-8800-39d88377ec13-cni-binary-copy\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.925691 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-multus-socket-dir-parent\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.925691 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-host-var-lib-cni-bin\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.925691 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924194    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-multus-conf-dir\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.925691 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924216    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs\") pod \"network-metrics-daemon-lgt8f\" (UID: \"807200be-220e-4e07-8641-8b0bd2788381\") " pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:17.925691 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-hostroot\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.925691 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924272    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37fa0583-e8c9-4e69-aeb6-aa38a78e4be4-host-slash\") pod \"iptables-alerter-82r4r\" (UID: \"37fa0583-e8c9-4e69-aeb6-aa38a78e4be4\") " pod="openshift-network-operator/iptables-alerter-82r4r"
Jul 27 21:54:17.925691 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924291    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-multus-cni-dir\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.925691 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924295    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-host-var-lib-kubelet\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.925691 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924347    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-host-var-lib-kubelet\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.925691 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-etc-kubernetes\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.925691 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhttz\" (UniqueName: \"kubernetes.io/projected/37fa0583-e8c9-4e69-aeb6-aa38a78e4be4-kube-api-access-fhttz\") pod \"iptables-alerter-82r4r\" (UID: \"37fa0583-e8c9-4e69-aeb6-aa38a78e4be4\") " pod="openshift-network-operator/iptables-alerter-82r4r"
Jul 27 21:54:17.925691 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924403    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-os-release\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.925691 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-cnibin\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.925691 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924452    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-host-run-k8s-cni-cncf-io\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.925691 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37fa0583-e8c9-4e69-aeb6-aa38a78e4be4-iptables-alerter-script\") pod \"iptables-alerter-82r4r\" (UID: \"37fa0583-e8c9-4e69-aeb6-aa38a78e4be4\") " pod="openshift-network-operator/iptables-alerter-82r4r"
Jul 27 21:54:17.926565 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924500    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-system-cni-dir\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.926565 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924519    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-dbus\") pod \"global-pull-secret-syncer-kg8x5\" (UID: \"0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0\") " pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:17.926565 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3611ede8-5415-4ada-8800-39d88377ec13-multus-daemon-config\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.926565 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tbrk\" (UniqueName: \"kubernetes.io/projected/807200be-220e-4e07-8641-8b0bd2788381-kube-api-access-6tbrk\") pod \"network-metrics-daemon-lgt8f\" (UID: \"807200be-220e-4e07-8641-8b0bd2788381\") " pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:17.926565 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924602    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-kubelet-config\") pod \"global-pull-secret-syncer-kg8x5\" (UID: \"0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0\") " pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:17.926565 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924631    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret\") pod \"global-pull-secret-syncer-kg8x5\" (UID: \"0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0\") " pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:17.926565 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924661    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-host-var-lib-cni-multus\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.926565 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924683    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-host-run-multus-certs\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.926565 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924720    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-host-run-netns\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.926565 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924755    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwkdd\" (UniqueName: \"kubernetes.io/projected/3611ede8-5415-4ada-8800-39d88377ec13-kube-api-access-zwkdd\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.926565 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.924975    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3611ede8-5415-4ada-8800-39d88377ec13-cni-binary-copy\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.926565 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.925049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-multus-socket-dir-parent\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.926565 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.925089    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-host-var-lib-cni-bin\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.926565 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.925127    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-multus-conf-dir\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.926565 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.925137    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-dbus\") pod \"global-pull-secret-syncer-kg8x5\" (UID: \"0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0\") " pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:17.926565 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.925203    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-etc-kubernetes\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.926565 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:17.925205    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:54:17.926565 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.925238    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-hostroot\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.927233 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.925279    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37fa0583-e8c9-4e69-aeb6-aa38a78e4be4-host-slash\") pod \"iptables-alerter-82r4r\" (UID: \"37fa0583-e8c9-4e69-aeb6-aa38a78e4be4\") " pod="openshift-network-operator/iptables-alerter-82r4r"
Jul 27 21:54:17.927233 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.925330    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-host-run-k8s-cni-cncf-io\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.927233 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:17.925407    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 21:54:17.927233 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:17.925421    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs podName:807200be-220e-4e07-8641-8b0bd2788381 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:18.425268779 +0000 UTC m=+3.166403561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs") pod "network-metrics-daemon-lgt8f" (UID: "807200be-220e-4e07-8641-8b0bd2788381") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:54:17.927233 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.925444    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3611ede8-5415-4ada-8800-39d88377ec13-multus-daemon-config\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.927233 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:17.925454    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret podName:0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:18.425440827 +0000 UTC m=+3.166575591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret") pod "global-pull-secret-syncer-kg8x5" (UID: "0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0") : object "kube-system"/"original-pull-secret" not registered
Jul 27 21:54:17.927233 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.925508    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-host-run-netns\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.927233 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.925516    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-kubelet-config\") pod \"global-pull-secret-syncer-kg8x5\" (UID: \"0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0\") " pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:17.927233 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.925565    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-system-cni-dir\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.927233 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.925581    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-cnibin\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.927233 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.925600    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-host-var-lib-cni-multus\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.927233 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.925656    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3611ede8-5415-4ada-8800-39d88377ec13-host-run-multus-certs\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:17.927233 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.925934    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37fa0583-e8c9-4e69-aeb6-aa38a78e4be4-iptables-alerter-script\") pod \"iptables-alerter-82r4r\" (UID: \"37fa0583-e8c9-4e69-aeb6-aa38a78e4be4\") " pod="openshift-network-operator/iptables-alerter-82r4r"
Jul 27 21:54:17.934243 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.934216    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tbrk\" (UniqueName: \"kubernetes.io/projected/807200be-220e-4e07-8641-8b0bd2788381-kube-api-access-6tbrk\") pod \"network-metrics-daemon-lgt8f\" (UID: \"807200be-220e-4e07-8641-8b0bd2788381\") " pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:17.935182 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.935161    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhttz\" (UniqueName: \"kubernetes.io/projected/37fa0583-e8c9-4e69-aeb6-aa38a78e4be4-kube-api-access-fhttz\") pod \"iptables-alerter-82r4r\" (UID: \"37fa0583-e8c9-4e69-aeb6-aa38a78e4be4\") " pod="openshift-network-operator/iptables-alerter-82r4r"
Jul 27 21:54:17.935277 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:17.935167    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwkdd\" (UniqueName: \"kubernetes.io/projected/3611ede8-5415-4ada-8800-39d88377ec13-kube-api-access-zwkdd\") pod \"multus-2l4n7\" (UID: \"3611ede8-5415-4ada-8800-39d88377ec13\") " pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:18.012511 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.012468    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7"
Jul 27 21:54:18.018544 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.018519    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vskvb"
Jul 27 21:54:18.026271 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.026244    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pxjs5"
Jul 27 21:54:18.026591 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:18.026567    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89949e5c_3381_42ac_a650_5bc1994464b9.slice/crio-9bff536ec36d08fdf4fcee32c465d1f374c0ac78dffa852e0faa5ce1c88544be WatchSource:0}: Error finding container 9bff536ec36d08fdf4fcee32c465d1f374c0ac78dffa852e0faa5ce1c88544be: Status 404 returned error can't find the container with id 9bff536ec36d08fdf4fcee32c465d1f374c0ac78dffa852e0faa5ce1c88544be
Jul 27 21:54:18.029547 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:18.029496    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e9e76fd_a285_4410_b6c3_4247ba933efa.slice/crio-6f00679a0ac90eacdff9bdb0317d99a6f4e66438445ae634d8c9dd7767218dd7 WatchSource:0}: Error finding container 6f00679a0ac90eacdff9bdb0317d99a6f4e66438445ae634d8c9dd7767218dd7: Status 404 returned error can't find the container with id 6f00679a0ac90eacdff9bdb0317d99a6f4e66438445ae634d8c9dd7767218dd7
Jul 27 21:54:18.035847 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.032352    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2l4n7"
Jul 27 21:54:18.038543 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.038522    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f82sq"
Jul 27 21:54:18.044558 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.044539    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:18.052107 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.052082    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-792l4"
Jul 27 21:54:18.059017 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.058999    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dttzh"
Jul 27 21:54:18.065690 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.065673    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-82r4r"
Jul 27 21:54:18.065819 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:18.065792    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3611ede8_5415_4ada_8800_39d88377ec13.slice/crio-b07822c2932b7a33d504b9676da2d818a25616d45ec80e52b6b8d3608734160d WatchSource:0}: Error finding container b07822c2932b7a33d504b9676da2d818a25616d45ec80e52b6b8d3608734160d: Status 404 returned error can't find the container with id b07822c2932b7a33d504b9676da2d818a25616d45ec80e52b6b8d3608734160d
Jul 27 21:54:18.075757 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:18.075675    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b27b10_c331_4eb3_afa0_f8af1ff913b2.slice/crio-bf32045d6a17115862ce434aa9ae9a9e6b7ca747089738f081902f28a3eca5f2 WatchSource:0}: Error finding container bf32045d6a17115862ce434aa9ae9a9e6b7ca747089738f081902f28a3eca5f2: Status 404 returned error can't find the container with id bf32045d6a17115862ce434aa9ae9a9e6b7ca747089738f081902f28a3eca5f2
Jul 27 21:54:18.077500 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:18.077476    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod881ffdfa_9a29_42e3_828d_23523dd11af5.slice/crio-5ebead4df9f05ca71a2933af506985832f8335c672b81757ad7e35521e2a695b WatchSource:0}: Error finding container 5ebead4df9f05ca71a2933af506985832f8335c672b81757ad7e35521e2a695b: Status 404 returned error can't find the container with id 5ebead4df9f05ca71a2933af506985832f8335c672b81757ad7e35521e2a695b
Jul 27 21:54:18.078450 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:18.078430    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82f51e4_ec5e_405e_97f1_8b12129dff3c.slice/crio-b4ff3565fe11db80eef852859e2c455069bbfa063aac4879d598953f6f0ee063 WatchSource:0}: Error finding container b4ff3565fe11db80eef852859e2c455069bbfa063aac4879d598953f6f0ee063: Status 404 returned error can't find the container with id b4ff3565fe11db80eef852859e2c455069bbfa063aac4879d598953f6f0ee063
Jul 27 21:54:18.081426 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:18.081403    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37fa0583_e8c9_4e69_aeb6_aa38a78e4be4.slice/crio-f70cab069665bbf1e90b3610123aa9409b7507312933a8b4b439838da332e92b WatchSource:0}: Error finding container f70cab069665bbf1e90b3610123aa9409b7507312933a8b4b439838da332e92b: Status 404 returned error can't find the container with id f70cab069665bbf1e90b3610123aa9409b7507312933a8b4b439838da332e92b
Jul 27 21:54:18.082653 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:18.082627    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod436e16da_313f_4334_bf1d_738922f32b0e.slice/crio-7831e980e23ac7798f3abec22c3eff42014b6a16730eccb68f970626db630fe8 WatchSource:0}: Error finding container 7831e980e23ac7798f3abec22c3eff42014b6a16730eccb68f970626db630fe8: Status 404 returned error can't find the container with id 7831e980e23ac7798f3abec22c3eff42014b6a16730eccb68f970626db630fe8
Jul 27 21:54:18.427775 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.427745    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret\") pod \"global-pull-secret-syncer-kg8x5\" (UID: \"0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0\") " pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:18.427945 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.427787    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jnnf\" (UniqueName: \"kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf\") pod \"network-check-target-btrhh\" (UID: \"eefb4933-08a8-4afb-a044-33331c4074b6\") " pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:18.427945 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.427824    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs\") pod \"network-metrics-daemon-lgt8f\" (UID: \"807200be-220e-4e07-8641-8b0bd2788381\") " pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:18.427945 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:18.427885    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 21:54:18.427945 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:18.427921    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:54:18.428150 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:18.427951    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret podName:0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:19.427930318 +0000 UTC m=+4.169065070 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret") pod "global-pull-secret-syncer-kg8x5" (UID: "0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0") : object "kube-system"/"original-pull-secret" not registered
Jul 27 21:54:18.428150 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:18.427968    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 21:54:18.428150 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:18.427989    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 21:54:18.428150 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:18.428002    2565 projected.go:196] Error preparing data for projected volume kube-api-access-5jnnf for pod openshift-network-diagnostics/network-check-target-btrhh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:54:18.428150 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:18.427971    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs podName:807200be-220e-4e07-8641-8b0bd2788381 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:19.427961729 +0000 UTC m=+4.169096474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs") pod "network-metrics-daemon-lgt8f" (UID: "807200be-220e-4e07-8641-8b0bd2788381") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:54:18.428150 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:18.428065    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf podName:eefb4933-08a8-4afb-a044-33331c4074b6 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:19.428048889 +0000 UTC m=+4.169183641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5jnnf" (UniqueName: "kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf") pod "network-check-target-btrhh" (UID: "eefb4933-08a8-4afb-a044-33331c4074b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:54:18.758777 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.758682    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 21:49:17 +0000 UTC" deadline="2027-12-30 00:00:29.747696591 +0000 UTC"
Jul 27 21:54:18.758777 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.758729    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12482h6m10.988970698s"
Jul 27 21:54:18.811312 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.811119    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:18.811488 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:18.811428    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kg8x5" podUID="0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0"
Jul 27 21:54:18.823107 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.823071    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal" event={"ID":"6a755af5e74d549c2ee35a96b8fe147c","Type":"ContainerStarted","Data":"201bcd60d500e57e7851d964872b8712bd1038af9ee9b24d89e1ec3a514f3a57"}
Jul 27 21:54:18.824271 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.824242    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-82r4r" event={"ID":"37fa0583-e8c9-4e69-aeb6-aa38a78e4be4","Type":"ContainerStarted","Data":"f70cab069665bbf1e90b3610123aa9409b7507312933a8b4b439838da332e92b"}
Jul 27 21:54:18.825432 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.825407    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f82sq" event={"ID":"881ffdfa-9a29-42e3-828d-23523dd11af5","Type":"ContainerStarted","Data":"5ebead4df9f05ca71a2933af506985832f8335c672b81757ad7e35521e2a695b"}
Jul 27 21:54:18.826591 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.826565    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dttzh" event={"ID":"e5b27b10-c331-4eb3-afa0-f8af1ff913b2","Type":"ContainerStarted","Data":"bf32045d6a17115862ce434aa9ae9a9e6b7ca747089738f081902f28a3eca5f2"}
Jul 27 21:54:18.827738 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.827713    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pxjs5" event={"ID":"eb157c02-c15b-478b-995d-c42405aff70e","Type":"ContainerStarted","Data":"b1722e684a61314f0ceaf201887e7da5c2179d491f371df99fe3008eebf4becd"}
Jul 27 21:54:18.828972 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.828951    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w" event={"ID":"436e16da-313f-4334-bf1d-738922f32b0e","Type":"ContainerStarted","Data":"7831e980e23ac7798f3abec22c3eff42014b6a16730eccb68f970626db630fe8"}
Jul 27 21:54:18.830063 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.830040    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-792l4" event={"ID":"f82f51e4-ec5e-405e-97f1-8b12129dff3c","Type":"ContainerStarted","Data":"b4ff3565fe11db80eef852859e2c455069bbfa063aac4879d598953f6f0ee063"}
Jul 27 21:54:18.831225 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.831204    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2l4n7" event={"ID":"3611ede8-5415-4ada-8800-39d88377ec13","Type":"ContainerStarted","Data":"b07822c2932b7a33d504b9676da2d818a25616d45ec80e52b6b8d3608734160d"}
Jul 27 21:54:18.832319 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.832301    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vskvb" event={"ID":"3e9e76fd-a285-4410-b6c3-4247ba933efa","Type":"ContainerStarted","Data":"6f00679a0ac90eacdff9bdb0317d99a6f4e66438445ae634d8c9dd7767218dd7"}
Jul 27 21:54:18.833466 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:18.833440    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7" event={"ID":"89949e5c-3381-42ac-a650-5bc1994464b9","Type":"ContainerStarted","Data":"9bff536ec36d08fdf4fcee32c465d1f374c0ac78dffa852e0faa5ce1c88544be"}
Jul 27 21:54:19.435559 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:19.434648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jnnf\" (UniqueName: \"kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf\") pod \"network-check-target-btrhh\" (UID: \"eefb4933-08a8-4afb-a044-33331c4074b6\") " pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:19.435559 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:19.434716    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs\") pod \"network-metrics-daemon-lgt8f\" (UID: \"807200be-220e-4e07-8641-8b0bd2788381\") " pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:19.435559 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:19.434765    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret\") pod \"global-pull-secret-syncer-kg8x5\" (UID: \"0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0\") " pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:19.435559 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:19.434883    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 21:54:19.435559 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:19.434954    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret podName:0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:21.434935094 +0000 UTC m=+6.176069846 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret") pod "global-pull-secret-syncer-kg8x5" (UID: "0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0") : object "kube-system"/"original-pull-secret" not registered
Jul 27 21:54:19.435559 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:19.435041    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 21:54:19.435559 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:19.435054    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 21:54:19.435559 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:19.435065    2565 projected.go:196] Error preparing data for projected volume kube-api-access-5jnnf for pod openshift-network-diagnostics/network-check-target-btrhh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:54:19.435559 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:19.435125    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf podName:eefb4933-08a8-4afb-a044-33331c4074b6 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:21.435113162 +0000 UTC m=+6.176247908 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5jnnf" (UniqueName: "kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf") pod "network-check-target-btrhh" (UID: "eefb4933-08a8-4afb-a044-33331c4074b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:54:19.435559 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:19.435186    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:54:19.435559 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:19.435219    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs podName:807200be-220e-4e07-8641-8b0bd2788381 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:21.435206385 +0000 UTC m=+6.176341136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs") pod "network-metrics-daemon-lgt8f" (UID: "807200be-220e-4e07-8641-8b0bd2788381") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:54:19.759355 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:19.759253    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 21:49:17 +0000 UTC" deadline="2028-03-25 12:54:02.401182867 +0000 UTC"
Jul 27 21:54:19.759355 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:19.759293    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14558h59m42.641893913s"
Jul 27 21:54:19.819287 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:19.816390    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:19.819287 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:19.816514    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btrhh" podUID="eefb4933-08a8-4afb-a044-33331c4074b6"
Jul 27 21:54:19.819287 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:19.816916    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:19.819287 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:19.817022    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgt8f" podUID="807200be-220e-4e07-8641-8b0bd2788381"
Jul 27 21:54:19.857733 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:19.857688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal" event={"ID":"7963463b045c47d8fc8e02283f628750","Type":"ContainerStarted","Data":"856f2cdadb879f7f1c4c6cb17a7d1a46939e03e9e10cd5279b17b1a23fca5e01"}
Jul 27 21:54:19.871379 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:19.871220    2565 generic.go:356] "Generic (PLEG): container finished" podID="6a755af5e74d549c2ee35a96b8fe147c" containerID="201bcd60d500e57e7851d964872b8712bd1038af9ee9b24d89e1ec3a514f3a57" exitCode=0
Jul 27 21:54:19.871379 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:19.871278    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal" event={"ID":"6a755af5e74d549c2ee35a96b8fe147c","Type":"ContainerDied","Data":"201bcd60d500e57e7851d964872b8712bd1038af9ee9b24d89e1ec3a514f3a57"}
Jul 27 21:54:19.874515 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:19.874391    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-114.ec2.internal" podStartSLOduration=2.8743709710000003 podStartE2EDuration="2.874370971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:54:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:54:19.873644967 +0000 UTC m=+4.614779735" watchObservedRunningTime="2026-07-27 21:54:19.874370971 +0000 UTC m=+4.615505742"
Jul 27 21:54:20.810640 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:20.810609    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:20.811071 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:20.810741    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kg8x5" podUID="0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0"
Jul 27 21:54:20.892483 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:20.892422    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal" event={"ID":"6a755af5e74d549c2ee35a96b8fe147c","Type":"ContainerStarted","Data":"63ccf1feee556eefebad70c9d802e1af2cce4b093caec18782215e7660b78efc"}
Jul 27 21:54:21.454364 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:21.453671    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs\") pod \"network-metrics-daemon-lgt8f\" (UID: \"807200be-220e-4e07-8641-8b0bd2788381\") " pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:21.454364 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:21.453748    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret\") pod \"global-pull-secret-syncer-kg8x5\" (UID: \"0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0\") " pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:21.454364 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:21.453779    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jnnf\" (UniqueName: \"kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf\") pod \"network-check-target-btrhh\" (UID: \"eefb4933-08a8-4afb-a044-33331c4074b6\") " pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:21.454364 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:21.453935    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 21:54:21.454364 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:21.453956    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 21:54:21.454364 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:21.453969    2565 projected.go:196] Error preparing data for projected volume kube-api-access-5jnnf for pod openshift-network-diagnostics/network-check-target-btrhh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:54:21.454364 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:21.454026    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf podName:eefb4933-08a8-4afb-a044-33331c4074b6 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:25.454007217 +0000 UTC m=+10.195141978 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5jnnf" (UniqueName: "kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf") pod "network-check-target-btrhh" (UID: "eefb4933-08a8-4afb-a044-33331c4074b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:54:21.454364 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:21.454264    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 21:54:21.454364 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:21.454346    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret podName:0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:25.454316179 +0000 UTC m=+10.195450943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret") pod "global-pull-secret-syncer-kg8x5" (UID: "0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0") : object "kube-system"/"original-pull-secret" not registered
Jul 27 21:54:21.454364 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:21.454348    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:54:21.454988 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:21.454396    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs podName:807200be-220e-4e07-8641-8b0bd2788381 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:25.454383835 +0000 UTC m=+10.195518600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs") pod "network-metrics-daemon-lgt8f" (UID: "807200be-220e-4e07-8641-8b0bd2788381") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:54:21.815016 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:21.814938    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:21.815464 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:21.815062    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btrhh" podUID="eefb4933-08a8-4afb-a044-33331c4074b6"
Jul 27 21:54:21.815464 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:21.815137    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:21.815464 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:21.815219    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgt8f" podUID="807200be-220e-4e07-8641-8b0bd2788381"
Jul 27 21:54:22.810878 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:22.810842    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:22.811055 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:22.810987    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kg8x5" podUID="0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0"
Jul 27 21:54:23.814842 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:23.814791    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:23.814842 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:23.814822    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:23.815311 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:23.814914    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btrhh" podUID="eefb4933-08a8-4afb-a044-33331c4074b6"
Jul 27 21:54:23.815311 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:23.815072    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgt8f" podUID="807200be-220e-4e07-8641-8b0bd2788381"
Jul 27 21:54:24.810422 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:24.810388    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:24.810590 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:24.810527    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kg8x5" podUID="0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0"
Jul 27 21:54:25.485039 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:25.485002    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs\") pod \"network-metrics-daemon-lgt8f\" (UID: \"807200be-220e-4e07-8641-8b0bd2788381\") " pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:25.485500 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:25.485073    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret\") pod \"global-pull-secret-syncer-kg8x5\" (UID: \"0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0\") " pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:25.485500 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:25.485107    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jnnf\" (UniqueName: \"kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf\") pod \"network-check-target-btrhh\" (UID: \"eefb4933-08a8-4afb-a044-33331c4074b6\") " pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:25.485500 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:25.485258    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 21:54:25.485500 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:25.485275    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 21:54:25.485500 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:25.485287    2565 projected.go:196] Error preparing data for projected volume kube-api-access-5jnnf for pod openshift-network-diagnostics/network-check-target-btrhh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:54:25.485500 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:25.485358    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf podName:eefb4933-08a8-4afb-a044-33331c4074b6 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:33.485323619 +0000 UTC m=+18.226458381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5jnnf" (UniqueName: "kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf") pod "network-check-target-btrhh" (UID: "eefb4933-08a8-4afb-a044-33331c4074b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:54:25.485500 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:25.485480    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:54:25.485849 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:25.485536    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 21:54:25.485849 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:25.485547    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs podName:807200be-220e-4e07-8641-8b0bd2788381 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:33.485530973 +0000 UTC m=+18.226665737 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs") pod "network-metrics-daemon-lgt8f" (UID: "807200be-220e-4e07-8641-8b0bd2788381") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:54:25.485849 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:25.485589    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret podName:0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:33.485576196 +0000 UTC m=+18.226710956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret") pod "global-pull-secret-syncer-kg8x5" (UID: "0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0") : object "kube-system"/"original-pull-secret" not registered
Jul 27 21:54:25.810617 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:25.810540    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:25.811776 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:25.811653    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:25.811893 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:25.811783    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btrhh" podUID="eefb4933-08a8-4afb-a044-33331c4074b6"
Jul 27 21:54:25.811893 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:25.811883    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgt8f" podUID="807200be-220e-4e07-8641-8b0bd2788381"
Jul 27 21:54:26.811539 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:26.811193    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:26.811539 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:26.811351    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kg8x5" podUID="0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0"
Jul 27 21:54:27.811187 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:27.811150    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:27.811376 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:27.811276    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btrhh" podUID="eefb4933-08a8-4afb-a044-33331c4074b6"
Jul 27 21:54:27.811438 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:27.811149    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:27.811578 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:27.811552    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgt8f" podUID="807200be-220e-4e07-8641-8b0bd2788381"
Jul 27 21:54:28.810617 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:28.810589    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:28.810762 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:28.810697    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kg8x5" podUID="0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0"
Jul 27 21:54:29.810961 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:29.810915    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:29.811432 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:29.811053    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgt8f" podUID="807200be-220e-4e07-8641-8b0bd2788381"
Jul 27 21:54:29.811432 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:29.811130    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:29.811432 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:29.811230    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btrhh" podUID="eefb4933-08a8-4afb-a044-33331c4074b6"
Jul 27 21:54:30.810852 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:30.810812    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:30.811018 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:30.810957    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kg8x5" podUID="0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0"
Jul 27 21:54:31.811419 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:31.811382    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:31.811867 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:31.811564    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btrhh" podUID="eefb4933-08a8-4afb-a044-33331c4074b6"
Jul 27 21:54:31.811867 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:31.811690    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:31.815171 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:31.815139    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgt8f" podUID="807200be-220e-4e07-8641-8b0bd2788381"
Jul 27 21:54:32.811296 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:32.811211    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:32.811493 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:32.811356    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kg8x5" podUID="0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0"
Jul 27 21:54:33.549204 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:33.549163    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret\") pod \"global-pull-secret-syncer-kg8x5\" (UID: \"0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0\") " pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:33.549487 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:33.549213    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jnnf\" (UniqueName: \"kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf\") pod \"network-check-target-btrhh\" (UID: \"eefb4933-08a8-4afb-a044-33331c4074b6\") " pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:33.549487 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:33.549244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs\") pod \"network-metrics-daemon-lgt8f\" (UID: \"807200be-220e-4e07-8641-8b0bd2788381\") " pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:33.549487 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:33.549283    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 21:54:33.549487 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:33.549330    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:54:33.549487 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:33.549365    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret podName:0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:49.549344641 +0000 UTC m=+34.290479400 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret") pod "global-pull-secret-syncer-kg8x5" (UID: "0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0") : object "kube-system"/"original-pull-secret" not registered
Jul 27 21:54:33.549487 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:33.549389    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs podName:807200be-220e-4e07-8641-8b0bd2788381 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:49.549376418 +0000 UTC m=+34.290511163 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs") pod "network-metrics-daemon-lgt8f" (UID: "807200be-220e-4e07-8641-8b0bd2788381") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:54:33.549487 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:33.549395    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 21:54:33.549487 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:33.549415    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 21:54:33.549487 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:33.549429    2565 projected.go:196] Error preparing data for projected volume kube-api-access-5jnnf for pod openshift-network-diagnostics/network-check-target-btrhh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:54:33.549487 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:33.549479    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf podName:eefb4933-08a8-4afb-a044-33331c4074b6 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:49.549463991 +0000 UTC m=+34.290598757 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5jnnf" (UniqueName: "kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf") pod "network-check-target-btrhh" (UID: "eefb4933-08a8-4afb-a044-33331c4074b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:54:33.810732 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:33.810650    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:33.810891 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:33.810785    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgt8f" podUID="807200be-220e-4e07-8641-8b0bd2788381"
Jul 27 21:54:33.810891 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:33.810834    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:33.811005 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:33.810915    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btrhh" podUID="eefb4933-08a8-4afb-a044-33331c4074b6"
Jul 27 21:54:34.810658 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:34.810620    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:34.811111 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:34.810764    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kg8x5" podUID="0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0"
Jul 27 21:54:35.812127 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:35.812094    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:35.812594 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:35.812215    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgt8f" podUID="807200be-220e-4e07-8641-8b0bd2788381"
Jul 27 21:54:35.812594 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:35.812266    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:35.812594 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:35.812384    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btrhh" podUID="eefb4933-08a8-4afb-a044-33331c4074b6"
Jul 27 21:54:36.811154 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:36.811127    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:36.811281 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:36.811260    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kg8x5" podUID="0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0"
Jul 27 21:54:36.929416 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:36.928678    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dttzh" event={"ID":"e5b27b10-c331-4eb3-afa0-f8af1ff913b2","Type":"ContainerStarted","Data":"12230f2f3e10e7252379f780dbd715c1531c7406060ef8010c0da3f150084a90"}
Jul 27 21:54:36.932568 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:36.932357    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vskvb" event={"ID":"3e9e76fd-a285-4410-b6c3-4247ba933efa","Type":"ContainerStarted","Data":"d543423d6b04ce5112da89d7321c0a499061d54525e877dea3de21bab455d826"}
Jul 27 21:54:36.935051 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:36.934969    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7" event={"ID":"89949e5c-3381-42ac-a650-5bc1994464b9","Type":"ContainerStarted","Data":"f5c20fbba4d329c07e6a9b3ea9bf67854bff96f96180c28bea53e5a1663788df"}
Jul 27 21:54:36.948212 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:36.948163    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-114.ec2.internal" podStartSLOduration=19.948147293 podStartE2EDuration="19.948147293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:54:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:54:20.9092889 +0000 UTC m=+5.650423672" watchObservedRunningTime="2026-07-27 21:54:36.948147293 +0000 UTC m=+21.689282062"
Jul 27 21:54:36.978956 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:36.978892    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dttzh" podStartSLOduration=2.369729356 podStartE2EDuration="20.978871516s" totalImagesPullingTime="18.60914216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:54:36.94838526 +0000 UTC m=+21.689520028" watchObservedRunningTime="2026-07-27 21:54:36.978871516 +0000 UTC m=+21.720006282"
Jul 27 21:54:36.979656 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:36.979617    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vskvb" podStartSLOduration=3.263970169 podStartE2EDuration="21.979603422s" totalImagesPullingTime="18.715633253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:54:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:54:36.979041913 +0000 UTC m=+21.720176668" watchObservedRunningTime="2026-07-27 21:54:36.979603422 +0000 UTC m=+21.720738190"
Jul 27 21:54:37.811301 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:37.811029    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:37.811476 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:37.811380    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btrhh" podUID="eefb4933-08a8-4afb-a044-33331c4074b6"
Jul 27 21:54:37.811732 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:37.811037    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:37.811732 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:37.811690    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgt8f" podUID="807200be-220e-4e07-8641-8b0bd2788381"
Jul 27 21:54:37.938498 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:37.938452    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f82sq" event={"ID":"881ffdfa-9a29-42e3-828d-23523dd11af5","Type":"ContainerStarted","Data":"af0bdd1a9eb1cd19842ee4e2b4b854c1a3694d505818e979138909f39430c7e9"}
Jul 27 21:54:37.939903 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:37.939877    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pxjs5" event={"ID":"eb157c02-c15b-478b-995d-c42405aff70e","Type":"ContainerStarted","Data":"10eb00ab617482fcb5f0bfa06ab3b6b9920ecc6286bfae44acf477641262faa5"}
Jul 27 21:54:37.942759 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:37.942734    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w" event={"ID":"436e16da-313f-4334-bf1d-738922f32b0e","Type":"ContainerStarted","Data":"97ce254c83f3a92f9e47cf5802da65e2d4b1f1101fffc47e8147cd5f2637bf19"}
Jul 27 21:54:37.942882 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:37.942801    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w" event={"ID":"436e16da-313f-4334-bf1d-738922f32b0e","Type":"ContainerStarted","Data":"8f4041f778ab2c2136d7a714b5901f9430e12e7bf1308c61c6fcd978cbb41656"}
Jul 27 21:54:37.942882 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:37.942833    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w" event={"ID":"436e16da-313f-4334-bf1d-738922f32b0e","Type":"ContainerStarted","Data":"a96de93aa822030fae75f74d9daa9755e334c67973cfd311b44de3114c3be9f9"}
Jul 27 21:54:37.942882 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:37.942861    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w" event={"ID":"436e16da-313f-4334-bf1d-738922f32b0e","Type":"ContainerStarted","Data":"d95e9385591524e68a9014336c2b55079e7517844bd559ca511fbed012a5115c"}
Jul 27 21:54:37.943048 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:37.942900    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w" event={"ID":"436e16da-313f-4334-bf1d-738922f32b0e","Type":"ContainerStarted","Data":"71f938a77e973cb2714c36461b00cdc28862cad0dd32e719f7d36a6a21a975ed"}
Jul 27 21:54:37.943048 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:37.942948    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w" event={"ID":"436e16da-313f-4334-bf1d-738922f32b0e","Type":"ContainerStarted","Data":"1fc3df424d5613fe4ec113a3d024f7f9c077ac1d7670dfed3868a6e43abdfe8c"}
Jul 27 21:54:37.944162 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:37.944141    2565 generic.go:356] "Generic (PLEG): container finished" podID="f82f51e4-ec5e-405e-97f1-8b12129dff3c" containerID="8448d17e87805cc17924503008547ff0b39fa7702468af635efc4231ad1b7d77" exitCode=0
Jul 27 21:54:37.944255 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:37.944205    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-792l4" event={"ID":"f82f51e4-ec5e-405e-97f1-8b12129dff3c","Type":"ContainerDied","Data":"8448d17e87805cc17924503008547ff0b39fa7702468af635efc4231ad1b7d77"}
Jul 27 21:54:37.945839 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:37.945817    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2l4n7" event={"ID":"3611ede8-5415-4ada-8800-39d88377ec13","Type":"ContainerStarted","Data":"80040b143eea69129148da6d1b44f0958ac1e648f9463da51919b5972f8dae3c"}
Jul 27 21:54:37.955844 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:37.955807    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f82sq" podStartSLOduration=4.286744248 podStartE2EDuration="22.955795754s" totalImagesPullingTime="18.669051506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:54:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:54:37.955705918 +0000 UTC m=+22.696840685" watchObservedRunningTime="2026-07-27 21:54:37.955795754 +0000 UTC m=+22.696930520"
Jul 27 21:54:37.998467 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:37.998424    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pxjs5" podStartSLOduration=4.284354115 podStartE2EDuration="22.998412541s" totalImagesPullingTime="18.714058426s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:54:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:54:37.99775446 +0000 UTC m=+22.738889240" watchObservedRunningTime="2026-07-27 21:54:37.998412541 +0000 UTC m=+22.739547308"
Jul 27 21:54:37.998585 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:37.998517    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2l4n7" podStartSLOduration=3.100235652 podStartE2EDuration="21.998513698s" totalImagesPullingTime="18.898278046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:54:37.97847376 +0000 UTC m=+22.719608529" watchObservedRunningTime="2026-07-27 21:54:37.998513698 +0000 UTC m=+22.739648464"
Jul 27 21:54:38.309126 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:38.309102    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 21:54:38.621495 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:38.621461    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dttzh"
Jul 27 21:54:38.621968 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:38.621953    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dttzh"
Jul 27 21:54:38.773587 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:38.773486    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T21:54:38.309118348Z","UUID":"35ca5622-2d93-4f15-9a1c-7f59e54f197b","Handler":null,"Name":"","Endpoint":""}
Jul 27 21:54:38.774984 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:38.774966    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 21:54:38.775070 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:38.775006    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 21:54:38.810930 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:38.810892    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:38.811084 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:38.811011    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kg8x5" podUID="0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0"
Jul 27 21:54:38.949880 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:38.949733    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-82r4r" event={"ID":"37fa0583-e8c9-4e69-aeb6-aa38a78e4be4","Type":"ContainerStarted","Data":"b7fc4a44a8937c00ca232b2017aba2d07b605185337be6c391be888edf3a3176"}
Jul 27 21:54:38.951637 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:38.951608    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7" event={"ID":"89949e5c-3381-42ac-a650-5bc1994464b9","Type":"ContainerStarted","Data":"239516d32d05ec91f0f73b82190f34b345ed77488b418fb9f8ef09a7dcd69216"}
Jul 27 21:54:38.964857 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:38.964800    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-82r4r" podStartSLOduration=4.36303596 podStartE2EDuration="22.964785887s" totalImagesPullingTime="18.601749927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:54:38.964456803 +0000 UTC m=+23.705591570" watchObservedRunningTime="2026-07-27 21:54:38.964785887 +0000 UTC m=+23.705920654"
Jul 27 21:54:39.810982 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:39.810888    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:39.811173 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:39.811036    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btrhh" podUID="eefb4933-08a8-4afb-a044-33331c4074b6"
Jul 27 21:54:39.811319 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:39.810888    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:39.811478 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:39.811433    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgt8f" podUID="807200be-220e-4e07-8641-8b0bd2788381"
Jul 27 21:54:39.958320 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:39.958285    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w" event={"ID":"436e16da-313f-4334-bf1d-738922f32b0e","Type":"ContainerStarted","Data":"d60dbff742cabe5673f7bff8ee5704a01bd1cdf2816191d852339575f2a42f3b"}
Jul 27 21:54:39.958790 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:39.958347    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 27 21:54:40.810889 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:40.810697    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:40.811104 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:40.811000    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kg8x5" podUID="0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0"
Jul 27 21:54:40.962776 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:40.962742    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7" event={"ID":"89949e5c-3381-42ac-a650-5bc1994464b9","Type":"ContainerStarted","Data":"e25cfd19046af6c6bc902bdcec571362dc03160bcd2dd2e9eefcc094cc9821f1"}
Jul 27 21:54:41.811378 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:41.811348    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:41.811508 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:41.811364    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:41.811508 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:41.811490    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btrhh" podUID="eefb4933-08a8-4afb-a044-33331c4074b6"
Jul 27 21:54:41.811617 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:41.811560    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgt8f" podUID="807200be-220e-4e07-8641-8b0bd2788381"
Jul 27 21:54:41.909573 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:41.909533    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dttzh"
Jul 27 21:54:41.909801 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:41.909676    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 27 21:54:41.910385 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:41.910168    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dttzh"
Jul 27 21:54:41.925593 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:41.925537    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xkx7" podStartSLOduration=5.323628482 podStartE2EDuration="26.925517593s" totalImagesPullingTime="21.601889111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:54:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:54:40.98042598 +0000 UTC m=+25.721560745" watchObservedRunningTime="2026-07-27 21:54:41.925517593 +0000 UTC m=+26.666652362"
Jul 27 21:54:41.969297 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:41.969251    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w" event={"ID":"436e16da-313f-4334-bf1d-738922f32b0e","Type":"ContainerStarted","Data":"80a6051e261b68a8e1c98898e4a38b5d7eca11ae60abd694763587f1a28f404d"}
Jul 27 21:54:42.029753 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:42.029661    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w" podStartSLOduration=8.348117255 podStartE2EDuration="27.029644094s" totalImagesPullingTime="18.681526839s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:54:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:54:42.029149543 +0000 UTC m=+26.770284332" watchObservedRunningTime="2026-07-27 21:54:42.029644094 +0000 UTC m=+26.770778860"
Jul 27 21:54:42.810824 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:42.810620    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:42.810997 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:42.810928    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kg8x5" podUID="0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0"
Jul 27 21:54:42.972136 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:42.972102    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:42.972621 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:42.972201    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:42.972621 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:42.972246    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:42.988237 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:42.988203    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:42.988566 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:42.988543    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:54:43.811360 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:43.811278    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:43.811500 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:43.811407    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btrhh" podUID="eefb4933-08a8-4afb-a044-33331c4074b6"
Jul 27 21:54:43.811500 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:43.811456    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:43.811624 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:43.811593    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgt8f" podUID="807200be-220e-4e07-8641-8b0bd2788381"
Jul 27 21:54:43.824607 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:43.824577    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-btrhh"]
Jul 27 21:54:43.825112 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:43.825071    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kg8x5"]
Jul 27 21:54:43.825204 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:43.825197    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:43.825315 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:43.825297    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kg8x5" podUID="0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0"
Jul 27 21:54:43.826881 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:43.826855    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lgt8f"]
Jul 27 21:54:43.973404 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:43.973365    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:43.973825 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:43.973506    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgt8f" podUID="807200be-220e-4e07-8641-8b0bd2788381"
Jul 27 21:54:43.973825 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:43.973784    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:43.973922 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:43.973878    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btrhh" podUID="eefb4933-08a8-4afb-a044-33331c4074b6"
Jul 27 21:54:44.977250 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:44.977213    2565 generic.go:356] "Generic (PLEG): container finished" podID="f82f51e4-ec5e-405e-97f1-8b12129dff3c" containerID="638e365fe1fb8d5116b28d334fef083566844eb452553e629c477c71f9a1e982" exitCode=0
Jul 27 21:54:44.977794 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:44.977291    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-792l4" event={"ID":"f82f51e4-ec5e-405e-97f1-8b12129dff3c","Type":"ContainerDied","Data":"638e365fe1fb8d5116b28d334fef083566844eb452553e629c477c71f9a1e982"}
Jul 27 21:54:45.811766 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:45.811735    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:45.811924 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:45.811827    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btrhh" podUID="eefb4933-08a8-4afb-a044-33331c4074b6"
Jul 27 21:54:45.811975 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:45.811924    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:45.812059 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:45.812039    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgt8f" podUID="807200be-220e-4e07-8641-8b0bd2788381"
Jul 27 21:54:45.812100 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:45.812089    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:45.812180 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:45.812165    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kg8x5" podUID="0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0"
Jul 27 21:54:46.984566 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:46.984383    2565 generic.go:356] "Generic (PLEG): container finished" podID="f82f51e4-ec5e-405e-97f1-8b12129dff3c" containerID="9a4291b3d4cf9b47a6ba0fc2fb34e784bcf9bbdd052898c4f90bf0b0234f8871" exitCode=0
Jul 27 21:54:46.984928 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:46.984428    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-792l4" event={"ID":"f82f51e4-ec5e-405e-97f1-8b12129dff3c","Type":"ContainerDied","Data":"9a4291b3d4cf9b47a6ba0fc2fb34e784bcf9bbdd052898c4f90bf0b0234f8871"}
Jul 27 21:54:47.811215 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:47.811185    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:47.811422 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:47.811185    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:47.811422 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:47.811316    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-btrhh" podUID="eefb4933-08a8-4afb-a044-33331c4074b6"
Jul 27 21:54:47.811422 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:47.811193    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:47.811533 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:47.811426    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lgt8f" podUID="807200be-220e-4e07-8641-8b0bd2788381"
Jul 27 21:54:47.811533 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:47.811507    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kg8x5" podUID="0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0"
Jul 27 21:54:48.991736 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:48.991708    2565 generic.go:356] "Generic (PLEG): container finished" podID="f82f51e4-ec5e-405e-97f1-8b12129dff3c" containerID="6ede99f64059dff5d97f6e19b8a5c66fffee0d27c8e0af29c7d97de82ece638a" exitCode=0
Jul 27 21:54:48.992167 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:48.991741    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-792l4" event={"ID":"f82f51e4-ec5e-405e-97f1-8b12129dff3c","Type":"ContainerDied","Data":"6ede99f64059dff5d97f6e19b8a5c66fffee0d27c8e0af29c7d97de82ece638a"}
Jul 27 21:54:49.573465 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.573383    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret\") pod \"global-pull-secret-syncer-kg8x5\" (UID: \"0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0\") " pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:49.573465 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.573431    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jnnf\" (UniqueName: \"kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf\") pod \"network-check-target-btrhh\" (UID: \"eefb4933-08a8-4afb-a044-33331c4074b6\") " pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:49.573699 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:49.573551    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 21:54:49.573699 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:49.573564    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 21:54:49.573699 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:49.573583    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 21:54:49.573699 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:49.573595    2565 projected.go:196] Error preparing data for projected volume kube-api-access-5jnnf for pod openshift-network-diagnostics/network-check-target-btrhh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:54:49.573699 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:49.573622    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret podName:0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0 nodeName:}" failed. No retries permitted until 2026-07-27 21:55:21.573602272 +0000 UTC m=+66.314737020 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret") pod "global-pull-secret-syncer-kg8x5" (UID: "0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0") : object "kube-system"/"original-pull-secret" not registered
Jul 27 21:54:49.573699 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:49.573625    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:54:49.573699 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:49.573640    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf podName:eefb4933-08a8-4afb-a044-33331c4074b6 nodeName:}" failed. No retries permitted until 2026-07-27 21:55:21.57363122 +0000 UTC m=+66.314765974 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5jnnf" (UniqueName: "kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf") pod "network-check-target-btrhh" (UID: "eefb4933-08a8-4afb-a044-33331c4074b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:54:49.573699 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.573563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs\") pod \"network-metrics-daemon-lgt8f\" (UID: \"807200be-220e-4e07-8641-8b0bd2788381\") " pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:49.573699 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:49.573664    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs podName:807200be-220e-4e07-8641-8b0bd2788381 nodeName:}" failed. No retries permitted until 2026-07-27 21:55:21.573653281 +0000 UTC m=+66.314788045 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs") pod "network-metrics-daemon-lgt8f" (UID: "807200be-220e-4e07-8641-8b0bd2788381") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:54:49.578300 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.578272    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-114.ec2.internal" event="NodeReady"
Jul 27 21:54:49.578443 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.578409    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 21:54:49.617327 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.617297    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7797499974-mg255"]
Jul 27 21:54:49.632635 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.632601    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-blwlz"]
Jul 27 21:54:49.632794 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.632716    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.636289 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.636260    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 21:54:49.636454 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.636440    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 21:54:49.636578 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.636559    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 21:54:49.636694 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.636667    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-65kmq\""
Jul 27 21:54:49.642306 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.642286    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 21:54:49.644428 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.644384    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kbx2h"]
Jul 27 21:54:49.644428 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.644425    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-blwlz"
Jul 27 21:54:49.648191 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.648168    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 21:54:49.648586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.648568    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jz2cl\""
Jul 27 21:54:49.648682 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.648641    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 21:54:49.663079 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.663054    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7797499974-mg255"]
Jul 27 21:54:49.663191 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.663088    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kbx2h"]
Jul 27 21:54:49.663191 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.663101    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-blwlz"]
Jul 27 21:54:49.663191 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.663185    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kbx2h"
Jul 27 21:54:49.665693 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.665674    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 21:54:49.665810 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.665774    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 21:54:49.665879 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.665854    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 21:54:49.666097 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.666081    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c4sqs\""
Jul 27 21:54:49.775800 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.775765    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b322165-7ba4-407d-81aa-2e7aaf96ded0-ca-trust-extracted\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.775995 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.775809    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b322165-7ba4-407d-81aa-2e7aaf96ded0-installation-pull-secrets\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.775995 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.775830    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlqf7\" (UniqueName: \"kubernetes.io/projected/f7de6e29-5e18-452b-9853-82530fc6bd38-kube-api-access-nlqf7\") pod \"dns-default-blwlz\" (UID: \"f7de6e29-5e18-452b-9853-82530fc6bd38\") " pod="openshift-dns/dns-default-blwlz"
Jul 27 21:54:49.775995 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.775856    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j6dx\" (UniqueName: \"kubernetes.io/projected/fb94c2b1-988f-4a6c-8871-4462d73cfb15-kube-api-access-2j6dx\") pod \"ingress-canary-kbx2h\" (UID: \"fb94c2b1-988f-4a6c-8871-4462d73cfb15\") " pod="openshift-ingress-canary/ingress-canary-kbx2h"
Jul 27 21:54:49.775995 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.775913    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-bound-sa-token\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.775995 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.775942    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-certificates\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.775995 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.775964    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f7de6e29-5e18-452b-9853-82530fc6bd38-config-volume\") pod \"dns-default-blwlz\" (UID: \"f7de6e29-5e18-452b-9853-82530fc6bd38\") " pod="openshift-dns/dns-default-blwlz"
Jul 27 21:54:49.775995 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.775988    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jkhc\" (UniqueName: \"kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-kube-api-access-4jkhc\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.776330 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.776045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.776330 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.776088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b322165-7ba4-407d-81aa-2e7aaf96ded0-image-registry-private-configuration\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.776330 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.776139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls\") pod \"dns-default-blwlz\" (UID: \"f7de6e29-5e18-452b-9853-82530fc6bd38\") " pod="openshift-dns/dns-default-blwlz"
Jul 27 21:54:49.776330 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.776160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb94c2b1-988f-4a6c-8871-4462d73cfb15-cert\") pod \"ingress-canary-kbx2h\" (UID: \"fb94c2b1-988f-4a6c-8871-4462d73cfb15\") " pod="openshift-ingress-canary/ingress-canary-kbx2h"
Jul 27 21:54:49.776330 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.776182    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7de6e29-5e18-452b-9853-82530fc6bd38-tmp-dir\") pod \"dns-default-blwlz\" (UID: \"f7de6e29-5e18-452b-9853-82530fc6bd38\") " pod="openshift-dns/dns-default-blwlz"
Jul 27 21:54:49.776330 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.776203    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b322165-7ba4-407d-81aa-2e7aaf96ded0-trusted-ca\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.811406 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.811374    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:54:49.811406 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.811400    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:54:49.811640 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.811445    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:54:49.814293 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.814268    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 21:54:49.814764 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.814486    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 21:54:49.814764 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.814503    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tm84h\""
Jul 27 21:54:49.814764 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.814597    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 21:54:49.814764 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.814736    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 21:54:49.814764 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.814751    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8ffd2\""
Jul 27 21:54:49.877293 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.877258    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jkhc\" (UniqueName: \"kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-kube-api-access-4jkhc\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.877504 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.877322    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.877504 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.877380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b322165-7ba4-407d-81aa-2e7aaf96ded0-image-registry-private-configuration\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.877504 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.877407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls\") pod \"dns-default-blwlz\" (UID: \"f7de6e29-5e18-452b-9853-82530fc6bd38\") " pod="openshift-dns/dns-default-blwlz"
Jul 27 21:54:49.877504 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.877436    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb94c2b1-988f-4a6c-8871-4462d73cfb15-cert\") pod \"ingress-canary-kbx2h\" (UID: \"fb94c2b1-988f-4a6c-8871-4462d73cfb15\") " pod="openshift-ingress-canary/ingress-canary-kbx2h"
Jul 27 21:54:49.877504 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.877456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7de6e29-5e18-452b-9853-82530fc6bd38-tmp-dir\") pod \"dns-default-blwlz\" (UID: \"f7de6e29-5e18-452b-9853-82530fc6bd38\") " pod="openshift-dns/dns-default-blwlz"
Jul 27 21:54:49.877504 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.877482    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b322165-7ba4-407d-81aa-2e7aaf96ded0-trusted-ca\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.877504 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:49.877485    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 21:54:49.877504 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:49.877506    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7797499974-mg255: secret "image-registry-tls" not found
Jul 27 21:54:49.877870 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.877513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b322165-7ba4-407d-81aa-2e7aaf96ded0-ca-trust-extracted\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.877870 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.877531    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b322165-7ba4-407d-81aa-2e7aaf96ded0-installation-pull-secrets\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.877870 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.877550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlqf7\" (UniqueName: \"kubernetes.io/projected/f7de6e29-5e18-452b-9853-82530fc6bd38-kube-api-access-nlqf7\") pod \"dns-default-blwlz\" (UID: \"f7de6e29-5e18-452b-9853-82530fc6bd38\") " pod="openshift-dns/dns-default-blwlz"
Jul 27 21:54:49.877870 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:49.877565    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls podName:9b322165-7ba4-407d-81aa-2e7aaf96ded0 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:50.377545205 +0000 UTC m=+35.118679954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls") pod "image-registry-7797499974-mg255" (UID: "9b322165-7ba4-407d-81aa-2e7aaf96ded0") : secret "image-registry-tls" not found
Jul 27 21:54:49.877870 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.877597    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j6dx\" (UniqueName: \"kubernetes.io/projected/fb94c2b1-988f-4a6c-8871-4462d73cfb15-kube-api-access-2j6dx\") pod \"ingress-canary-kbx2h\" (UID: \"fb94c2b1-988f-4a6c-8871-4462d73cfb15\") " pod="openshift-ingress-canary/ingress-canary-kbx2h"
Jul 27 21:54:49.877870 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:49.877493    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 21:54:49.877870 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.877633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-bound-sa-token\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.877870 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:49.877676    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls podName:f7de6e29-5e18-452b-9853-82530fc6bd38 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:50.37765474 +0000 UTC m=+35.118789509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls") pod "dns-default-blwlz" (UID: "f7de6e29-5e18-452b-9853-82530fc6bd38") : secret "dns-default-metrics-tls" not found
Jul 27 21:54:49.877870 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.877698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-certificates\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.877870 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.877731    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f7de6e29-5e18-452b-9853-82530fc6bd38-config-volume\") pod \"dns-default-blwlz\" (UID: \"f7de6e29-5e18-452b-9853-82530fc6bd38\") " pod="openshift-dns/dns-default-blwlz"
Jul 27 21:54:49.878323 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.878030    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7de6e29-5e18-452b-9853-82530fc6bd38-tmp-dir\") pod \"dns-default-blwlz\" (UID: \"f7de6e29-5e18-452b-9853-82530fc6bd38\") " pod="openshift-dns/dns-default-blwlz"
Jul 27 21:54:49.878398 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.878354    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f7de6e29-5e18-452b-9853-82530fc6bd38-config-volume\") pod \"dns-default-blwlz\" (UID: \"f7de6e29-5e18-452b-9853-82530fc6bd38\") " pod="openshift-dns/dns-default-blwlz"
Jul 27 21:54:49.878457 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.878421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-certificates\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.878534 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.878506    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b322165-7ba4-407d-81aa-2e7aaf96ded0-ca-trust-extracted\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.879516 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.879492    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b322165-7ba4-407d-81aa-2e7aaf96ded0-trusted-ca\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.882005 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.881986    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b322165-7ba4-407d-81aa-2e7aaf96ded0-image-registry-private-configuration\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.882119 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.882006    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb94c2b1-988f-4a6c-8871-4462d73cfb15-cert\") pod \"ingress-canary-kbx2h\" (UID: \"fb94c2b1-988f-4a6c-8871-4462d73cfb15\") " pod="openshift-ingress-canary/ingress-canary-kbx2h"
Jul 27 21:54:49.882119 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.882076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b322165-7ba4-407d-81aa-2e7aaf96ded0-installation-pull-secrets\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.889502 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.889081    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-bound-sa-token\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.889810 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.889778    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j6dx\" (UniqueName: \"kubernetes.io/projected/fb94c2b1-988f-4a6c-8871-4462d73cfb15-kube-api-access-2j6dx\") pod \"ingress-canary-kbx2h\" (UID: \"fb94c2b1-988f-4a6c-8871-4462d73cfb15\") " pod="openshift-ingress-canary/ingress-canary-kbx2h"
Jul 27 21:54:49.892621 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.892597    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlqf7\" (UniqueName: \"kubernetes.io/projected/f7de6e29-5e18-452b-9853-82530fc6bd38-kube-api-access-nlqf7\") pod \"dns-default-blwlz\" (UID: \"f7de6e29-5e18-452b-9853-82530fc6bd38\") " pod="openshift-dns/dns-default-blwlz"
Jul 27 21:54:49.894244 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.894219    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jkhc\" (UniqueName: \"kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-kube-api-access-4jkhc\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:49.973437 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:49.973407    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kbx2h"
Jul 27 21:54:50.177503 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:50.177470    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kbx2h"]
Jul 27 21:54:50.182130 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:54:50.181949    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb94c2b1_988f_4a6c_8871_4462d73cfb15.slice/crio-be40e6d914e70851633808b1dbaa73fc1ce61261efb5018a833c9d3588d391f9 WatchSource:0}: Error finding container be40e6d914e70851633808b1dbaa73fc1ce61261efb5018a833c9d3588d391f9: Status 404 returned error can't find the container with id be40e6d914e70851633808b1dbaa73fc1ce61261efb5018a833c9d3588d391f9
Jul 27 21:54:50.383234 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:50.383151    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:50.383234 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:50.383195    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls\") pod \"dns-default-blwlz\" (UID: \"f7de6e29-5e18-452b-9853-82530fc6bd38\") " pod="openshift-dns/dns-default-blwlz"
Jul 27 21:54:50.383469 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:50.383320    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 21:54:50.383469 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:50.383392    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls podName:f7de6e29-5e18-452b-9853-82530fc6bd38 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:51.383376932 +0000 UTC m=+36.124511690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls") pod "dns-default-blwlz" (UID: "f7de6e29-5e18-452b-9853-82530fc6bd38") : secret "dns-default-metrics-tls" not found
Jul 27 21:54:50.383469 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:50.383323    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 21:54:50.383469 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:50.383430    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7797499974-mg255: secret "image-registry-tls" not found
Jul 27 21:54:50.383469 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:50.383470    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls podName:9b322165-7ba4-407d-81aa-2e7aaf96ded0 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:51.383458769 +0000 UTC m=+36.124593519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls") pod "image-registry-7797499974-mg255" (UID: "9b322165-7ba4-407d-81aa-2e7aaf96ded0") : secret "image-registry-tls" not found
Jul 27 21:54:50.997664 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:50.997636    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kbx2h" event={"ID":"fb94c2b1-988f-4a6c-8871-4462d73cfb15","Type":"ContainerStarted","Data":"be40e6d914e70851633808b1dbaa73fc1ce61261efb5018a833c9d3588d391f9"}
Jul 27 21:54:51.385579 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:51.385445    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dttzh_e5b27b10-c331-4eb3-afa0-f8af1ff913b2/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:51.393296 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:51.393266    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:51.393479 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:51.393322    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls\") pod \"dns-default-blwlz\" (UID: \"f7de6e29-5e18-452b-9853-82530fc6bd38\") " pod="openshift-dns/dns-default-blwlz"
Jul 27 21:54:51.393479 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:51.393414    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 21:54:51.393479 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:51.393431    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7797499974-mg255: secret "image-registry-tls" not found
Jul 27 21:54:51.393643 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:51.393497    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls podName:9b322165-7ba4-407d-81aa-2e7aaf96ded0 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:53.393476941 +0000 UTC m=+38.134611709 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls") pod "image-registry-7797499974-mg255" (UID: "9b322165-7ba4-407d-81aa-2e7aaf96ded0") : secret "image-registry-tls" not found
Jul 27 21:54:51.393643 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:51.393499    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 21:54:51.393643 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:51.393549    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls podName:f7de6e29-5e18-452b-9853-82530fc6bd38 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:53.39353375 +0000 UTC m=+38.134668512 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls") pod "dns-default-blwlz" (UID: "f7de6e29-5e18-452b-9853-82530fc6bd38") : secret "dns-default-metrics-tls" not found
Jul 27 21:54:51.581578 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:51.581539    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dttzh_e5b27b10-c331-4eb3-afa0-f8af1ff913b2/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:51.718998 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:51.718941    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dttzh_e5b27b10-c331-4eb3-afa0-f8af1ff913b2/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:51.869496 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:51.869455    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dttzh_e5b27b10-c331-4eb3-afa0-f8af1ff913b2/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:51.972386 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:51.972292    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dttzh_e5b27b10-c331-4eb3-afa0-f8af1ff913b2/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:52.340728 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:52.340646    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dttzh_e5b27b10-c331-4eb3-afa0-f8af1ff913b2/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:52.440365 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:52.440289    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dttzh_e5b27b10-c331-4eb3-afa0-f8af1ff913b2/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:52.736447 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:52.736408    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dttzh_e5b27b10-c331-4eb3-afa0-f8af1ff913b2/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:52.836965 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:52.836905    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dttzh_e5b27b10-c331-4eb3-afa0-f8af1ff913b2/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:53.410876 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:53.410843    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:53.411062 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:53.410899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls\") pod \"dns-default-blwlz\" (UID: \"f7de6e29-5e18-452b-9853-82530fc6bd38\") " pod="openshift-dns/dns-default-blwlz"
Jul 27 21:54:53.411062 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:53.411027    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 21:54:53.411062 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:53.411050    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 21:54:53.411062 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:53.411054    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7797499974-mg255: secret "image-registry-tls" not found
Jul 27 21:54:53.411205 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:53.411109    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls podName:f7de6e29-5e18-452b-9853-82530fc6bd38 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:57.41109178 +0000 UTC m=+42.152226525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls") pod "dns-default-blwlz" (UID: "f7de6e29-5e18-452b-9853-82530fc6bd38") : secret "dns-default-metrics-tls" not found
Jul 27 21:54:53.411205 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:53.411131    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls podName:9b322165-7ba4-407d-81aa-2e7aaf96ded0 nodeName:}" failed. No retries permitted until 2026-07-27 21:54:57.411120488 +0000 UTC m=+42.152255245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls") pod "image-registry-7797499974-mg255" (UID: "9b322165-7ba4-407d-81aa-2e7aaf96ded0") : secret "image-registry-tls" not found
Jul 27 21:54:54.910655 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:54.910621    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dttzh_e5b27b10-c331-4eb3-afa0-f8af1ff913b2/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:55.008713 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:55.008669    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kbx2h" event={"ID":"fb94c2b1-988f-4a6c-8871-4462d73cfb15","Type":"ContainerStarted","Data":"c4efcba5eda19d4722e6b40f754f55e3ed779560fadd4eb52cc9b4610d307bde"}
Jul 27 21:54:55.011487 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:55.011467    2565 generic.go:356] "Generic (PLEG): container finished" podID="f82f51e4-ec5e-405e-97f1-8b12129dff3c" containerID="759ba276ffef9bc96cd7c524b3edd5b018ba0e1d8971ccc246df4d28dc40a8df" exitCode=0
Jul 27 21:54:55.011581 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:55.011500    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-792l4" event={"ID":"f82f51e4-ec5e-405e-97f1-8b12129dff3c","Type":"ContainerDied","Data":"759ba276ffef9bc96cd7c524b3edd5b018ba0e1d8971ccc246df4d28dc40a8df"}
Jul 27 21:54:55.031199 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:55.031172    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dttzh_e5b27b10-c331-4eb3-afa0-f8af1ff913b2/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:55.041150 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:55.039903    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kbx2h" podStartSLOduration=2.117249151 podStartE2EDuration="6.039884536s" totalImagesPullingTime="3.922635385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:54:55.038051077 +0000 UTC m=+39.779185845" watchObservedRunningTime="2026-07-27 21:54:55.039884536 +0000 UTC m=+39.781019303"
Jul 27 21:54:56.016926 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:56.016895    2565 generic.go:356] "Generic (PLEG): container finished" podID="f82f51e4-ec5e-405e-97f1-8b12129dff3c" containerID="646a30868c357b765bd29bfabcf7496307dc92d1e36b4df9a34f73f03a0bd031" exitCode=0
Jul 27 21:54:56.017313 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:56.016981    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-792l4" event={"ID":"f82f51e4-ec5e-405e-97f1-8b12129dff3c","Type":"ContainerDied","Data":"646a30868c357b765bd29bfabcf7496307dc92d1e36b4df9a34f73f03a0bd031"}
Jul 27 21:54:57.022399 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:57.022362    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-792l4" event={"ID":"f82f51e4-ec5e-405e-97f1-8b12129dff3c","Type":"ContainerStarted","Data":"fcefcc06ca3d9a9f161846a595f27662fe8f38f348ae1ecef0426269933482ed"}
Jul 27 21:54:57.081164 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:57.081117    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-792l4" podStartSLOduration=8.787340702 podStartE2EDuration="41.08110118s" totalImagesPullingTime="32.293760478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:54:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:54:57.078838929 +0000 UTC m=+41.819973696" watchObservedRunningTime="2026-07-27 21:54:57.08110118 +0000 UTC m=+41.822235946"
Jul 27 21:54:57.256765 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:57.256726    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dttzh_e5b27b10-c331-4eb3-afa0-f8af1ff913b2/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:57.404395 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:57.404298    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dttzh_e5b27b10-c331-4eb3-afa0-f8af1ff913b2/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:57.443318 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:57.443285    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:54:57.443461 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:57.443349    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls\") pod \"dns-default-blwlz\" (UID: \"f7de6e29-5e18-452b-9853-82530fc6bd38\") " pod="openshift-dns/dns-default-blwlz"
Jul 27 21:54:57.443502 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:57.443463    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 21:54:57.443502 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:57.443469    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 21:54:57.443502 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:57.443491    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7797499974-mg255: secret "image-registry-tls" not found
Jul 27 21:54:57.443607 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:57.443529    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls podName:f7de6e29-5e18-452b-9853-82530fc6bd38 nodeName:}" failed. No retries permitted until 2026-07-27 21:55:05.443513845 +0000 UTC m=+50.184648591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls") pod "dns-default-blwlz" (UID: "f7de6e29-5e18-452b-9853-82530fc6bd38") : secret "dns-default-metrics-tls" not found
Jul 27 21:54:57.443607 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:54:57.443541    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls podName:9b322165-7ba4-407d-81aa-2e7aaf96ded0 nodeName:}" failed. No retries permitted until 2026-07-27 21:55:05.44353614 +0000 UTC m=+50.184670886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls") pod "image-registry-7797499974-mg255" (UID: "9b322165-7ba4-407d-81aa-2e7aaf96ded0") : secret "image-registry-tls" not found
Jul 27 21:54:57.577569 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:57.577536    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dttzh_e5b27b10-c331-4eb3-afa0-f8af1ff913b2/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:58.714999 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:58.714966    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dttzh_e5b27b10-c331-4eb3-afa0-f8af1ff913b2/konnectivity-agent/0.log" limit=1024
Jul 27 21:54:59.988664 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:54:59.988630    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dttzh_e5b27b10-c331-4eb3-afa0-f8af1ff913b2/konnectivity-agent/0.log" limit=1024
Jul 27 21:55:05.498350 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:05.498308    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:55:05.498727 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:05.498370    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls\") pod \"dns-default-blwlz\" (UID: \"f7de6e29-5e18-452b-9853-82530fc6bd38\") " pod="openshift-dns/dns-default-blwlz"
Jul 27 21:55:05.498727 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:05.498452    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 21:55:05.498727 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:05.498464    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 21:55:05.498727 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:05.498471    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7797499974-mg255: secret "image-registry-tls" not found
Jul 27 21:55:05.498727 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:05.498525    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls podName:f7de6e29-5e18-452b-9853-82530fc6bd38 nodeName:}" failed. No retries permitted until 2026-07-27 21:55:21.498507122 +0000 UTC m=+66.239641870 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls") pod "dns-default-blwlz" (UID: "f7de6e29-5e18-452b-9853-82530fc6bd38") : secret "dns-default-metrics-tls" not found
Jul 27 21:55:05.498727 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:05.498545    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls podName:9b322165-7ba4-407d-81aa-2e7aaf96ded0 nodeName:}" failed. No retries permitted until 2026-07-27 21:55:21.498537103 +0000 UTC m=+66.239671849 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls") pod "image-registry-7797499974-mg255" (UID: "9b322165-7ba4-407d-81aa-2e7aaf96ded0") : secret "image-registry-tls" not found
Jul 27 21:55:14.987952 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:14.987919    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lgj5w"
Jul 27 21:55:21.510236 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:21.510196    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:55:21.510236 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:21.510242    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls\") pod \"dns-default-blwlz\" (UID: \"f7de6e29-5e18-452b-9853-82530fc6bd38\") " pod="openshift-dns/dns-default-blwlz"
Jul 27 21:55:21.510692 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:21.510356    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 21:55:21.510692 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:21.510361    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 21:55:21.510692 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:21.510379    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7797499974-mg255: secret "image-registry-tls" not found
Jul 27 21:55:21.510692 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:21.510410    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls podName:f7de6e29-5e18-452b-9853-82530fc6bd38 nodeName:}" failed. No retries permitted until 2026-07-27 21:55:53.510394561 +0000 UTC m=+98.251529318 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls") pod "dns-default-blwlz" (UID: "f7de6e29-5e18-452b-9853-82530fc6bd38") : secret "dns-default-metrics-tls" not found
Jul 27 21:55:21.510692 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:21.510422    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls podName:9b322165-7ba4-407d-81aa-2e7aaf96ded0 nodeName:}" failed. No retries permitted until 2026-07-27 21:55:53.510416819 +0000 UTC m=+98.251551564 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls") pod "image-registry-7797499974-mg255" (UID: "9b322165-7ba4-407d-81aa-2e7aaf96ded0") : secret "image-registry-tls" not found
Jul 27 21:55:21.611382 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:21.611325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret\") pod \"global-pull-secret-syncer-kg8x5\" (UID: \"0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0\") " pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:55:21.611382 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:21.611392    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jnnf\" (UniqueName: \"kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf\") pod \"network-check-target-btrhh\" (UID: \"eefb4933-08a8-4afb-a044-33331c4074b6\") " pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:55:21.611642 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:21.611551    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs\") pod \"network-metrics-daemon-lgt8f\" (UID: \"807200be-220e-4e07-8641-8b0bd2788381\") " pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:55:21.614106 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:21.614085    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 21:55:21.614250 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:21.614234    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 21:55:21.614347 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:21.614320    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 21:55:21.622126 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:21.622095    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 21:55:21.622242 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:21.622166    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs podName:807200be-220e-4e07-8641-8b0bd2788381 nodeName:}" failed. No retries permitted until 2026-07-27 21:56:25.622148474 +0000 UTC m=+130.363283231 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs") pod "network-metrics-daemon-lgt8f" (UID: "807200be-220e-4e07-8641-8b0bd2788381") : secret "metrics-daemon-secret" not found
Jul 27 21:55:21.624863 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:21.624843    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 21:55:21.625392 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:21.625376    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0-original-pull-secret\") pod \"global-pull-secret-syncer-kg8x5\" (UID: \"0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0\") " pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:55:21.629867 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:21.629853    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kg8x5"
Jul 27 21:55:21.634348 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:21.634318    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jnnf\" (UniqueName: \"kubernetes.io/projected/eefb4933-08a8-4afb-a044-33331c4074b6-kube-api-access-5jnnf\") pod \"network-check-target-btrhh\" (UID: \"eefb4933-08a8-4afb-a044-33331c4074b6\") " pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:55:21.638309 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:21.638289    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8ffd2\""
Jul 27 21:55:21.646458 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:21.646440    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:55:21.757088 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:21.756930    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kg8x5"]
Jul 27 21:55:21.759711 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:55:21.759682    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aa7d8a4_ee6b_46f4_950b_92335e3aa5f0.slice/crio-c94cabd7d01670912196bf7db4360171ddc13880157c102e3e81b65ad02c040c WatchSource:0}: Error finding container c94cabd7d01670912196bf7db4360171ddc13880157c102e3e81b65ad02c040c: Status 404 returned error can't find the container with id c94cabd7d01670912196bf7db4360171ddc13880157c102e3e81b65ad02c040c
Jul 27 21:55:21.769800 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:21.769778    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-btrhh"]
Jul 27 21:55:21.772207 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:55:21.772185    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeefb4933_08a8_4afb_a044_33331c4074b6.slice/crio-2e3a70ca9235b2eb554f30e79f6fedb893a0a0bab29149397cfda4ddcd010dc1 WatchSource:0}: Error finding container 2e3a70ca9235b2eb554f30e79f6fedb893a0a0bab29149397cfda4ddcd010dc1: Status 404 returned error can't find the container with id 2e3a70ca9235b2eb554f30e79f6fedb893a0a0bab29149397cfda4ddcd010dc1
Jul 27 21:55:22.076274 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:22.076169    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-btrhh" event={"ID":"eefb4933-08a8-4afb-a044-33331c4074b6","Type":"ContainerStarted","Data":"2e3a70ca9235b2eb554f30e79f6fedb893a0a0bab29149397cfda4ddcd010dc1"}
Jul 27 21:55:22.077318 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:22.077286    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kg8x5" event={"ID":"0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0","Type":"ContainerStarted","Data":"c94cabd7d01670912196bf7db4360171ddc13880157c102e3e81b65ad02c040c"}
Jul 27 21:55:25.085969 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:25.085927    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-btrhh" event={"ID":"eefb4933-08a8-4afb-a044-33331c4074b6","Type":"ContainerStarted","Data":"ee00cbedbfc7c39f5f8744d8f8d11c28552262a9bf573e5489a3a3c9f71733ce"}
Jul 27 21:55:25.086352 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:25.086059    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:55:25.104050 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:25.104004    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-btrhh" podStartSLOduration=67.308480271 podStartE2EDuration="1m10.103989125s" totalImagesPullingTime="2.795508854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:54:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:55:25.103474508 +0000 UTC m=+69.844609277" watchObservedRunningTime="2026-07-27 21:55:25.103989125 +0000 UTC m=+69.845123891"
Jul 27 21:55:27.092141 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:27.092099    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kg8x5" event={"ID":"0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0","Type":"ContainerStarted","Data":"80ac7fd14fc1ac61455531903ca0512ad9822cc836701c7e6eba2ef24e922fdd"}
Jul 27 21:55:27.107976 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:27.107923    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kg8x5" podStartSLOduration=66.385909285 podStartE2EDuration="1m11.107906232s" totalImagesPullingTime="4.721996947s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:55:27.107488201 +0000 UTC m=+71.848622968" watchObservedRunningTime="2026-07-27 21:55:27.107906232 +0000 UTC m=+71.849040999"
Jul 27 21:55:40.483315 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.483197    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6rvzs"]
Jul 27 21:55:40.485855 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.485840    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:40.489621 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.489596    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 21:55:40.490575 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.490542    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 21:55:40.490575 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.490561    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 21:55:40.490734 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.490577    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 21:55:40.490734 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.490612    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s5pg8\""
Jul 27 21:55:40.506183 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.506164    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6rvzs"]
Jul 27 21:55:40.543045 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.543024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-crio-socket\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:40.543172 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.543082    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:40.543172 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.543100    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:40.543255 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.543178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-data-volume\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:40.543290 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.543274    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng2nz\" (UniqueName: \"kubernetes.io/projected/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-api-access-ng2nz\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:40.644126 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.644065    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng2nz\" (UniqueName: \"kubernetes.io/projected/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-api-access-ng2nz\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:40.644288 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.644155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-crio-socket\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:40.644288 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.644202    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:40.644288 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.644219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:40.644288 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.644269    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-crio-socket\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:40.644288 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:40.644281    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 21:55:40.644467 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:40.644304    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 21:55:40.644467 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.644305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-data-volume\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:40.644467 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:40.644373    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-rbac-proxy-cm podName:d188f777-521a-4a1a-8cb9-6caf9c6acf8f nodeName:}" failed. No retries permitted until 2026-07-27 21:55:41.144353501 +0000 UTC m=+85.885488266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6rvzs" (UID: "d188f777-521a-4a1a-8cb9-6caf9c6acf8f") : configmap "kube-rbac-proxy" not found
Jul 27 21:55:40.644467 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:40.644453    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls podName:d188f777-521a-4a1a-8cb9-6caf9c6acf8f nodeName:}" failed. No retries permitted until 2026-07-27 21:55:41.144435843 +0000 UTC m=+85.885570591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6rvzs" (UID: "d188f777-521a-4a1a-8cb9-6caf9c6acf8f") : secret "insights-runtime-extractor-tls" not found
Jul 27 21:55:40.644592 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.644555    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-data-volume\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:40.652859 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:40.652834    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng2nz\" (UniqueName: \"kubernetes.io/projected/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-api-access-ng2nz\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:41.147751 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:41.147715    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:41.147751 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:41.147744    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:41.147953 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:41.147808    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 21:55:41.147953 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:41.147856    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 21:55:41.147953 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:41.147879    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-rbac-proxy-cm podName:d188f777-521a-4a1a-8cb9-6caf9c6acf8f nodeName:}" failed. No retries permitted until 2026-07-27 21:55:42.147863805 +0000 UTC m=+86.888998549 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6rvzs" (UID: "d188f777-521a-4a1a-8cb9-6caf9c6acf8f") : configmap "kube-rbac-proxy" not found
Jul 27 21:55:41.147953 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:41.147898    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls podName:d188f777-521a-4a1a-8cb9-6caf9c6acf8f nodeName:}" failed. No retries permitted until 2026-07-27 21:55:42.147886759 +0000 UTC m=+86.889021540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6rvzs" (UID: "d188f777-521a-4a1a-8cb9-6caf9c6acf8f") : secret "insights-runtime-extractor-tls" not found
Jul 27 21:55:42.154877 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:42.154841    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:42.154877 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:42.154877    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:42.155298 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:42.154950    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 21:55:42.155298 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:42.154978    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 21:55:42.155298 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:42.155018    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-rbac-proxy-cm podName:d188f777-521a-4a1a-8cb9-6caf9c6acf8f nodeName:}" failed. No retries permitted until 2026-07-27 21:55:44.15500383 +0000 UTC m=+88.896138575 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6rvzs" (UID: "d188f777-521a-4a1a-8cb9-6caf9c6acf8f") : configmap "kube-rbac-proxy" not found
Jul 27 21:55:42.155298 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:42.155031    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls podName:d188f777-521a-4a1a-8cb9-6caf9c6acf8f nodeName:}" failed. No retries permitted until 2026-07-27 21:55:44.155025629 +0000 UTC m=+88.896160374 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6rvzs" (UID: "d188f777-521a-4a1a-8cb9-6caf9c6acf8f") : secret "insights-runtime-extractor-tls" not found
Jul 27 21:55:42.462778 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:42.462755    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pxjs5_eb157c02-c15b-478b-995d-c42405aff70e/dns-node-resolver/0.log"
Jul 27 21:55:43.262066 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:43.262032    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f82sq_881ffdfa-9a29-42e3-828d-23523dd11af5/node-ca/0.log"
Jul 27 21:55:44.171308 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:44.171276    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:44.171308 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:44.171307    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:44.171520 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:44.171409    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 21:55:44.171520 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:44.171439    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 21:55:44.171520 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:44.171493    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls podName:d188f777-521a-4a1a-8cb9-6caf9c6acf8f nodeName:}" failed. No retries permitted until 2026-07-27 21:55:48.171477598 +0000 UTC m=+92.912612364 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6rvzs" (UID: "d188f777-521a-4a1a-8cb9-6caf9c6acf8f") : secret "insights-runtime-extractor-tls" not found
Jul 27 21:55:44.171520 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:44.171508    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-rbac-proxy-cm podName:d188f777-521a-4a1a-8cb9-6caf9c6acf8f nodeName:}" failed. No retries permitted until 2026-07-27 21:55:48.171501606 +0000 UTC m=+92.912636366 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6rvzs" (UID: "d188f777-521a-4a1a-8cb9-6caf9c6acf8f") : configmap "kube-rbac-proxy" not found
Jul 27 21:55:44.262903 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:44.262871    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kbx2h_fb94c2b1-988f-4a6c-8871-4462d73cfb15/serve-healthcheck-canary/0.log"
Jul 27 21:55:46.117627 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:46.117594    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vwg5z"]
Jul 27 21:55:46.120236 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:46.120208    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vwg5z"
Jul 27 21:55:46.122559 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:46.122539    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-fbzcs\""
Jul 27 21:55:46.123518 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:46.123500    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 27 21:55:46.123613 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:46.123503    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 27 21:55:46.138048 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:46.138022    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vwg5z"]
Jul 27 21:55:46.185589 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:46.185563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkv7b\" (UniqueName: \"kubernetes.io/projected/308497ef-816b-4a18-b4a3-b35176e67bc6-kube-api-access-rkv7b\") pod \"volume-data-source-validator-549c6d54cf-vwg5z\" (UID: \"308497ef-816b-4a18-b4a3-b35176e67bc6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vwg5z"
Jul 27 21:55:46.286724 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:46.286681    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkv7b\" (UniqueName: \"kubernetes.io/projected/308497ef-816b-4a18-b4a3-b35176e67bc6-kube-api-access-rkv7b\") pod \"volume-data-source-validator-549c6d54cf-vwg5z\" (UID: \"308497ef-816b-4a18-b4a3-b35176e67bc6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vwg5z"
Jul 27 21:55:46.295149 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:46.295129    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkv7b\" (UniqueName: \"kubernetes.io/projected/308497ef-816b-4a18-b4a3-b35176e67bc6-kube-api-access-rkv7b\") pod \"volume-data-source-validator-549c6d54cf-vwg5z\" (UID: \"308497ef-816b-4a18-b4a3-b35176e67bc6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vwg5z"
Jul 27 21:55:46.429002 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:46.428915    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vwg5z"
Jul 27 21:55:46.545112 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:46.545075    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vwg5z"]
Jul 27 21:55:46.549085 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:55:46.549060    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308497ef_816b_4a18_b4a3_b35176e67bc6.slice/crio-507a425edb5e5822b745fff2a2e695f45f85705524476a78ae5759cd7a99bd48 WatchSource:0}: Error finding container 507a425edb5e5822b745fff2a2e695f45f85705524476a78ae5759cd7a99bd48: Status 404 returned error can't find the container with id 507a425edb5e5822b745fff2a2e695f45f85705524476a78ae5759cd7a99bd48
Jul 27 21:55:47.141127 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:47.141091    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vwg5z" event={"ID":"308497ef-816b-4a18-b4a3-b35176e67bc6","Type":"ContainerStarted","Data":"507a425edb5e5822b745fff2a2e695f45f85705524476a78ae5759cd7a99bd48"}
Jul 27 21:55:48.144821 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:48.144727    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vwg5z" event={"ID":"308497ef-816b-4a18-b4a3-b35176e67bc6","Type":"ContainerStarted","Data":"c27663ad2b8e8e7a396000fcc6c45d66ae71c1eae820da7f5b877e2a5635b78d"}
Jul 27 21:55:48.160216 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:48.160173    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vwg5z" podStartSLOduration=0.890025469 podStartE2EDuration="2.160158163s" totalImagesPullingTime="1.270132694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:55:48.159747639 +0000 UTC m=+92.900882433" watchObservedRunningTime="2026-07-27 21:55:48.160158163 +0000 UTC m=+92.901292930"
Jul 27 21:55:48.205436 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:48.205409    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:48.205527 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:48.205440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:48.205566 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:48.205529    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 21:55:48.205606 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:48.205568    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 21:55:48.205606 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:48.205584    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-rbac-proxy-cm podName:d188f777-521a-4a1a-8cb9-6caf9c6acf8f nodeName:}" failed. No retries permitted until 2026-07-27 21:55:56.205569915 +0000 UTC m=+100.946704664 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6rvzs" (UID: "d188f777-521a-4a1a-8cb9-6caf9c6acf8f") : configmap "kube-rbac-proxy" not found
Jul 27 21:55:48.205686 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:48.205616    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls podName:d188f777-521a-4a1a-8cb9-6caf9c6acf8f nodeName:}" failed. No retries permitted until 2026-07-27 21:55:56.205602622 +0000 UTC m=+100.946737381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6rvzs" (UID: "d188f777-521a-4a1a-8cb9-6caf9c6acf8f") : secret "insights-runtime-extractor-tls" not found
Jul 27 21:55:53.131953 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.131916    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-kb48r"]
Jul 27 21:55:53.135011 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.134995    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kb48r"
Jul 27 21:55:53.137558 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.137537    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 27 21:55:53.137688 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.137672    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6mmkk\""
Jul 27 21:55:53.138534 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.138519    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 27 21:55:53.142449 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.142429    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-kb48r"]
Jul 27 21:55:53.243241 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.243200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfbwz\" (UniqueName: \"kubernetes.io/projected/9f479a96-d058-410c-ad48-e6180b486689-kube-api-access-sfbwz\") pod \"migrator-6865c9967-kb48r\" (UID: \"9f479a96-d058-410c-ad48-e6180b486689\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kb48r"
Jul 27 21:55:53.343708 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.343664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfbwz\" (UniqueName: \"kubernetes.io/projected/9f479a96-d058-410c-ad48-e6180b486689-kube-api-access-sfbwz\") pod \"migrator-6865c9967-kb48r\" (UID: \"9f479a96-d058-410c-ad48-e6180b486689\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kb48r"
Jul 27 21:55:53.352480 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.352459    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfbwz\" (UniqueName: \"kubernetes.io/projected/9f479a96-d058-410c-ad48-e6180b486689-kube-api-access-sfbwz\") pod \"migrator-6865c9967-kb48r\" (UID: \"9f479a96-d058-410c-ad48-e6180b486689\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kb48r"
Jul 27 21:55:53.443929 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.443831    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kb48r"
Jul 27 21:55:53.544951 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.544915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls\") pod \"image-registry-7797499974-mg255\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") " pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:55:53.544951 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.544951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls\") pod \"dns-default-blwlz\" (UID: \"f7de6e29-5e18-452b-9853-82530fc6bd38\") " pod="openshift-dns/dns-default-blwlz"
Jul 27 21:55:53.545130 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:53.545044    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 21:55:53.545130 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:53.545091    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls podName:f7de6e29-5e18-452b-9853-82530fc6bd38 nodeName:}" failed. No retries permitted until 2026-07-27 21:56:57.5450774 +0000 UTC m=+162.286212145 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls") pod "dns-default-blwlz" (UID: "f7de6e29-5e18-452b-9853-82530fc6bd38") : secret "dns-default-metrics-tls" not found
Jul 27 21:55:53.545199 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:53.545154    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 21:55:53.545199 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:53.545172    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7797499974-mg255: secret "image-registry-tls" not found
Jul 27 21:55:53.545260 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:53.545223    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls podName:9b322165-7ba4-407d-81aa-2e7aaf96ded0 nodeName:}" failed. No retries permitted until 2026-07-27 21:56:57.545211613 +0000 UTC m=+162.286346358 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls") pod "image-registry-7797499974-mg255" (UID: "9b322165-7ba4-407d-81aa-2e7aaf96ded0") : secret "image-registry-tls" not found
Jul 27 21:55:53.561496 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.561467    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-kb48r"]
Jul 27 21:55:53.564393 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:55:53.564371    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f479a96_d058_410c_ad48_e6180b486689.slice/crio-2a5ff8658236dd734f2cdf62655ffe5c798b75dade6854825c5bb98d779d97d2 WatchSource:0}: Error finding container 2a5ff8658236dd734f2cdf62655ffe5c798b75dade6854825c5bb98d779d97d2: Status 404 returned error can't find the container with id 2a5ff8658236dd734f2cdf62655ffe5c798b75dade6854825c5bb98d779d97d2
Jul 27 21:55:53.940569 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.940536    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-2z8fq"]
Jul 27 21:55:53.944617 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.944592    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-2z8fq"
Jul 27 21:55:53.947375 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.947349    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 27 21:55:53.947559 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.947543    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 27 21:55:53.947685 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.947673    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 27 21:55:53.948276 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.948256    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gk5x5\""
Jul 27 21:55:53.948359 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.948267    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 27 21:55:53.955514 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:53.955491    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-2z8fq"]
Jul 27 21:55:54.049101 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:54.049067    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/db64d2a3-f487-4e5d-a6d8-659bf4a215fd-signing-cabundle\") pod \"service-ca-658d7b7c78-2z8fq\" (UID: \"db64d2a3-f487-4e5d-a6d8-659bf4a215fd\") " pod="openshift-service-ca/service-ca-658d7b7c78-2z8fq"
Jul 27 21:55:54.049101 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:54.049110    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/db64d2a3-f487-4e5d-a6d8-659bf4a215fd-signing-key\") pod \"service-ca-658d7b7c78-2z8fq\" (UID: \"db64d2a3-f487-4e5d-a6d8-659bf4a215fd\") " pod="openshift-service-ca/service-ca-658d7b7c78-2z8fq"
Jul 27 21:55:54.049316 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:54.049127    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7twf\" (UniqueName: \"kubernetes.io/projected/db64d2a3-f487-4e5d-a6d8-659bf4a215fd-kube-api-access-l7twf\") pod \"service-ca-658d7b7c78-2z8fq\" (UID: \"db64d2a3-f487-4e5d-a6d8-659bf4a215fd\") " pod="openshift-service-ca/service-ca-658d7b7c78-2z8fq"
Jul 27 21:55:54.150482 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:54.150446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/db64d2a3-f487-4e5d-a6d8-659bf4a215fd-signing-cabundle\") pod \"service-ca-658d7b7c78-2z8fq\" (UID: \"db64d2a3-f487-4e5d-a6d8-659bf4a215fd\") " pod="openshift-service-ca/service-ca-658d7b7c78-2z8fq"
Jul 27 21:55:54.150952 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:54.150501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/db64d2a3-f487-4e5d-a6d8-659bf4a215fd-signing-key\") pod \"service-ca-658d7b7c78-2z8fq\" (UID: \"db64d2a3-f487-4e5d-a6d8-659bf4a215fd\") " pod="openshift-service-ca/service-ca-658d7b7c78-2z8fq"
Jul 27 21:55:54.150952 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:54.150763    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7twf\" (UniqueName: \"kubernetes.io/projected/db64d2a3-f487-4e5d-a6d8-659bf4a215fd-kube-api-access-l7twf\") pod \"service-ca-658d7b7c78-2z8fq\" (UID: \"db64d2a3-f487-4e5d-a6d8-659bf4a215fd\") " pod="openshift-service-ca/service-ca-658d7b7c78-2z8fq"
Jul 27 21:55:54.151479 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:54.151422    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/db64d2a3-f487-4e5d-a6d8-659bf4a215fd-signing-cabundle\") pod \"service-ca-658d7b7c78-2z8fq\" (UID: \"db64d2a3-f487-4e5d-a6d8-659bf4a215fd\") " pod="openshift-service-ca/service-ca-658d7b7c78-2z8fq"
Jul 27 21:55:54.153791 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:54.153769    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/db64d2a3-f487-4e5d-a6d8-659bf4a215fd-signing-key\") pod \"service-ca-658d7b7c78-2z8fq\" (UID: \"db64d2a3-f487-4e5d-a6d8-659bf4a215fd\") " pod="openshift-service-ca/service-ca-658d7b7c78-2z8fq"
Jul 27 21:55:54.163186 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:54.160693    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7twf\" (UniqueName: \"kubernetes.io/projected/db64d2a3-f487-4e5d-a6d8-659bf4a215fd-kube-api-access-l7twf\") pod \"service-ca-658d7b7c78-2z8fq\" (UID: \"db64d2a3-f487-4e5d-a6d8-659bf4a215fd\") " pod="openshift-service-ca/service-ca-658d7b7c78-2z8fq"
Jul 27 21:55:54.164719 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:54.164688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kb48r" event={"ID":"9f479a96-d058-410c-ad48-e6180b486689","Type":"ContainerStarted","Data":"2a5ff8658236dd734f2cdf62655ffe5c798b75dade6854825c5bb98d779d97d2"}
Jul 27 21:55:54.252889 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:54.252859    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-2z8fq"
Jul 27 21:55:54.384983 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:54.384942    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-2z8fq"]
Jul 27 21:55:54.389418 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:55:54.389386    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb64d2a3_f487_4e5d_a6d8_659bf4a215fd.slice/crio-8a6d77e956565cf2a0e5d663da9ede5799f80843e71d2a23865c05d7e4fba2a3 WatchSource:0}: Error finding container 8a6d77e956565cf2a0e5d663da9ede5799f80843e71d2a23865c05d7e4fba2a3: Status 404 returned error can't find the container with id 8a6d77e956565cf2a0e5d663da9ede5799f80843e71d2a23865c05d7e4fba2a3
Jul 27 21:55:55.169350 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:55.169310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-2z8fq" event={"ID":"db64d2a3-f487-4e5d-a6d8-659bf4a215fd","Type":"ContainerStarted","Data":"8a6d77e956565cf2a0e5d663da9ede5799f80843e71d2a23865c05d7e4fba2a3"}
Jul 27 21:55:55.171464 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:55.171435    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kb48r" event={"ID":"9f479a96-d058-410c-ad48-e6180b486689","Type":"ContainerStarted","Data":"c0b3d0dd72f1ed0d92a0687f7ca4595c0a8b6b6c3672b708f4a75fe1999ce49a"}
Jul 27 21:55:55.171616 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:55.171488    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kb48r" event={"ID":"9f479a96-d058-410c-ad48-e6180b486689","Type":"ContainerStarted","Data":"cb3b96698b5811bd988952de2e5d47466fa4d320e7968e9d7dad4e8f7064cbea"}
Jul 27 21:55:56.091908 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:56.091879    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-btrhh"
Jul 27 21:55:56.111562 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:56.111500    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-kb48r" podStartSLOduration=2.006897934 podStartE2EDuration="3.111483226s" totalImagesPullingTime="1.104585292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:55:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:55:55.190142429 +0000 UTC m=+99.931277195" watchObservedRunningTime="2026-07-27 21:55:56.111483226 +0000 UTC m=+100.852617994"
Jul 27 21:55:56.267865 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:56.267842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:56.268202 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:56.267876    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:56.268202 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:56.267959    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 21:55:56.268202 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:55:56.268000    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls podName:d188f777-521a-4a1a-8cb9-6caf9c6acf8f nodeName:}" failed. No retries permitted until 2026-07-27 21:56:12.267986692 +0000 UTC m=+117.009121438 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6rvzs" (UID: "d188f777-521a-4a1a-8cb9-6caf9c6acf8f") : secret "insights-runtime-extractor-tls" not found
Jul 27 21:55:56.268419 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:56.268400    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:55:57.181632 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:57.181593    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-2z8fq" event={"ID":"db64d2a3-f487-4e5d-a6d8-659bf4a215fd","Type":"ContainerStarted","Data":"a1fcfe024e61e68b7159ada98839c16de52e5fd2efd36b142aee30c79c403148"}
Jul 27 21:55:57.200571 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:55:57.200513    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-2z8fq" podStartSLOduration=2.41448972 podStartE2EDuration="4.200493946s" totalImagesPullingTime="1.786004226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:55:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:55:57.198802591 +0000 UTC m=+101.939937357" watchObservedRunningTime="2026-07-27 21:55:57.200493946 +0000 UTC m=+101.941628714"
Jul 27 21:56:12.291746 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:12.291692    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:56:12.293835 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:12.293807    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d188f777-521a-4a1a-8cb9-6caf9c6acf8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6rvzs\" (UID: \"d188f777-521a-4a1a-8cb9-6caf9c6acf8f\") " pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:56:12.296798 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:12.296783    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6rvzs"
Jul 27 21:56:12.415472 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:12.415438    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6rvzs"]
Jul 27 21:56:12.418544 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:56:12.418517    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd188f777_521a_4a1a_8cb9_6caf9c6acf8f.slice/crio-5983414c73529286438b742800b8ba4f7d0359df317d3d8d7d7e75225eab4860 WatchSource:0}: Error finding container 5983414c73529286438b742800b8ba4f7d0359df317d3d8d7d7e75225eab4860: Status 404 returned error can't find the container with id 5983414c73529286438b742800b8ba4f7d0359df317d3d8d7d7e75225eab4860
Jul 27 21:56:13.229211 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:13.229137    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6rvzs" event={"ID":"d188f777-521a-4a1a-8cb9-6caf9c6acf8f","Type":"ContainerStarted","Data":"5983414c73529286438b742800b8ba4f7d0359df317d3d8d7d7e75225eab4860"}
Jul 27 21:56:13.779501 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:13.779424    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-cbv9s"]
Jul 27 21:56:13.781605 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:13.781573    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sw5bh"]
Jul 27 21:56:13.781753 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:13.781719    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cbv9s"
Jul 27 21:56:13.783585 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:13.783563    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-p59jd"]
Jul 27 21:56:13.783718 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:13.783683    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sw5bh"
Jul 27 21:56:13.784128 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:13.784108    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pz4r5\""
Jul 27 21:56:13.784356 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:13.784329    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 27 21:56:13.785469 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:13.785420    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p59jd"
Jul 27 21:56:13.787841 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:13.787822    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 27 21:56:13.788937 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:13.788819    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 27 21:56:13.788937 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:13.788832    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-m8pc8\""
Jul 27 21:56:13.788937 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:13.788854    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dtjzn\""
Jul 27 21:56:13.815714 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:13.815575    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-p59jd"]
Jul 27 21:56:13.816286 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:13.816265    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-cbv9s"]
Jul 27 21:56:13.817300 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:13.817275    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sw5bh"]
Jul 27 21:56:13.906135 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:13.906104    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/96b3223c-2d5a-4b94-9a18-7c0e1043b3f8-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-cbv9s\" (UID: \"96b3223c-2d5a-4b94-9a18-7c0e1043b3f8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cbv9s"
Jul 27 21:56:13.906403 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:13.906175    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96b3223c-2d5a-4b94-9a18-7c0e1043b3f8-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cbv9s\" (UID: \"96b3223c-2d5a-4b94-9a18-7c0e1043b3f8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cbv9s"
Jul 27 21:56:13.906403 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:13.906230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d95af059-949b-4242-ae1b-ff8d1bf6a27c-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-sw5bh\" (UID: \"d95af059-949b-4242-ae1b-ff8d1bf6a27c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sw5bh"
Jul 27 21:56:13.906403 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:13.906375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttfdj\" (UniqueName: \"kubernetes.io/projected/f3cd784d-44af-4c80-bfea-9f333c5d77df-kube-api-access-ttfdj\") pod \"network-check-source-7d88cb55d8-p59jd\" (UID: \"f3cd784d-44af-4c80-bfea-9f333c5d77df\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p59jd"
Jul 27 21:56:14.007666 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:14.007615    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/96b3223c-2d5a-4b94-9a18-7c0e1043b3f8-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-cbv9s\" (UID: \"96b3223c-2d5a-4b94-9a18-7c0e1043b3f8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cbv9s"
Jul 27 21:56:14.007854 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:14.007671    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96b3223c-2d5a-4b94-9a18-7c0e1043b3f8-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cbv9s\" (UID: \"96b3223c-2d5a-4b94-9a18-7c0e1043b3f8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cbv9s"
Jul 27 21:56:14.007854 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:14.007735    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d95af059-949b-4242-ae1b-ff8d1bf6a27c-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-sw5bh\" (UID: \"d95af059-949b-4242-ae1b-ff8d1bf6a27c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sw5bh"
Jul 27 21:56:14.007972 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:14.007878    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttfdj\" (UniqueName: \"kubernetes.io/projected/f3cd784d-44af-4c80-bfea-9f333c5d77df-kube-api-access-ttfdj\") pod \"network-check-source-7d88cb55d8-p59jd\" (UID: \"f3cd784d-44af-4c80-bfea-9f333c5d77df\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p59jd"
Jul 27 21:56:14.008646 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:14.008568    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/96b3223c-2d5a-4b94-9a18-7c0e1043b3f8-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-cbv9s\" (UID: \"96b3223c-2d5a-4b94-9a18-7c0e1043b3f8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cbv9s"
Jul 27 21:56:14.010436 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:14.010413    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96b3223c-2d5a-4b94-9a18-7c0e1043b3f8-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cbv9s\" (UID: \"96b3223c-2d5a-4b94-9a18-7c0e1043b3f8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cbv9s"
Jul 27 21:56:14.010530 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:14.010485    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d95af059-949b-4242-ae1b-ff8d1bf6a27c-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-sw5bh\" (UID: \"d95af059-949b-4242-ae1b-ff8d1bf6a27c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sw5bh"
Jul 27 21:56:14.020918 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:14.020896    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttfdj\" (UniqueName: \"kubernetes.io/projected/f3cd784d-44af-4c80-bfea-9f333c5d77df-kube-api-access-ttfdj\") pod \"network-check-source-7d88cb55d8-p59jd\" (UID: \"f3cd784d-44af-4c80-bfea-9f333c5d77df\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p59jd"
Jul 27 21:56:14.093997 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:14.093915    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cbv9s"
Jul 27 21:56:14.101825 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:14.101802    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sw5bh"
Jul 27 21:56:14.107565 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:14.107381    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p59jd"
Jul 27 21:56:14.259114 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:14.259031    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-cbv9s"]
Jul 27 21:56:14.264162 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:56:14.264120    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96b3223c_2d5a_4b94_9a18_7c0e1043b3f8.slice/crio-568e9b8a7201ddc8fc1ad8d42519cdaa3d2de3a3e638f8e68d1ffafb257141d5 WatchSource:0}: Error finding container 568e9b8a7201ddc8fc1ad8d42519cdaa3d2de3a3e638f8e68d1ffafb257141d5: Status 404 returned error can't find the container with id 568e9b8a7201ddc8fc1ad8d42519cdaa3d2de3a3e638f8e68d1ffafb257141d5
Jul 27 21:56:14.492497 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:14.492456    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-p59jd"]
Jul 27 21:56:14.495058 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:56:14.495029    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3cd784d_44af_4c80_bfea_9f333c5d77df.slice/crio-e46abddb6783e5ce9920c2bce3f2b4644dd034c0b0e8bc6d4ae30ad6d0d9b60e WatchSource:0}: Error finding container e46abddb6783e5ce9920c2bce3f2b4644dd034c0b0e8bc6d4ae30ad6d0d9b60e: Status 404 returned error can't find the container with id e46abddb6783e5ce9920c2bce3f2b4644dd034c0b0e8bc6d4ae30ad6d0d9b60e
Jul 27 21:56:14.507502 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:14.507388    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sw5bh"]
Jul 27 21:56:14.510051 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:56:14.510022    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd95af059_949b_4242_ae1b_ff8d1bf6a27c.slice/crio-0ea392f68acd5439a032d80e4c5842b59df141a975798ef10d8fc856810068a6 WatchSource:0}: Error finding container 0ea392f68acd5439a032d80e4c5842b59df141a975798ef10d8fc856810068a6: Status 404 returned error can't find the container with id 0ea392f68acd5439a032d80e4c5842b59df141a975798ef10d8fc856810068a6
Jul 27 21:56:15.237369 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:15.237310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cbv9s" event={"ID":"96b3223c-2d5a-4b94-9a18-7c0e1043b3f8","Type":"ContainerStarted","Data":"568e9b8a7201ddc8fc1ad8d42519cdaa3d2de3a3e638f8e68d1ffafb257141d5"}
Jul 27 21:56:15.238927 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:15.238852    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p59jd" event={"ID":"f3cd784d-44af-4c80-bfea-9f333c5d77df","Type":"ContainerStarted","Data":"7bfaacf696beb5f8d78f57f5f6eedaba607cefc3a80141103d410b7c870283d5"}
Jul 27 21:56:15.238927 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:15.238898    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p59jd" event={"ID":"f3cd784d-44af-4c80-bfea-9f333c5d77df","Type":"ContainerStarted","Data":"e46abddb6783e5ce9920c2bce3f2b4644dd034c0b0e8bc6d4ae30ad6d0d9b60e"}
Jul 27 21:56:15.240135 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:15.240115    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sw5bh" event={"ID":"d95af059-949b-4242-ae1b-ff8d1bf6a27c","Type":"ContainerStarted","Data":"0ea392f68acd5439a032d80e4c5842b59df141a975798ef10d8fc856810068a6"}
Jul 27 21:56:15.254606 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:15.254568    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p59jd" podStartSLOduration=2.25455613 podStartE2EDuration="2.25455613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:56:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:56:15.253539468 +0000 UTC m=+119.994674264" watchObservedRunningTime="2026-07-27 21:56:15.25455613 +0000 UTC m=+119.995690896"
Jul 27 21:56:18.254781 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:18.254742    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cbv9s" event={"ID":"96b3223c-2d5a-4b94-9a18-7c0e1043b3f8","Type":"ContainerStarted","Data":"9cf97ce46508cdf2b2443d3ae1547d96e155733f40af801ce3dd23f7e0eacdd6"}
Jul 27 21:56:18.256139 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:18.256115    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6rvzs" event={"ID":"d188f777-521a-4a1a-8cb9-6caf9c6acf8f","Type":"ContainerStarted","Data":"59a0b767d4a0694aecd34f171e2a3ce54bff47f749b348afe0d70d5613c4c4a3"}
Jul 27 21:56:18.257369 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:18.257328    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sw5bh" event={"ID":"d95af059-949b-4242-ae1b-ff8d1bf6a27c","Type":"ContainerStarted","Data":"e5f61e79db1952a48b36b2fb50c4bc84870efcf2b8c62d90291faa7090113f01"}
Jul 27 21:56:18.257473 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:18.257458    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sw5bh"
Jul 27 21:56:18.262041 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:18.262024    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sw5bh"
Jul 27 21:56:18.271075 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:18.271037    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cbv9s" podStartSLOduration=1.654069839 podStartE2EDuration="5.271024561s" totalImagesPullingTime="3.616954722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:56:18.270143397 +0000 UTC m=+123.011278164" watchObservedRunningTime="2026-07-27 21:56:18.271024561 +0000 UTC m=+123.012159324"
Jul 27 21:56:18.284825 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:18.284781    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-sw5bh" podStartSLOduration=1.910771183 podStartE2EDuration="5.28477084s" totalImagesPullingTime="3.373999657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:56:18.284034712 +0000 UTC m=+123.025169479" watchObservedRunningTime="2026-07-27 21:56:18.28477084 +0000 UTC m=+123.025905606"
Jul 27 21:56:21.269932 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:21.269894    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6rvzs" event={"ID":"d188f777-521a-4a1a-8cb9-6caf9c6acf8f","Type":"ContainerStarted","Data":"4a221716d886146a0bd4a9301ce14a594043111a8b3ff453fd3ce3a1b39f9b8d"}
Jul 27 21:56:25.288108 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:25.288068    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6rvzs" event={"ID":"d188f777-521a-4a1a-8cb9-6caf9c6acf8f","Type":"ContainerStarted","Data":"f89fd937b44ec361ac80027c9553d1a617ae349327aeb29e7210ade0c10b6e48"}
Jul 27 21:56:25.309552 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:25.309504    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6rvzs" podStartSLOduration=33.345860709 podStartE2EDuration="45.309485312s" totalImagesPullingTime="11.963624603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:55:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:56:25.308386543 +0000 UTC m=+130.049521321" watchObservedRunningTime="2026-07-27 21:56:25.309485312 +0000 UTC m=+130.050620079"
Jul 27 21:56:25.702450 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:25.702325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs\") pod \"network-metrics-daemon-lgt8f\" (UID: \"807200be-220e-4e07-8641-8b0bd2788381\") " pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:56:25.704546 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:25.704524    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/807200be-220e-4e07-8641-8b0bd2788381-metrics-certs\") pod \"network-metrics-daemon-lgt8f\" (UID: \"807200be-220e-4e07-8641-8b0bd2788381\") " pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:56:25.825670 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:25.825644    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tm84h\""
Jul 27 21:56:25.833963 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:25.833946    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lgt8f"
Jul 27 21:56:25.954875 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:25.954763    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lgt8f"]
Jul 27 21:56:25.957817 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:56:25.957793    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod807200be_220e_4e07_8641_8b0bd2788381.slice/crio-eeafd5710c588afe2c87c24d10c4343161a960d3e95a02d05f17f50b94b3828d WatchSource:0}: Error finding container eeafd5710c588afe2c87c24d10c4343161a960d3e95a02d05f17f50b94b3828d: Status 404 returned error can't find the container with id eeafd5710c588afe2c87c24d10c4343161a960d3e95a02d05f17f50b94b3828d
Jul 27 21:56:26.292143 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:26.292108    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lgt8f" event={"ID":"807200be-220e-4e07-8641-8b0bd2788381","Type":"ContainerStarted","Data":"eeafd5710c588afe2c87c24d10c4343161a960d3e95a02d05f17f50b94b3828d"}
Jul 27 21:56:27.296585 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:27.296548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lgt8f" event={"ID":"807200be-220e-4e07-8641-8b0bd2788381","Type":"ContainerStarted","Data":"c36aca85b93edb2ed22990393677134eda434fafa6358eedccb48652ac2a0138"}
Jul 27 21:56:27.296955 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:27.296605    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lgt8f" event={"ID":"807200be-220e-4e07-8641-8b0bd2788381","Type":"ContainerStarted","Data":"b445f2a036310121ee0d5663ab342fd22e3f11580384517a2283cfac1e7cfd9f"}
Jul 27 21:56:27.314232 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:27.314181    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lgt8f" podStartSLOduration=130.384902265 podStartE2EDuration="2m11.314167395s" totalImagesPullingTime="929.26513ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:56:27.3136831 +0000 UTC m=+132.054817886" watchObservedRunningTime="2026-07-27 21:56:27.314167395 +0000 UTC m=+132.055302161"
Jul 27 21:56:30.187825 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.187792    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp"]
Jul 27 21:56:30.190954 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.190935    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp"
Jul 27 21:56:30.193775 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.193750    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 27 21:56:30.194243 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.194224    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 21:56:30.200053 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.200032    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 21:56:30.200203 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.200093    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 21:56:30.200306 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.200286    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4b4d5\""
Jul 27 21:56:30.200621 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.200097    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 27 21:56:30.202739 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.202716    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"]
Jul 27 21:56:30.207880 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.206032    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:30.208265 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.208248    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-w62f7"]
Jul 27 21:56:30.208402 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.208383    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 27 21:56:30.208543 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.208526    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vmkjd\""
Jul 27 21:56:30.208761 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.208745    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 27 21:56:30.208916 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.208903    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 27 21:56:30.212968 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.212949    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp"]
Jul 27 21:56:30.213085 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.213052    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.216001 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.215357    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jqbc5\""
Jul 27 21:56:30.216068 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.216025    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 21:56:30.216272 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.216253    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 21:56:30.216459 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.216416    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 21:56:30.217132 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.217113    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"]
Jul 27 21:56:30.230079 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.230055    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/db759bf4-2c95-43e8-b419-25167337b05c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gksqp\" (UID: \"db759bf4-2c95-43e8-b419-25167337b05c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp"
Jul 27 21:56:30.230182 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.230098    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db759bf4-2c95-43e8-b419-25167337b05c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-gksqp\" (UID: \"db759bf4-2c95-43e8-b419-25167337b05c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp"
Jul 27 21:56:30.230182 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.230125    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/777715f6-7f65-45ed-b262-85464cdd02f5-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-5m5gq\" (UID: \"777715f6-7f65-45ed-b262-85464cdd02f5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:30.230182 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.230149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/777715f6-7f65-45ed-b262-85464cdd02f5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-5m5gq\" (UID: \"777715f6-7f65-45ed-b262-85464cdd02f5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:30.230182 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.230173    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c39868ff-0054-4900-867f-7338e6bd13af-node-exporter-wtmp\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.230382 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.230213    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/777715f6-7f65-45ed-b262-85464cdd02f5-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-5m5gq\" (UID: \"777715f6-7f65-45ed-b262-85464cdd02f5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:30.230382 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.230278    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/777715f6-7f65-45ed-b262-85464cdd02f5-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-5m5gq\" (UID: \"777715f6-7f65-45ed-b262-85464cdd02f5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:30.230382 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.230303    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/777715f6-7f65-45ed-b262-85464cdd02f5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-5m5gq\" (UID: \"777715f6-7f65-45ed-b262-85464cdd02f5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:30.230382 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.230326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zcdk\" (UniqueName: \"kubernetes.io/projected/db759bf4-2c95-43e8-b419-25167337b05c-kube-api-access-5zcdk\") pod \"openshift-state-metrics-b8f49f5c6-gksqp\" (UID: \"db759bf4-2c95-43e8-b419-25167337b05c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp"
Jul 27 21:56:30.230382 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.230367    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c39868ff-0054-4900-867f-7338e6bd13af-root\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.230618 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.230403    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c39868ff-0054-4900-867f-7338e6bd13af-node-exporter-accelerators-collector-config\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.230618 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.230426    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms8nr\" (UniqueName: \"kubernetes.io/projected/c39868ff-0054-4900-867f-7338e6bd13af-kube-api-access-ms8nr\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.230618 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.230461    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6chq\" (UniqueName: \"kubernetes.io/projected/777715f6-7f65-45ed-b262-85464cdd02f5-kube-api-access-p6chq\") pod \"kube-state-metrics-56d9f944b4-5m5gq\" (UID: \"777715f6-7f65-45ed-b262-85464cdd02f5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:30.230618 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.230485    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c39868ff-0054-4900-867f-7338e6bd13af-node-exporter-textfile\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.230618 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.230501    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db759bf4-2c95-43e8-b419-25167337b05c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-gksqp\" (UID: \"db759bf4-2c95-43e8-b419-25167337b05c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp"
Jul 27 21:56:30.230618 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.230515    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c39868ff-0054-4900-867f-7338e6bd13af-metrics-client-ca\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.230618 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.230538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c39868ff-0054-4900-867f-7338e6bd13af-node-exporter-tls\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.230618 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.230553    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c39868ff-0054-4900-867f-7338e6bd13af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.231051 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.230656    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c39868ff-0054-4900-867f-7338e6bd13af-sys\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.331237 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.331197    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/db759bf4-2c95-43e8-b419-25167337b05c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gksqp\" (UID: \"db759bf4-2c95-43e8-b419-25167337b05c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp"
Jul 27 21:56:30.331425 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.331250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db759bf4-2c95-43e8-b419-25167337b05c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-gksqp\" (UID: \"db759bf4-2c95-43e8-b419-25167337b05c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp"
Jul 27 21:56:30.331425 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.331276    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/777715f6-7f65-45ed-b262-85464cdd02f5-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-5m5gq\" (UID: \"777715f6-7f65-45ed-b262-85464cdd02f5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:30.331425 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.331301    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/777715f6-7f65-45ed-b262-85464cdd02f5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-5m5gq\" (UID: \"777715f6-7f65-45ed-b262-85464cdd02f5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:30.331425 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.331328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c39868ff-0054-4900-867f-7338e6bd13af-node-exporter-wtmp\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.331648 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.331553    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/777715f6-7f65-45ed-b262-85464cdd02f5-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-5m5gq\" (UID: \"777715f6-7f65-45ed-b262-85464cdd02f5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:30.331648 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.331595    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/777715f6-7f65-45ed-b262-85464cdd02f5-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-5m5gq\" (UID: \"777715f6-7f65-45ed-b262-85464cdd02f5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:30.331751 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.331510    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c39868ff-0054-4900-867f-7338e6bd13af-node-exporter-wtmp\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.331751 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:56:30.331368    2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 27 21:56:30.331851 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:56:30.331756    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db759bf4-2c95-43e8-b419-25167337b05c-openshift-state-metrics-tls podName:db759bf4-2c95-43e8-b419-25167337b05c nodeName:}" failed. No retries permitted until 2026-07-27 21:56:30.831739467 +0000 UTC m=+135.572874220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/db759bf4-2c95-43e8-b419-25167337b05c-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-gksqp" (UID: "db759bf4-2c95-43e8-b419-25167337b05c") : secret "openshift-state-metrics-tls" not found
Jul 27 21:56:30.331948 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.331923    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/777715f6-7f65-45ed-b262-85464cdd02f5-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-5m5gq\" (UID: \"777715f6-7f65-45ed-b262-85464cdd02f5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:30.332005 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:56:30.331675    2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 27 21:56:30.332005 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.331977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/777715f6-7f65-45ed-b262-85464cdd02f5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-5m5gq\" (UID: \"777715f6-7f65-45ed-b262-85464cdd02f5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:30.332005 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:56:30.331993    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/777715f6-7f65-45ed-b262-85464cdd02f5-kube-state-metrics-tls podName:777715f6-7f65-45ed-b262-85464cdd02f5 nodeName:}" failed. No retries permitted until 2026-07-27 21:56:30.831980514 +0000 UTC m=+135.573115266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/777715f6-7f65-45ed-b262-85464cdd02f5-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-5m5gq" (UID: "777715f6-7f65-45ed-b262-85464cdd02f5") : secret "kube-state-metrics-tls" not found
Jul 27 21:56:30.332144 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.332023    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zcdk\" (UniqueName: \"kubernetes.io/projected/db759bf4-2c95-43e8-b419-25167337b05c-kube-api-access-5zcdk\") pod \"openshift-state-metrics-b8f49f5c6-gksqp\" (UID: \"db759bf4-2c95-43e8-b419-25167337b05c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp"
Jul 27 21:56:30.332144 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.332047    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c39868ff-0054-4900-867f-7338e6bd13af-root\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.332144 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.332092    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c39868ff-0054-4900-867f-7338e6bd13af-node-exporter-accelerators-collector-config\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.332144 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.332116    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms8nr\" (UniqueName: \"kubernetes.io/projected/c39868ff-0054-4900-867f-7338e6bd13af-kube-api-access-ms8nr\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.332356 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.332143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6chq\" (UniqueName: \"kubernetes.io/projected/777715f6-7f65-45ed-b262-85464cdd02f5-kube-api-access-p6chq\") pod \"kube-state-metrics-56d9f944b4-5m5gq\" (UID: \"777715f6-7f65-45ed-b262-85464cdd02f5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:30.332356 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.332168    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c39868ff-0054-4900-867f-7338e6bd13af-node-exporter-textfile\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.332356 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.332193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db759bf4-2c95-43e8-b419-25167337b05c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-gksqp\" (UID: \"db759bf4-2c95-43e8-b419-25167337b05c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp"
Jul 27 21:56:30.332356 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.332220    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c39868ff-0054-4900-867f-7338e6bd13af-metrics-client-ca\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.332356 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.332265    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c39868ff-0054-4900-867f-7338e6bd13af-node-exporter-tls\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.332356 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.332288    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c39868ff-0054-4900-867f-7338e6bd13af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.332646 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.332356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c39868ff-0054-4900-867f-7338e6bd13af-sys\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.332646 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.332373    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/777715f6-7f65-45ed-b262-85464cdd02f5-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-5m5gq\" (UID: \"777715f6-7f65-45ed-b262-85464cdd02f5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:30.332646 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.332435    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c39868ff-0054-4900-867f-7338e6bd13af-sys\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.332646 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.332550    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/777715f6-7f65-45ed-b262-85464cdd02f5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-5m5gq\" (UID: \"777715f6-7f65-45ed-b262-85464cdd02f5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:30.332844 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.332823    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c39868ff-0054-4900-867f-7338e6bd13af-node-exporter-textfile\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.333094 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.333071    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c39868ff-0054-4900-867f-7338e6bd13af-metrics-client-ca\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.333311 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.333290    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c39868ff-0054-4900-867f-7338e6bd13af-node-exporter-accelerators-collector-config\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.333400 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.332822    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c39868ff-0054-4900-867f-7338e6bd13af-root\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.333454 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:56:30.333406    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 27 21:56:30.333454 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.333444    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db759bf4-2c95-43e8-b419-25167337b05c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-gksqp\" (UID: \"db759bf4-2c95-43e8-b419-25167337b05c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp"
Jul 27 21:56:30.333559 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:56:30.333454    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c39868ff-0054-4900-867f-7338e6bd13af-node-exporter-tls podName:c39868ff-0054-4900-867f-7338e6bd13af nodeName:}" failed. No retries permitted until 2026-07-27 21:56:30.833439512 +0000 UTC m=+135.574574264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c39868ff-0054-4900-867f-7338e6bd13af-node-exporter-tls") pod "node-exporter-w62f7" (UID: "c39868ff-0054-4900-867f-7338e6bd13af") : secret "node-exporter-tls" not found
Jul 27 21:56:30.335590 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.335561    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c39868ff-0054-4900-867f-7338e6bd13af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.335717 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.335694    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db759bf4-2c95-43e8-b419-25167337b05c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-gksqp\" (UID: \"db759bf4-2c95-43e8-b419-25167337b05c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp"
Jul 27 21:56:30.335790 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.335773    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/777715f6-7f65-45ed-b262-85464cdd02f5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-5m5gq\" (UID: \"777715f6-7f65-45ed-b262-85464cdd02f5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:30.340874 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.340850    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6chq\" (UniqueName: \"kubernetes.io/projected/777715f6-7f65-45ed-b262-85464cdd02f5-kube-api-access-p6chq\") pod \"kube-state-metrics-56d9f944b4-5m5gq\" (UID: \"777715f6-7f65-45ed-b262-85464cdd02f5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:30.341501 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.341473    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zcdk\" (UniqueName: \"kubernetes.io/projected/db759bf4-2c95-43e8-b419-25167337b05c-kube-api-access-5zcdk\") pod \"openshift-state-metrics-b8f49f5c6-gksqp\" (UID: \"db759bf4-2c95-43e8-b419-25167337b05c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp"
Jul 27 21:56:30.341865 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.341845    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms8nr\" (UniqueName: \"kubernetes.io/projected/c39868ff-0054-4900-867f-7338e6bd13af-kube-api-access-ms8nr\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.836867 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.836832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/db759bf4-2c95-43e8-b419-25167337b05c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gksqp\" (UID: \"db759bf4-2c95-43e8-b419-25167337b05c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp"
Jul 27 21:56:30.837036 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.836882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/777715f6-7f65-45ed-b262-85464cdd02f5-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-5m5gq\" (UID: \"777715f6-7f65-45ed-b262-85464cdd02f5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:30.837036 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.836934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c39868ff-0054-4900-867f-7338e6bd13af-node-exporter-tls\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.839139 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.839114    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c39868ff-0054-4900-867f-7338e6bd13af-node-exporter-tls\") pod \"node-exporter-w62f7\" (UID: \"c39868ff-0054-4900-867f-7338e6bd13af\") " pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:30.839250 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.839221    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/777715f6-7f65-45ed-b262-85464cdd02f5-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-5m5gq\" (UID: \"777715f6-7f65-45ed-b262-85464cdd02f5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:30.839289 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:30.839263    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/db759bf4-2c95-43e8-b419-25167337b05c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gksqp\" (UID: \"db759bf4-2c95-43e8-b419-25167337b05c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp"
Jul 27 21:56:31.111078 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.110991    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp"
Jul 27 21:56:31.120818 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.120790    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"
Jul 27 21:56:31.128127 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.128100    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w62f7"
Jul 27 21:56:31.138799 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:56:31.138767    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc39868ff_0054_4900_867f_7338e6bd13af.slice/crio-94d0a6756f73154add4980a64997572eef40f0fb63ef3198325cf29c8c4934b5 WatchSource:0}: Error finding container 94d0a6756f73154add4980a64997572eef40f0fb63ef3198325cf29c8c4934b5: Status 404 returned error can't find the container with id 94d0a6756f73154add4980a64997572eef40f0fb63ef3198325cf29c8c4934b5
Jul 27 21:56:31.245567 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.245540    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:56:31.251518 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.251493    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.260026 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.260000    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 27 21:56:31.260236 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.260069    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 27 21:56:31.260236 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.260000    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-r6j9x\""
Jul 27 21:56:31.260541 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.260265    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 27 21:56:31.260541 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.260228    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 27 21:56:31.260541 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.260497    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 27 21:56:31.261071 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.260622    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 27 21:56:31.261071 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.260663    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 27 21:56:31.261071 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.260899    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 27 21:56:31.261274 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.261252    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 27 21:56:31.263323 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.263302    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp"]
Jul 27 21:56:31.265095 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:56:31.265076    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb759bf4_2c95_43e8_b419_25167337b05c.slice/crio-8572b075d3e3de7590c072be8848a1b3c8981f690b95be837722ed5129fab5b6 WatchSource:0}: Error finding container 8572b075d3e3de7590c072be8848a1b3c8981f690b95be837722ed5129fab5b6: Status 404 returned error can't find the container with id 8572b075d3e3de7590c072be8848a1b3c8981f690b95be837722ed5129fab5b6
Jul 27 21:56:31.273124 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.273105    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:56:31.281884 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.281851    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq"]
Jul 27 21:56:31.284223 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:56:31.284136    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod777715f6_7f65_45ed_b262_85464cdd02f5.slice/crio-2e2d38d92cdf4b94c064fbf4970c79531f14ca2165c8f3c42172c5e103da4466 WatchSource:0}: Error finding container 2e2d38d92cdf4b94c064fbf4970c79531f14ca2165c8f3c42172c5e103da4466: Status 404 returned error can't find the container with id 2e2d38d92cdf4b94c064fbf4970c79531f14ca2165c8f3c42172c5e103da4466
Jul 27 21:56:31.309966 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.309940    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq" event={"ID":"777715f6-7f65-45ed-b262-85464cdd02f5","Type":"ContainerStarted","Data":"2e2d38d92cdf4b94c064fbf4970c79531f14ca2165c8f3c42172c5e103da4466"}
Jul 27 21:56:31.311099 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.311076    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp" event={"ID":"db759bf4-2c95-43e8-b419-25167337b05c","Type":"ContainerStarted","Data":"8572b075d3e3de7590c072be8848a1b3c8981f690b95be837722ed5129fab5b6"}
Jul 27 21:56:31.312159 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.312131    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w62f7" event={"ID":"c39868ff-0054-4900-867f-7338e6bd13af","Type":"ContainerStarted","Data":"94d0a6756f73154add4980a64997572eef40f0fb63ef3198325cf29c8c4934b5"}
Jul 27 21:56:31.340328 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.340305    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cf87a32b-31ca-46b9-a3ab-1680f03412c6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.340431 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.340368    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.340489 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.340466    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.340535 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.340522    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cf87a32b-31ca-46b9-a3ab-1680f03412c6-config-out\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.340576 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.340556    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf87a32b-31ca-46b9-a3ab-1680f03412c6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.340695 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.340588    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf87a32b-31ca-46b9-a3ab-1680f03412c6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.340695 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.340633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-web-config\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.340695 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.340680    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-config-volume\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.340843 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.340726    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.340843 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.340783    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.340843 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.340813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.340993 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.340842    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmk4f\" (UniqueName: \"kubernetes.io/projected/cf87a32b-31ca-46b9-a3ab-1680f03412c6-kube-api-access-lmk4f\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.340993 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.340867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cf87a32b-31ca-46b9-a3ab-1680f03412c6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.441408 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.441376    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.441561 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.441417    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.441561 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.441443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmk4f\" (UniqueName: \"kubernetes.io/projected/cf87a32b-31ca-46b9-a3ab-1680f03412c6-kube-api-access-lmk4f\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.441561 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.441467    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cf87a32b-31ca-46b9-a3ab-1680f03412c6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.441561 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.441501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cf87a32b-31ca-46b9-a3ab-1680f03412c6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.441561 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.441524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.441802 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.441581    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.441802 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.441626    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cf87a32b-31ca-46b9-a3ab-1680f03412c6-config-out\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.441802 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.441658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf87a32b-31ca-46b9-a3ab-1680f03412c6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.441802 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.441686    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf87a32b-31ca-46b9-a3ab-1680f03412c6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.441802 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.441712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-web-config\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.441802 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.441746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-config-volume\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.441802 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.441792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.442133 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.441952    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cf87a32b-31ca-46b9-a3ab-1680f03412c6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.443553 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.442603    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf87a32b-31ca-46b9-a3ab-1680f03412c6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.443553 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.443205    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf87a32b-31ca-46b9-a3ab-1680f03412c6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.444288 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.444147    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cf87a32b-31ca-46b9-a3ab-1680f03412c6-config-out\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.444516 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.444470    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.445112 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.444876    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-config-volume\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.445197 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.445183    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.445250 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.445197    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-web-config\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.445410 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.445387    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.445766 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.445746    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cf87a32b-31ca-46b9-a3ab-1680f03412c6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.446201 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.446183    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.446294 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.446278    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.452895 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.452876    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmk4f\" (UniqueName: \"kubernetes.io/projected/cf87a32b-31ca-46b9-a3ab-1680f03412c6-kube-api-access-lmk4f\") pod \"alertmanager-main-0\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.562471 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.562429    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:56:31.714663 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:31.714531    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:56:31.719732 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:56:31.719696    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf87a32b_31ca_46b9_a3ab_1680f03412c6.slice/crio-35b0c944aa7452d6ec09ed637bdfe250302f3638311d0ed1f61352d0ce4c941c WatchSource:0}: Error finding container 35b0c944aa7452d6ec09ed637bdfe250302f3638311d0ed1f61352d0ce4c941c: Status 404 returned error can't find the container with id 35b0c944aa7452d6ec09ed637bdfe250302f3638311d0ed1f61352d0ce4c941c
Jul 27 21:56:32.317975 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:32.317877    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf87a32b-31ca-46b9-a3ab-1680f03412c6","Type":"ContainerStarted","Data":"35b0c944aa7452d6ec09ed637bdfe250302f3638311d0ed1f61352d0ce4c941c"}
Jul 27 21:56:32.320538 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:32.320510    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp" event={"ID":"db759bf4-2c95-43e8-b419-25167337b05c","Type":"ContainerStarted","Data":"5317a02a650b0d47d6efa8786c392d92470d3cbee13aa9ed6e84ed033e545b19"}
Jul 27 21:56:32.320684 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:32.320566    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp" event={"ID":"db759bf4-2c95-43e8-b419-25167337b05c","Type":"ContainerStarted","Data":"5ff90d3e0a68c74bef0df3c2edbfdfc3adf9592d66e9fde25c49f9dbe3b4f783"}
Jul 27 21:56:33.165975 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.165938    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5d56677975-kmk9m"]
Jul 27 21:56:33.170021 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.170000    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.174214 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.174187    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 27 21:56:33.174601 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.174456    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4rrg7\""
Jul 27 21:56:33.174601 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.174558    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a45u966rtpcmp\""
Jul 27 21:56:33.174913 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.174891    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 27 21:56:33.174997 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.174951    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 27 21:56:33.175460 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.175300    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 27 21:56:33.175460 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.175423    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 27 21:56:33.189485 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.189459    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d56677975-kmk9m"]
Jul 27 21:56:33.257913 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.257878    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9969c480-8555-4907-8cee-2cb98c865ddd-secret-thanos-querier-tls\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.258070 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.257936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9969c480-8555-4907-8cee-2cb98c865ddd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.258070 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.257962    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9969c480-8555-4907-8cee-2cb98c865ddd-metrics-client-ca\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.258070 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.258024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkkft\" (UniqueName: \"kubernetes.io/projected/9969c480-8555-4907-8cee-2cb98c865ddd-kube-api-access-tkkft\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.258070 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.258059    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9969c480-8555-4907-8cee-2cb98c865ddd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.258244 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.258080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9969c480-8555-4907-8cee-2cb98c865ddd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.258244 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.258148    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9969c480-8555-4907-8cee-2cb98c865ddd-secret-grpc-tls\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.258244 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.258213    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9969c480-8555-4907-8cee-2cb98c865ddd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.325424 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.325393    2565 generic.go:356] "Generic (PLEG): container finished" podID="c39868ff-0054-4900-867f-7338e6bd13af" containerID="8398ab0be2613abfcad9a3669073aec62f8002ab52a8d819e6963a36d20e69a1" exitCode=0
Jul 27 21:56:33.325891 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.325476    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w62f7" event={"ID":"c39868ff-0054-4900-867f-7338e6bd13af","Type":"ContainerDied","Data":"8398ab0be2613abfcad9a3669073aec62f8002ab52a8d819e6963a36d20e69a1"}
Jul 27 21:56:33.327594 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.327568    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq" event={"ID":"777715f6-7f65-45ed-b262-85464cdd02f5","Type":"ContainerStarted","Data":"c2d62ccd39daffa836e3251ffcf2b4f964007afe81a040f307c07e6191928aba"}
Jul 27 21:56:33.327697 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.327622    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq" event={"ID":"777715f6-7f65-45ed-b262-85464cdd02f5","Type":"ContainerStarted","Data":"66552349aba79c2b8b251bc512f438f6dcd813036b600fae09be24056becf2b7"}
Jul 27 21:56:33.327697 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.327650    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq" event={"ID":"777715f6-7f65-45ed-b262-85464cdd02f5","Type":"ContainerStarted","Data":"330a5af9be761d07640396155c04b4b739d17524ae56af7d0a9c249149d976b8"}
Jul 27 21:56:33.359606 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.359582    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9969c480-8555-4907-8cee-2cb98c865ddd-metrics-client-ca\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.359703 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.359633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkkft\" (UniqueName: \"kubernetes.io/projected/9969c480-8555-4907-8cee-2cb98c865ddd-kube-api-access-tkkft\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.359703 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.359664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9969c480-8555-4907-8cee-2cb98c865ddd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.359703 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.359691    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9969c480-8555-4907-8cee-2cb98c865ddd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.359853 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.359721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9969c480-8555-4907-8cee-2cb98c865ddd-secret-grpc-tls\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.359853 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.359800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9969c480-8555-4907-8cee-2cb98c865ddd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.359943 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.359921    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9969c480-8555-4907-8cee-2cb98c865ddd-secret-thanos-querier-tls\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.360408 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.360269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9969c480-8555-4907-8cee-2cb98c865ddd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.361706 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.361182    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9969c480-8555-4907-8cee-2cb98c865ddd-metrics-client-ca\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.364169 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.364121    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9969c480-8555-4907-8cee-2cb98c865ddd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.364315 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.364252    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5m5gq" podStartSLOduration=2.249022742 podStartE2EDuration="3.364237253s" totalImagesPullingTime="1.115214511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:56:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:56:33.363846453 +0000 UTC m=+138.104981225" watchObservedRunningTime="2026-07-27 21:56:33.364237253 +0000 UTC m=+138.105372032"
Jul 27 21:56:33.364944 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.364848    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9969c480-8555-4907-8cee-2cb98c865ddd-secret-grpc-tls\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.365639 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.365607    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9969c480-8555-4907-8cee-2cb98c865ddd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.366146 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.366127    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9969c480-8555-4907-8cee-2cb98c865ddd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.366795 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.366774    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9969c480-8555-4907-8cee-2cb98c865ddd-secret-thanos-querier-tls\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.367252 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.367210    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9969c480-8555-4907-8cee-2cb98c865ddd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.369992 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.369974    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkkft\" (UniqueName: \"kubernetes.io/projected/9969c480-8555-4907-8cee-2cb98c865ddd-kube-api-access-tkkft\") pod \"thanos-querier-5d56677975-kmk9m\" (UID: \"9969c480-8555-4907-8cee-2cb98c865ddd\") " pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.481175 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.481145    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:33.613758 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:33.613724    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d56677975-kmk9m"]
Jul 27 21:56:33.616934 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:56:33.616906    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9969c480_8555_4907_8cee_2cb98c865ddd.slice/crio-c3f3c64d992425b94f863af2183b2d6d1e1dc2ce85fccc0c24d731a4ec8c68ad WatchSource:0}: Error finding container c3f3c64d992425b94f863af2183b2d6d1e1dc2ce85fccc0c24d731a4ec8c68ad: Status 404 returned error can't find the container with id c3f3c64d992425b94f863af2183b2d6d1e1dc2ce85fccc0c24d731a4ec8c68ad
Jul 27 21:56:34.334344 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.334292    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp" event={"ID":"db759bf4-2c95-43e8-b419-25167337b05c","Type":"ContainerStarted","Data":"5bf41c7f66d833a15ed362594ee47502424eeb8c6a8671fbfce002f06bc8f41c"}
Jul 27 21:56:34.335873 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.335842    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m" event={"ID":"9969c480-8555-4907-8cee-2cb98c865ddd","Type":"ContainerStarted","Data":"c3f3c64d992425b94f863af2183b2d6d1e1dc2ce85fccc0c24d731a4ec8c68ad"}
Jul 27 21:56:34.338587 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.338505    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w62f7" event={"ID":"c39868ff-0054-4900-867f-7338e6bd13af","Type":"ContainerStarted","Data":"01bc775ea542f169789fad6eaea884fec006b1eb5070f803ee8fd1f50f0cf9da"}
Jul 27 21:56:34.338587 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.338555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w62f7" event={"ID":"c39868ff-0054-4900-867f-7338e6bd13af","Type":"ContainerStarted","Data":"1c4133650b04ee80e7e428ca78b040e3268238304f40331e5aba14c2d5caaf3c"}
Jul 27 21:56:34.340419 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.340392    2565 generic.go:356] "Generic (PLEG): container finished" podID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerID="215479b54dbf964795e6f000bc857365261b79442a039334d8804eae0ea8a4fc" exitCode=0
Jul 27 21:56:34.340518 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.340474    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf87a32b-31ca-46b9-a3ab-1680f03412c6","Type":"ContainerDied","Data":"215479b54dbf964795e6f000bc857365261b79442a039334d8804eae0ea8a4fc"}
Jul 27 21:56:34.353751 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.353702    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gksqp" podStartSLOduration=2.408360788 podStartE2EDuration="4.353687408s" totalImagesPullingTime="1.94532662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:56:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:56:34.351315159 +0000 UTC m=+139.092449941" watchObservedRunningTime="2026-07-27 21:56:34.353687408 +0000 UTC m=+139.094822177"
Jul 27 21:56:34.397811 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.397751    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-w62f7" podStartSLOduration=3.428299574 podStartE2EDuration="4.397729142s" totalImagesPullingTime="901.138101ms" totalInitContainerRuntime="68.291467ms" isStatefulPod=true podCreationTimestamp="2026-07-27 21:56:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:56:34.396578748 +0000 UTC m=+139.137713573" watchObservedRunningTime="2026-07-27 21:56:34.397729142 +0000 UTC m=+139.138863910"
Jul 27 21:56:34.479867 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.479831    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-685b65cf7f-dwtrs"]
Jul 27 21:56:34.483401 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.483377    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.486429 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.486260    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 27 21:56:34.486429 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.486304    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 27 21:56:34.486429 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.486407    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 27 21:56:34.486653 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.486431    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2losqf28comiq\""
Jul 27 21:56:34.486653 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.486542    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 27 21:56:34.486653 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.486641    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-s67z6\""
Jul 27 21:56:34.493440 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.493417    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-685b65cf7f-dwtrs"]
Jul 27 21:56:34.570741 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.570704    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-secret-metrics-server-client-certs\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.570741 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.570742    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-client-ca-bundle\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.570971 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.570778    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.570971 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.570822    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-audit-log\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.570971 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.570894    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-secret-metrics-server-tls\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.570971 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.570911    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-metrics-server-audit-profiles\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.571117 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.570981    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzrzz\" (UniqueName: \"kubernetes.io/projected/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-kube-api-access-lzrzz\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.671564 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.671478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-secret-metrics-server-client-certs\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.671564 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.671526    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-client-ca-bundle\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.671781 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.671575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.671781 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.671602    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-audit-log\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.671781 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.671634    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-secret-metrics-server-tls\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.671781 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.671658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-metrics-server-audit-profiles\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.671781 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.671711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzrzz\" (UniqueName: \"kubernetes.io/projected/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-kube-api-access-lzrzz\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.672104 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.672080    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-audit-log\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.672433 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.672409    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.673284 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.673237    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-metrics-server-audit-profiles\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.674423 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.674399    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-client-ca-bundle\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.674679 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.674651    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-secret-metrics-server-client-certs\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.674764 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.674651    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-secret-metrics-server-tls\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.680467 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.680445    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzrzz\" (UniqueName: \"kubernetes.io/projected/8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f-kube-api-access-lzrzz\") pod \"metrics-server-685b65cf7f-dwtrs\" (UID: \"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f\") " pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.795085 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.795057    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:34.954854 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:34.954778    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-685b65cf7f-dwtrs"]
Jul 27 21:56:34.956399 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:56:34.956366    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d3c6c62_f90a_4192_b8a8_f88f5f7d4c5f.slice/crio-93ce84049cf642f3cc29ca7a90da35ad079c8f8669e27a5e09d294e927458181 WatchSource:0}: Error finding container 93ce84049cf642f3cc29ca7a90da35ad079c8f8669e27a5e09d294e927458181: Status 404 returned error can't find the container with id 93ce84049cf642f3cc29ca7a90da35ad079c8f8669e27a5e09d294e927458181
Jul 27 21:56:35.347300 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:35.347231    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs" event={"ID":"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f","Type":"ContainerStarted","Data":"93ce84049cf642f3cc29ca7a90da35ad079c8f8669e27a5e09d294e927458181"}
Jul 27 21:56:36.349651 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.349625    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 21:56:36.356968 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.355056    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.357618 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.357508    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf87a32b-31ca-46b9-a3ab-1680f03412c6","Type":"ContainerStarted","Data":"0c90958cfcc816649e15372a30649f70d40f7cd07ea944abc2e8bc47aa1c5e76"}
Jul 27 21:56:36.357618 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.357577    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf87a32b-31ca-46b9-a3ab-1680f03412c6","Type":"ContainerStarted","Data":"de4e1a25e3813574c280ff8e94515ba8cd466f2cef35ebf389a22b3d2be39616"}
Jul 27 21:56:36.357771 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.357623    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf87a32b-31ca-46b9-a3ab-1680f03412c6","Type":"ContainerStarted","Data":"8c9e533b64948acfd603b361e7661b92952a5e9a446c98973be6fd276a53a722"}
Jul 27 21:56:36.362821 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.362719    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m" event={"ID":"9969c480-8555-4907-8cee-2cb98c865ddd","Type":"ContainerStarted","Data":"0a52712bc58ba30667e1b2906a16e7ccd0213334809cdb04900d4856be8e9da5"}
Jul 27 21:56:36.362821 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.362788    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m" event={"ID":"9969c480-8555-4907-8cee-2cb98c865ddd","Type":"ContainerStarted","Data":"83f0279c7301284c9e67724abe83afb00c11d1cb3a0f6c45b232e741db263637"}
Jul 27 21:56:36.363022 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.362830    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m" event={"ID":"9969c480-8555-4907-8cee-2cb98c865ddd","Type":"ContainerStarted","Data":"9457eb098650e24566f89d2df309651958eeb2a9af8787a3443e1dccc23ba805"}
Jul 27 21:56:36.367358 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.363969    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e36kmsd9b2hll\""
Jul 27 21:56:36.367358 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.364688    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 27 21:56:36.367358 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.364936    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 27 21:56:36.367358 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.365121    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 27 21:56:36.367358 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.365305    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 27 21:56:36.367358 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.365499    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 27 21:56:36.367358 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.365651    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 27 21:56:36.367358 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.365806    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 27 21:56:36.367358 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.365971    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 27 21:56:36.367358 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.366150    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 27 21:56:36.367358 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.366327    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 27 21:56:36.367358 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.366524    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 27 21:56:36.367358 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.366704    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 27 21:56:36.369961 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.369564    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4wvtz\""
Jul 27 21:56:36.370878 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.370861    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 27 21:56:36.375016 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.374850    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 27 21:56:36.376006 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.375985    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 21:56:36.387751 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.387729    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-config\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.387842 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.387759    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.387842 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.387793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.387842 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.387808    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv6ch\" (UniqueName: \"kubernetes.io/projected/cfef9838-c38e-4d8b-923f-eb68862a6d63-kube-api-access-jv6ch\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.387842 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.387823    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.387842 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.387837    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.388076 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.387867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfef9838-c38e-4d8b-923f-eb68862a6d63-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.388076 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.387899    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.388224 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.388206    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.388363 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.388323    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.388495 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.388480    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.388549 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.388523    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.388601 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.388550    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.388671 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.388641    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.388726 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.388682    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-web-config\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.388790 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.388771    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.388840 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.388821    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfef9838-c38e-4d8b-923f-eb68862a6d63-config-out\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.388900 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.388856    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.388900 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.388883    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.388999 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.388912    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.489731 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.489698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.489731 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.489742    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfef9838-c38e-4d8b-923f-eb68862a6d63-config-out\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.489973 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.489765    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.489973 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.489794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.489973 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.489820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.489973 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.489856    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-config\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.489973 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.489877    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.489973 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.489924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.489973 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.489947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv6ch\" (UniqueName: \"kubernetes.io/projected/cfef9838-c38e-4d8b-923f-eb68862a6d63-kube-api-access-jv6ch\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.489973 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.489972    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.490399 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.489995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.490399 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.490024    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfef9838-c38e-4d8b-923f-eb68862a6d63-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.490399 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.490070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.490399 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.490094    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.490399 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.490123    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.490399 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.490166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.490399 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.490198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.490399 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.490211    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.490399 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.490221    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.490399 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.490311    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.490399 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.490364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-web-config\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.490899 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.490428    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.490899 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.490854    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.490899 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.490872    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.491109 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.491089    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.493190 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.493155    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.493434 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.493416    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfef9838-c38e-4d8b-923f-eb68862a6d63-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.493951 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.493630    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-web-config\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.493951 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.493800    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-config\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.493951 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.493842    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.493951 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.493854    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.494213 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.494187    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.494584 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.494534    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfef9838-c38e-4d8b-923f-eb68862a6d63-config-out\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.494944 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.494922    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.495689 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.495661    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.496661 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.496634    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.497142 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.497107    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.497318 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.497297    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.497978 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.497960    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.501400 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.501381    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv6ch\" (UniqueName: \"kubernetes.io/projected/cfef9838-c38e-4d8b-923f-eb68862a6d63-kube-api-access-jv6ch\") pod \"prometheus-k8s-0\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.687227 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.687132    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:36.933861 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:36.933836    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 21:56:36.936664 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:56:36.936637    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfef9838_c38e_4d8b_923f_eb68862a6d63.slice/crio-fa1af40db93f017180f72f73ade2d1cc032cd3a67f0506c8047e297f5a1e60e6 WatchSource:0}: Error finding container fa1af40db93f017180f72f73ade2d1cc032cd3a67f0506c8047e297f5a1e60e6: Status 404 returned error can't find the container with id fa1af40db93f017180f72f73ade2d1cc032cd3a67f0506c8047e297f5a1e60e6
Jul 27 21:56:37.373183 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:37.373154    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf87a32b-31ca-46b9-a3ab-1680f03412c6","Type":"ContainerStarted","Data":"1684b70c6c7d10958632eee20e5238f0bd58ebe4265b1432959d11463adf82b1"}
Jul 27 21:56:37.373544 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:37.373220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf87a32b-31ca-46b9-a3ab-1680f03412c6","Type":"ContainerStarted","Data":"9b08c84ab87c1ef09c5e5acc17fc2a2d61e6749e08037c79a3c5299620a1e3de"}
Jul 27 21:56:37.374709 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:37.374682    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs" event={"ID":"8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f","Type":"ContainerStarted","Data":"0d5c8db4e743dabfbdce415f5d0bbdbf2137865fd5b134dd57dae30687ea6bfe"}
Jul 27 21:56:37.376198 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:37.376172    2565 generic.go:356] "Generic (PLEG): container finished" podID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerID="3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5" exitCode=0
Jul 27 21:56:37.376311 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:37.376210    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef9838-c38e-4d8b-923f-eb68862a6d63","Type":"ContainerDied","Data":"3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5"}
Jul 27 21:56:37.376311 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:37.376264    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef9838-c38e-4d8b-923f-eb68862a6d63","Type":"ContainerStarted","Data":"fa1af40db93f017180f72f73ade2d1cc032cd3a67f0506c8047e297f5a1e60e6"}
Jul 27 21:56:37.395467 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:37.395393    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs" podStartSLOduration=1.511656653 podStartE2EDuration="3.395371004s" totalImagesPullingTime="1.883714351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:56:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:56:37.39210988 +0000 UTC m=+142.133244649" watchObservedRunningTime="2026-07-27 21:56:37.395371004 +0000 UTC m=+142.136505776"
Jul 27 21:56:38.384230 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:38.384189    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf87a32b-31ca-46b9-a3ab-1680f03412c6","Type":"ContainerStarted","Data":"803949bf2ab63a0ca0cddab47678ffcd29997cd152199276ff96fef63b53fc7b"}
Jul 27 21:56:38.387893 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:38.387861    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m" event={"ID":"9969c480-8555-4907-8cee-2cb98c865ddd","Type":"ContainerStarted","Data":"25a1ab481d68a3a0cad093ca4b620eccc83b2f14978614e5aa0a39ee91a824d7"}
Jul 27 21:56:38.388034 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:38.387934    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m" event={"ID":"9969c480-8555-4907-8cee-2cb98c865ddd","Type":"ContainerStarted","Data":"5b7a81e016978e0dbfa6135340103f93b11e868ee388881722a3d0ab8887b85d"}
Jul 27 21:56:38.388034 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:38.387974    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m" event={"ID":"9969c480-8555-4907-8cee-2cb98c865ddd","Type":"ContainerStarted","Data":"89dd2a5f8277c424506fda59d0299de8154dc4d5878610eaa77b30d1da3c66cd"}
Jul 27 21:56:38.388034 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:38.388016    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:38.416170 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:38.416105    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.523770956 podStartE2EDuration="7.416084697s" totalImagesPullingTime="3.872559543s" totalInitContainerRuntime="19.754198ms" isStatefulPod=false podCreationTimestamp="2026-07-27 21:56:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:56:38.411672266 +0000 UTC m=+143.152807039" watchObservedRunningTime="2026-07-27 21:56:38.416084697 +0000 UTC m=+143.157219465"
Jul 27 21:56:41.404436 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:41.404401    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef9838-c38e-4d8b-923f-eb68862a6d63","Type":"ContainerStarted","Data":"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d"}
Jul 27 21:56:41.404874 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:41.404468    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef9838-c38e-4d8b-923f-eb68862a6d63","Type":"ContainerStarted","Data":"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95"}
Jul 27 21:56:41.404874 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:41.404494    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef9838-c38e-4d8b-923f-eb68862a6d63","Type":"ContainerStarted","Data":"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7"}
Jul 27 21:56:41.404874 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:41.404517    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef9838-c38e-4d8b-923f-eb68862a6d63","Type":"ContainerStarted","Data":"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87"}
Jul 27 21:56:41.404874 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:41.404544    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef9838-c38e-4d8b-923f-eb68862a6d63","Type":"ContainerStarted","Data":"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095"}
Jul 27 21:56:41.404874 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:41.404566    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef9838-c38e-4d8b-923f-eb68862a6d63","Type":"ContainerStarted","Data":"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce"}
Jul 27 21:56:41.435941 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:41.435886    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m" podStartSLOduration=4.977618698 podStartE2EDuration="8.435869898s" totalImagesPullingTime="3.4582512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:56:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:56:38.434822926 +0000 UTC m=+143.175957699" watchObservedRunningTime="2026-07-27 21:56:41.435869898 +0000 UTC m=+146.177004672"
Jul 27 21:56:41.436476 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:41.436442    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.113372388 podStartE2EDuration="5.436430161s" totalImagesPullingTime="3.300189251s" totalInitContainerRuntime="22.868522ms" isStatefulPod=false podCreationTimestamp="2026-07-27 21:56:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:56:41.434454265 +0000 UTC m=+146.175589031" watchObservedRunningTime="2026-07-27 21:56:41.436430161 +0000 UTC m=+146.177564927"
Jul 27 21:56:41.687807 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:41.687725    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:56:44.398151 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:44.398124    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5d56677975-kmk9m"
Jul 27 21:56:45.857773 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:45.857733    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7797499974-mg255"]
Jul 27 21:56:45.858236 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:56:45.858017    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7797499974-mg255" podUID="9b322165-7ba4-407d-81aa-2e7aaf96ded0"
Jul 27 21:56:46.424535 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.424505    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:56:46.432820 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.432793    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:56:46.490101 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.490065    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b322165-7ba4-407d-81aa-2e7aaf96ded0-image-registry-private-configuration\") pod \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") "
Jul 27 21:56:46.490280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.490128    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b322165-7ba4-407d-81aa-2e7aaf96ded0-trusted-ca\") pod \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") "
Jul 27 21:56:46.490280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.490150    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jkhc\" (UniqueName: \"kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-kube-api-access-4jkhc\") pod \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") "
Jul 27 21:56:46.490280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.490171    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-certificates\") pod \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") "
Jul 27 21:56:46.490280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.490205    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-bound-sa-token\") pod \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") "
Jul 27 21:56:46.490280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.490226    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b322165-7ba4-407d-81aa-2e7aaf96ded0-ca-trust-extracted\") pod \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") "
Jul 27 21:56:46.490280 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.490271    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b322165-7ba4-407d-81aa-2e7aaf96ded0-installation-pull-secrets\") pod \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\" (UID: \"9b322165-7ba4-407d-81aa-2e7aaf96ded0\") "
Jul 27 21:56:46.490634 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.490591    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b322165-7ba4-407d-81aa-2e7aaf96ded0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9b322165-7ba4-407d-81aa-2e7aaf96ded0" (UID: "9b322165-7ba4-407d-81aa-2e7aaf96ded0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:56:46.490634 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.490599    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9b322165-7ba4-407d-81aa-2e7aaf96ded0" (UID: "9b322165-7ba4-407d-81aa-2e7aaf96ded0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:56:46.490729 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.490668    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b322165-7ba4-407d-81aa-2e7aaf96ded0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9b322165-7ba4-407d-81aa-2e7aaf96ded0" (UID: "9b322165-7ba4-407d-81aa-2e7aaf96ded0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:56:46.492494 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.492467    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-kube-api-access-4jkhc" (OuterVolumeSpecName: "kube-api-access-4jkhc") pod "9b322165-7ba4-407d-81aa-2e7aaf96ded0" (UID: "9b322165-7ba4-407d-81aa-2e7aaf96ded0"). InnerVolumeSpecName "kube-api-access-4jkhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:56:46.492619 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.492475    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b322165-7ba4-407d-81aa-2e7aaf96ded0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9b322165-7ba4-407d-81aa-2e7aaf96ded0" (UID: "9b322165-7ba4-407d-81aa-2e7aaf96ded0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:56:46.492663 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.492648    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b322165-7ba4-407d-81aa-2e7aaf96ded0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9b322165-7ba4-407d-81aa-2e7aaf96ded0" (UID: "9b322165-7ba4-407d-81aa-2e7aaf96ded0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:56:46.492707 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.492684    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9b322165-7ba4-407d-81aa-2e7aaf96ded0" (UID: "9b322165-7ba4-407d-81aa-2e7aaf96ded0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:56:46.592042 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.592000    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-bound-sa-token\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:56:46.592042 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.592033    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b322165-7ba4-407d-81aa-2e7aaf96ded0-ca-trust-extracted\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:56:46.592042 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.592043    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b322165-7ba4-407d-81aa-2e7aaf96ded0-installation-pull-secrets\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:56:46.592042 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.592052    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b322165-7ba4-407d-81aa-2e7aaf96ded0-image-registry-private-configuration\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:56:46.592308 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.592062    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b322165-7ba4-407d-81aa-2e7aaf96ded0-trusted-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:56:46.592308 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.592070    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jkhc\" (UniqueName: \"kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-kube-api-access-4jkhc\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:56:46.592308 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:46.592078    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-certificates\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:56:47.428874 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:47.428843    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7797499974-mg255"
Jul 27 21:56:47.487505 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:47.487471    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7797499974-mg255"]
Jul 27 21:56:47.492388 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:47.492361    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7797499974-mg255"]
Jul 27 21:56:47.599642 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:47.599602    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b322165-7ba4-407d-81aa-2e7aaf96ded0-registry-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:56:47.816903 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:47.816869    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b322165-7ba4-407d-81aa-2e7aaf96ded0" path="/var/lib/kubelet/pods/9b322165-7ba4-407d-81aa-2e7aaf96ded0/volumes"
Jul 27 21:56:47.964683 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:47.964653    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pxjs5_eb157c02-c15b-478b-995d-c42405aff70e/dns-node-resolver/0.log"
Jul 27 21:56:48.964229 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:48.964199    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f82sq_881ffdfa-9a29-42e3-828d-23523dd11af5/node-ca/0.log"
Jul 27 21:56:49.965004 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:49.964964    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kbx2h_fb94c2b1-988f-4a6c-8871-4462d73cfb15/serve-healthcheck-canary/0.log"
Jul 27 21:56:52.654517 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:56:52.654477    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-blwlz" podUID="f7de6e29-5e18-452b-9853-82530fc6bd38"
Jul 27 21:56:53.453960 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:53.453164    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-blwlz"
Jul 27 21:56:54.795839 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:54.795804    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:54.796238 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:54.795870    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:56:57.596000 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:57.595952    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls\") pod \"dns-default-blwlz\" (UID: \"f7de6e29-5e18-452b-9853-82530fc6bd38\") " pod="openshift-dns/dns-default-blwlz"
Jul 27 21:56:57.598139 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:57.598110    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7de6e29-5e18-452b-9853-82530fc6bd38-metrics-tls\") pod \"dns-default-blwlz\" (UID: \"f7de6e29-5e18-452b-9853-82530fc6bd38\") " pod="openshift-dns/dns-default-blwlz"
Jul 27 21:56:57.657373 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:57.657325    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jz2cl\""
Jul 27 21:56:57.664721 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:57.664691    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-blwlz"
Jul 27 21:56:58.065857 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:58.065826    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-blwlz"]
Jul 27 21:56:58.069552 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:56:58.069526    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7de6e29_5e18_452b_9853_82530fc6bd38.slice/crio-d381adc1ede7c27e5d532868e47158c5edb4efbc0e884a294a33556abbea8c01 WatchSource:0}: Error finding container d381adc1ede7c27e5d532868e47158c5edb4efbc0e884a294a33556abbea8c01: Status 404 returned error can't find the container with id d381adc1ede7c27e5d532868e47158c5edb4efbc0e884a294a33556abbea8c01
Jul 27 21:56:58.476727 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:56:58.476637    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-blwlz" event={"ID":"f7de6e29-5e18-452b-9853-82530fc6bd38","Type":"ContainerStarted","Data":"d381adc1ede7c27e5d532868e47158c5edb4efbc0e884a294a33556abbea8c01"}
Jul 27 21:57:00.490616 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:00.490569    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-blwlz" event={"ID":"f7de6e29-5e18-452b-9853-82530fc6bd38","Type":"ContainerStarted","Data":"245a6f3fe48c8074957be9558bfc2e4f77e9123bc4a097e96927aa00f0f4b988"}
Jul 27 21:57:00.491104 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:00.490649    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-blwlz" event={"ID":"f7de6e29-5e18-452b-9853-82530fc6bd38","Type":"ContainerStarted","Data":"e9960bb81e7bcc97344680b81918b8869a93de4bb50f2ddf3b66b33d5f430c9a"}
Jul 27 21:57:00.491632 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:00.491605    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-blwlz"
Jul 27 21:57:00.509857 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:00.509804    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-blwlz" podStartSLOduration=129.573820654 podStartE2EDuration="2m11.509788019s" totalImagesPullingTime="1.935967365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:57:00.507541087 +0000 UTC m=+165.248675864" watchObservedRunningTime="2026-07-27 21:57:00.509788019 +0000 UTC m=+165.250922786"
Jul 27 21:57:11.502263 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:11.502188    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-blwlz"
Jul 27 21:57:14.800374 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:14.800329    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:57:14.804068 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:14.804043    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-685b65cf7f-dwtrs"
Jul 27 21:57:36.687826 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:36.687793    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:36.708806 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:36.708777    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:37.654348 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:37.654312    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:50.510023 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:50.509983    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:57:50.510555 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:50.510356    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="alertmanager" containerID="cri-o://8c9e533b64948acfd603b361e7661b92952a5e9a446c98973be6fd276a53a722" gracePeriod=120
Jul 27 21:57:50.510555 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:50.510398    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="kube-rbac-proxy-metric" containerID="cri-o://1684b70c6c7d10958632eee20e5238f0bd58ebe4265b1432959d11463adf82b1" gracePeriod=120
Jul 27 21:57:50.510555 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:50.510427    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="kube-rbac-proxy-web" containerID="cri-o://0c90958cfcc816649e15372a30649f70d40f7cd07ea944abc2e8bc47aa1c5e76" gracePeriod=120
Jul 27 21:57:50.510555 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:50.510436    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="kube-rbac-proxy" containerID="cri-o://9b08c84ab87c1ef09c5e5acc17fc2a2d61e6749e08037c79a3c5299620a1e3de" gracePeriod=120
Jul 27 21:57:50.510555 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:50.510479    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="config-reloader" containerID="cri-o://de4e1a25e3813574c280ff8e94515ba8cd466f2cef35ebf389a22b3d2be39616" gracePeriod=120
Jul 27 21:57:50.510555 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:50.510500    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="prom-label-proxy" containerID="cri-o://803949bf2ab63a0ca0cddab47678ffcd29997cd152199276ff96fef63b53fc7b" gracePeriod=120
Jul 27 21:57:50.697010 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:50.696976    2565 generic.go:356] "Generic (PLEG): container finished" podID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerID="803949bf2ab63a0ca0cddab47678ffcd29997cd152199276ff96fef63b53fc7b" exitCode=0
Jul 27 21:57:50.697010 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:50.697004    2565 generic.go:356] "Generic (PLEG): container finished" podID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerID="1684b70c6c7d10958632eee20e5238f0bd58ebe4265b1432959d11463adf82b1" exitCode=0
Jul 27 21:57:50.697010 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:50.697012    2565 generic.go:356] "Generic (PLEG): container finished" podID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerID="9b08c84ab87c1ef09c5e5acc17fc2a2d61e6749e08037c79a3c5299620a1e3de" exitCode=0
Jul 27 21:57:50.697218 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:50.697019    2565 generic.go:356] "Generic (PLEG): container finished" podID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerID="de4e1a25e3813574c280ff8e94515ba8cd466f2cef35ebf389a22b3d2be39616" exitCode=0
Jul 27 21:57:50.697218 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:50.697027    2565 generic.go:356] "Generic (PLEG): container finished" podID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerID="8c9e533b64948acfd603b361e7661b92952a5e9a446c98973be6fd276a53a722" exitCode=0
Jul 27 21:57:50.697218 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:50.697046    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf87a32b-31ca-46b9-a3ab-1680f03412c6","Type":"ContainerDied","Data":"803949bf2ab63a0ca0cddab47678ffcd29997cd152199276ff96fef63b53fc7b"}
Jul 27 21:57:50.697218 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:50.697109    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf87a32b-31ca-46b9-a3ab-1680f03412c6","Type":"ContainerDied","Data":"1684b70c6c7d10958632eee20e5238f0bd58ebe4265b1432959d11463adf82b1"}
Jul 27 21:57:50.697218 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:50.697135    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf87a32b-31ca-46b9-a3ab-1680f03412c6","Type":"ContainerDied","Data":"9b08c84ab87c1ef09c5e5acc17fc2a2d61e6749e08037c79a3c5299620a1e3de"}
Jul 27 21:57:50.697218 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:50.697159    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf87a32b-31ca-46b9-a3ab-1680f03412c6","Type":"ContainerDied","Data":"de4e1a25e3813574c280ff8e94515ba8cd466f2cef35ebf389a22b3d2be39616"}
Jul 27 21:57:50.697218 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:50.697184    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf87a32b-31ca-46b9-a3ab-1680f03412c6","Type":"ContainerDied","Data":"8c9e533b64948acfd603b361e7661b92952a5e9a446c98973be6fd276a53a722"}
Jul 27 21:57:51.705561 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.705533    2565 generic.go:356] "Generic (PLEG): container finished" podID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerID="0c90958cfcc816649e15372a30649f70d40f7cd07ea944abc2e8bc47aa1c5e76" exitCode=0
Jul 27 21:57:51.705884 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.705605    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf87a32b-31ca-46b9-a3ab-1680f03412c6","Type":"ContainerDied","Data":"0c90958cfcc816649e15372a30649f70d40f7cd07ea944abc2e8bc47aa1c5e76"}
Jul 27 21:57:51.746049 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.746030    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:51.871305 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.871231    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-config-volume\") pod \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") "
Jul 27 21:57:51.871305 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.871262    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-kube-rbac-proxy-web\") pod \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") "
Jul 27 21:57:51.871305 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.871302    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-web-config\") pod \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") "
Jul 27 21:57:51.871561 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.871416    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cf87a32b-31ca-46b9-a3ab-1680f03412c6-alertmanager-main-db\") pod \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") "
Jul 27 21:57:51.871561 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.871471    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf87a32b-31ca-46b9-a3ab-1680f03412c6-metrics-client-ca\") pod \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") "
Jul 27 21:57:51.871561 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.871508    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-cluster-tls-config\") pod \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") "
Jul 27 21:57:51.871561 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.871551    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cf87a32b-31ca-46b9-a3ab-1680f03412c6-tls-assets\") pod \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") "
Jul 27 21:57:51.871746 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.871574    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmk4f\" (UniqueName: \"kubernetes.io/projected/cf87a32b-31ca-46b9-a3ab-1680f03412c6-kube-api-access-lmk4f\") pod \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") "
Jul 27 21:57:51.871746 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.871626    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-main-tls\") pod \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") "
Jul 27 21:57:51.871746 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.871672    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") "
Jul 27 21:57:51.871746 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.871708    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf87a32b-31ca-46b9-a3ab-1680f03412c6-alertmanager-trusted-ca-bundle\") pod \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") "
Jul 27 21:57:51.871746 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.871707    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf87a32b-31ca-46b9-a3ab-1680f03412c6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "cf87a32b-31ca-46b9-a3ab-1680f03412c6" (UID: "cf87a32b-31ca-46b9-a3ab-1680f03412c6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:57:51.871746 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.871732    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-kube-rbac-proxy\") pod \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") "
Jul 27 21:57:51.872035 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.871766    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cf87a32b-31ca-46b9-a3ab-1680f03412c6-config-out\") pod \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\" (UID: \"cf87a32b-31ca-46b9-a3ab-1680f03412c6\") "
Jul 27 21:57:51.872155 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.872032    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cf87a32b-31ca-46b9-a3ab-1680f03412c6-alertmanager-main-db\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:51.872155 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.872063    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf87a32b-31ca-46b9-a3ab-1680f03412c6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "cf87a32b-31ca-46b9-a3ab-1680f03412c6" (UID: "cf87a32b-31ca-46b9-a3ab-1680f03412c6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:57:51.872592 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.872561    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf87a32b-31ca-46b9-a3ab-1680f03412c6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "cf87a32b-31ca-46b9-a3ab-1680f03412c6" (UID: "cf87a32b-31ca-46b9-a3ab-1680f03412c6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:57:51.874555 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.874518    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-config-volume" (OuterVolumeSpecName: "config-volume") pod "cf87a32b-31ca-46b9-a3ab-1680f03412c6" (UID: "cf87a32b-31ca-46b9-a3ab-1680f03412c6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:57:51.874911 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.874879    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf87a32b-31ca-46b9-a3ab-1680f03412c6-config-out" (OuterVolumeSpecName: "config-out") pod "cf87a32b-31ca-46b9-a3ab-1680f03412c6" (UID: "cf87a32b-31ca-46b9-a3ab-1680f03412c6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:57:51.874911 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.874888    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "cf87a32b-31ca-46b9-a3ab-1680f03412c6" (UID: "cf87a32b-31ca-46b9-a3ab-1680f03412c6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:57:51.875208 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.875185    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf87a32b-31ca-46b9-a3ab-1680f03412c6-kube-api-access-lmk4f" (OuterVolumeSpecName: "kube-api-access-lmk4f") pod "cf87a32b-31ca-46b9-a3ab-1680f03412c6" (UID: "cf87a32b-31ca-46b9-a3ab-1680f03412c6"). InnerVolumeSpecName "kube-api-access-lmk4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:57:51.875301 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.875226    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "cf87a32b-31ca-46b9-a3ab-1680f03412c6" (UID: "cf87a32b-31ca-46b9-a3ab-1680f03412c6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:57:51.875377 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.875317    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf87a32b-31ca-46b9-a3ab-1680f03412c6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "cf87a32b-31ca-46b9-a3ab-1680f03412c6" (UID: "cf87a32b-31ca-46b9-a3ab-1680f03412c6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:57:51.875952 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.875928    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "cf87a32b-31ca-46b9-a3ab-1680f03412c6" (UID: "cf87a32b-31ca-46b9-a3ab-1680f03412c6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:57:51.876108 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.876086    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "cf87a32b-31ca-46b9-a3ab-1680f03412c6" (UID: "cf87a32b-31ca-46b9-a3ab-1680f03412c6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:57:51.878429 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.878405    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "cf87a32b-31ca-46b9-a3ab-1680f03412c6" (UID: "cf87a32b-31ca-46b9-a3ab-1680f03412c6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:57:51.884729 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.884711    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-web-config" (OuterVolumeSpecName: "web-config") pod "cf87a32b-31ca-46b9-a3ab-1680f03412c6" (UID: "cf87a32b-31ca-46b9-a3ab-1680f03412c6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:57:51.973206 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.973173    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-main-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:51.973206 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.973199    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:51.973206 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.973209    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf87a32b-31ca-46b9-a3ab-1680f03412c6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:51.973453 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.973219    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:51.973453 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.973228    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cf87a32b-31ca-46b9-a3ab-1680f03412c6-config-out\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:51.973453 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.973236    2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-config-volume\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:51.973453 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.973243    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:51.973453 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.973252    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-web-config\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:51.973453 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.973260    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf87a32b-31ca-46b9-a3ab-1680f03412c6-metrics-client-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:51.973453 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.973268    2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cf87a32b-31ca-46b9-a3ab-1680f03412c6-cluster-tls-config\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:51.973453 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.973277    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cf87a32b-31ca-46b9-a3ab-1680f03412c6-tls-assets\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:51.973453 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:51.973284    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmk4f\" (UniqueName: \"kubernetes.io/projected/cf87a32b-31ca-46b9-a3ab-1680f03412c6-kube-api-access-lmk4f\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:52.712260 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.712222    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf87a32b-31ca-46b9-a3ab-1680f03412c6","Type":"ContainerDied","Data":"35b0c944aa7452d6ec09ed637bdfe250302f3638311d0ed1f61352d0ce4c941c"}
Jul 27 21:57:52.712260 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.712251    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.712718 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.712322    2565 scope.go:117] "RemoveContainer" containerID="803949bf2ab63a0ca0cddab47678ffcd29997cd152199276ff96fef63b53fc7b"
Jul 27 21:57:52.721247 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.721226    2565 scope.go:117] "RemoveContainer" containerID="1684b70c6c7d10958632eee20e5238f0bd58ebe4265b1432959d11463adf82b1"
Jul 27 21:57:52.728039 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.728021    2565 scope.go:117] "RemoveContainer" containerID="9b08c84ab87c1ef09c5e5acc17fc2a2d61e6749e08037c79a3c5299620a1e3de"
Jul 27 21:57:52.735091 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.735071    2565 scope.go:117] "RemoveContainer" containerID="0c90958cfcc816649e15372a30649f70d40f7cd07ea944abc2e8bc47aa1c5e76"
Jul 27 21:57:52.735509 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.735480    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:57:52.740500 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.740478    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:57:52.742580 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.742562    2565 scope.go:117] "RemoveContainer" containerID="de4e1a25e3813574c280ff8e94515ba8cd466f2cef35ebf389a22b3d2be39616"
Jul 27 21:57:52.749371 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.749353    2565 scope.go:117] "RemoveContainer" containerID="8c9e533b64948acfd603b361e7661b92952a5e9a446c98973be6fd276a53a722"
Jul 27 21:57:52.761102 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.761077    2565 scope.go:117] "RemoveContainer" containerID="215479b54dbf964795e6f000bc857365261b79442a039334d8804eae0ea8a4fc"
Jul 27 21:57:52.766397 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766375    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:57:52.766722 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766706    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="alertmanager"
Jul 27 21:57:52.766793 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766724    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="alertmanager"
Jul 27 21:57:52.766793 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766741    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="kube-rbac-proxy-web"
Jul 27 21:57:52.766793 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766750    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="kube-rbac-proxy-web"
Jul 27 21:57:52.766793 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766761    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="kube-rbac-proxy"
Jul 27 21:57:52.766793 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766770    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="kube-rbac-proxy"
Jul 27 21:57:52.766793 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766786    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="prom-label-proxy"
Jul 27 21:57:52.766793 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766794    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="prom-label-proxy"
Jul 27 21:57:52.767133 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766807    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="init-config-reloader"
Jul 27 21:57:52.767133 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766815    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="init-config-reloader"
Jul 27 21:57:52.767133 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766834    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="kube-rbac-proxy-metric"
Jul 27 21:57:52.767133 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766843    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="kube-rbac-proxy-metric"
Jul 27 21:57:52.767133 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766854    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="config-reloader"
Jul 27 21:57:52.767133 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766861    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="config-reloader"
Jul 27 21:57:52.767133 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766932    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="kube-rbac-proxy-metric"
Jul 27 21:57:52.767133 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766945    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="kube-rbac-proxy-web"
Jul 27 21:57:52.767133 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766954    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="alertmanager"
Jul 27 21:57:52.767133 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766965    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="prom-label-proxy"
Jul 27 21:57:52.767133 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766977    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="config-reloader"
Jul 27 21:57:52.767133 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.766986    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" containerName="kube-rbac-proxy"
Jul 27 21:57:52.772071 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.772052    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.774899 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.774877    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-r6j9x\""
Jul 27 21:57:52.775011 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.774908    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 27 21:57:52.775011 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.774877    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 27 21:57:52.775011 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.775005    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 27 21:57:52.775227 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.775078    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 27 21:57:52.775227 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.775171    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 27 21:57:52.775227 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.775180    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 27 21:57:52.775407 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.775180    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 27 21:57:52.775407 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.775388    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 27 21:57:52.780766 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.780749    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 27 21:57:52.786885 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.786864    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:57:52.878559 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.878487    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.878559 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.878518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7f585aac-f45d-4a5d-a290-44ca24274c56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.878559 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.878535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f585aac-f45d-4a5d-a290-44ca24274c56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.878772 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.878568    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.878772 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.878604    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-web-config\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.878772 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.878629    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7f585aac-f45d-4a5d-a290-44ca24274c56-config-out\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.878772 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.878647    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-config-volume\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.878772 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.878661    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7f585aac-f45d-4a5d-a290-44ca24274c56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.878772 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.878678    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.878772 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.878695    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f585aac-f45d-4a5d-a290-44ca24274c56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.878772 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.878757    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.879054 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.878800    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.879054 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.878840    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvzd4\" (UniqueName: \"kubernetes.io/projected/7f585aac-f45d-4a5d-a290-44ca24274c56-kube-api-access-lvzd4\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.979739 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.979703    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7f585aac-f45d-4a5d-a290-44ca24274c56-config-out\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.979888 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.979809    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-config-volume\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.979888 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.979838    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7f585aac-f45d-4a5d-a290-44ca24274c56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.980003 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.979888    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.980003 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.979920    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f585aac-f45d-4a5d-a290-44ca24274c56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.980003 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.979952    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.980003 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.979999    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.980190 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.980025    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvzd4\" (UniqueName: \"kubernetes.io/projected/7f585aac-f45d-4a5d-a290-44ca24274c56-kube-api-access-lvzd4\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.980190 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.980082    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.980190 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.980134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7f585aac-f45d-4a5d-a290-44ca24274c56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.980190 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.980167    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f585aac-f45d-4a5d-a290-44ca24274c56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.980417 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.980227    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.980417 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.980303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-web-config\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.981113 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.981087    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7f585aac-f45d-4a5d-a290-44ca24274c56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.981430 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.981405    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f585aac-f45d-4a5d-a290-44ca24274c56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.983281 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.983252    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.983410 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.983303    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.984230 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.983853    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f585aac-f45d-4a5d-a290-44ca24274c56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.984230 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.984132    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7f585aac-f45d-4a5d-a290-44ca24274c56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.984230 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.984188    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.985592 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.985146    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7f585aac-f45d-4a5d-a290-44ca24274c56-config-out\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.985592 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.985553    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-config-volume\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.985592 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.985554    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-web-config\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.986219 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.986197    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.986794 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.986754    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7f585aac-f45d-4a5d-a290-44ca24274c56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:52.988842 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:52.988821    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvzd4\" (UniqueName: \"kubernetes.io/projected/7f585aac-f45d-4a5d-a290-44ca24274c56-kube-api-access-lvzd4\") pod \"alertmanager-main-0\" (UID: \"7f585aac-f45d-4a5d-a290-44ca24274c56\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:53.081163 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:53.081121    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:57:53.212989 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:53.212961    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:57:53.214764 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:57:53.214737    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f585aac_f45d_4a5d_a290_44ca24274c56.slice/crio-f29fd7db33cbbcf8e94c1bf5e6ee51f4e318b0a988d5153cbe21743ea1a9d478 WatchSource:0}: Error finding container f29fd7db33cbbcf8e94c1bf5e6ee51f4e318b0a988d5153cbe21743ea1a9d478: Status 404 returned error can't find the container with id f29fd7db33cbbcf8e94c1bf5e6ee51f4e318b0a988d5153cbe21743ea1a9d478
Jul 27 21:57:53.718261 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:53.718226    2565 generic.go:356] "Generic (PLEG): container finished" podID="7f585aac-f45d-4a5d-a290-44ca24274c56" containerID="8c4cf2e5219e20327064845579200bc36f1a26e3e34b5b9e5e27992464a9f18c" exitCode=0
Jul 27 21:57:53.718665 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:53.718314    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f585aac-f45d-4a5d-a290-44ca24274c56","Type":"ContainerDied","Data":"8c4cf2e5219e20327064845579200bc36f1a26e3e34b5b9e5e27992464a9f18c"}
Jul 27 21:57:53.718665 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:53.718483    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f585aac-f45d-4a5d-a290-44ca24274c56","Type":"ContainerStarted","Data":"f29fd7db33cbbcf8e94c1bf5e6ee51f4e318b0a988d5153cbe21743ea1a9d478"}
Jul 27 21:57:53.816320 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:53.816294    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf87a32b-31ca-46b9-a3ab-1680f03412c6" path="/var/lib/kubelet/pods/cf87a32b-31ca-46b9-a3ab-1680f03412c6/volumes"
Jul 27 21:57:54.725096 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:54.725064    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f585aac-f45d-4a5d-a290-44ca24274c56","Type":"ContainerStarted","Data":"ba9751c92ba2d339c2022a002f61986e69abc467140ac2f008432153dd559bbd"}
Jul 27 21:57:54.725474 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:54.725123    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f585aac-f45d-4a5d-a290-44ca24274c56","Type":"ContainerStarted","Data":"45702312fccbe5722e78dbf90f15fb61edf941d362afda1c2186ea2e1a1e2aa7"}
Jul 27 21:57:54.725474 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:54.725150    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f585aac-f45d-4a5d-a290-44ca24274c56","Type":"ContainerStarted","Data":"23b61a0ee3d2d7bde8d3312889138b1a368285b42d8782b76c7c083e9446e0ea"}
Jul 27 21:57:54.725474 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:54.725173    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f585aac-f45d-4a5d-a290-44ca24274c56","Type":"ContainerStarted","Data":"626e9be1088893906c8e16567c81a7c9909947eacd3cd0ef30c88806ee5ecb3c"}
Jul 27 21:57:54.725474 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:54.725196    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f585aac-f45d-4a5d-a290-44ca24274c56","Type":"ContainerStarted","Data":"e291f50e74ee0121b5f0d91cff71ea0f5482396e89a62229d132493681bc1d04"}
Jul 27 21:57:54.725474 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:54.725218    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f585aac-f45d-4a5d-a290-44ca24274c56","Type":"ContainerStarted","Data":"c726adb703382900734a5bf5b8c66284a9a41320ef83c7dbe68e7942b45c6d9a"}
Jul 27 21:57:54.753407 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:54.753355    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.738779272 podStartE2EDuration="2.753326123s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.546851ms" isStatefulPod=false podCreationTimestamp="2026-07-27 21:57:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:57:54.751676901 +0000 UTC m=+219.492811668" watchObservedRunningTime="2026-07-27 21:57:54.753326123 +0000 UTC m=+219.494460927"
Jul 27 21:57:54.830578 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:54.830536    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 21:57:54.831983 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:54.831112    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d" gracePeriod=600
Jul 27 21:57:54.831983 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:54.831627    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="kube-rbac-proxy-web" containerID="cri-o://3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7" gracePeriod=600
Jul 27 21:57:54.831983 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:54.831753    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="kube-rbac-proxy" containerID="cri-o://35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95" gracePeriod=600
Jul 27 21:57:54.831983 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:54.831833    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="thanos-sidecar" containerID="cri-o://12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87" gracePeriod=600
Jul 27 21:57:54.831983 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:54.831911    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="config-reloader" containerID="cri-o://58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095" gracePeriod=600
Jul 27 21:57:54.832329 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:54.832311    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="prometheus" containerID="cri-o://d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce" gracePeriod=600
Jul 27 21:57:55.077084 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.077058    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.203574 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.203546    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-configmap-metrics-client-ca\") pod \"cfef9838-c38e-4d8b-923f-eb68862a6d63\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") "
Jul 27 21:57:55.203574 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.203579    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-config\") pod \"cfef9838-c38e-4d8b-923f-eb68862a6d63\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") "
Jul 27 21:57:55.203752 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.203597    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-configmap-serving-certs-ca-bundle\") pod \"cfef9838-c38e-4d8b-923f-eb68862a6d63\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") "
Jul 27 21:57:55.203752 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.203623    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"cfef9838-c38e-4d8b-923f-eb68862a6d63\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") "
Jul 27 21:57:55.203752 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.203647    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-kube-rbac-proxy\") pod \"cfef9838-c38e-4d8b-923f-eb68862a6d63\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") "
Jul 27 21:57:55.203916 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.203786    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-configmap-kubelet-serving-ca-bundle\") pod \"cfef9838-c38e-4d8b-923f-eb68862a6d63\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") "
Jul 27 21:57:55.203916 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.203826    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-rulefiles-2\") pod \"cfef9838-c38e-4d8b-923f-eb68862a6d63\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") "
Jul 27 21:57:55.203916 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.203853    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfef9838-c38e-4d8b-923f-eb68862a6d63-config-out\") pod \"cfef9838-c38e-4d8b-923f-eb68862a6d63\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") "
Jul 27 21:57:55.204056 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.203919    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-thanos-prometheus-http-client-file\") pod \"cfef9838-c38e-4d8b-923f-eb68862a6d63\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") "
Jul 27 21:57:55.204056 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.203956    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jv6ch\" (UniqueName: \"kubernetes.io/projected/cfef9838-c38e-4d8b-923f-eb68862a6d63-kube-api-access-jv6ch\") pod \"cfef9838-c38e-4d8b-923f-eb68862a6d63\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") "
Jul 27 21:57:55.204056 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.203987    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-rulefiles-0\") pod \"cfef9838-c38e-4d8b-923f-eb68862a6d63\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") "
Jul 27 21:57:55.204056 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.204020    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-grpc-tls\") pod \"cfef9838-c38e-4d8b-923f-eb68862a6d63\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") "
Jul 27 21:57:55.204246 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.204058    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-metrics-client-certs\") pod \"cfef9838-c38e-4d8b-923f-eb68862a6d63\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") "
Jul 27 21:57:55.204246 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.204080    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-rulefiles-1\") pod \"cfef9838-c38e-4d8b-923f-eb68862a6d63\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") "
Jul 27 21:57:55.204246 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.204101    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "cfef9838-c38e-4d8b-923f-eb68862a6d63" (UID: "cfef9838-c38e-4d8b-923f-eb68862a6d63"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:57:55.204246 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.204132    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfef9838-c38e-4d8b-923f-eb68862a6d63-tls-assets\") pod \"cfef9838-c38e-4d8b-923f-eb68862a6d63\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") "
Jul 27 21:57:55.204246 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.204145    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "cfef9838-c38e-4d8b-923f-eb68862a6d63" (UID: "cfef9838-c38e-4d8b-923f-eb68862a6d63"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:57:55.204246 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.204155    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "cfef9838-c38e-4d8b-923f-eb68862a6d63" (UID: "cfef9838-c38e-4d8b-923f-eb68862a6d63"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:57:55.204246 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.204161    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"cfef9838-c38e-4d8b-923f-eb68862a6d63\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") "
Jul 27 21:57:55.204246 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.204182    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "cfef9838-c38e-4d8b-923f-eb68862a6d63" (UID: "cfef9838-c38e-4d8b-923f-eb68862a6d63"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:57:55.204246 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.204205    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-web-config\") pod \"cfef9838-c38e-4d8b-923f-eb68862a6d63\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") "
Jul 27 21:57:55.204246 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.204239    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-trusted-ca-bundle\") pod \"cfef9838-c38e-4d8b-923f-eb68862a6d63\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") "
Jul 27 21:57:55.204754 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.204463    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-prometheus-k8s-tls\") pod \"cfef9838-c38e-4d8b-923f-eb68862a6d63\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") "
Jul 27 21:57:55.204754 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.204511    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-db\") pod \"cfef9838-c38e-4d8b-923f-eb68862a6d63\" (UID: \"cfef9838-c38e-4d8b-923f-eb68862a6d63\") "
Jul 27 21:57:55.204852 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.204789    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-configmap-metrics-client-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:55.204852 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.204807    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:55.204852 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.204823    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:55.204852 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.204837    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:55.205793 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.205434    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "cfef9838-c38e-4d8b-923f-eb68862a6d63" (UID: "cfef9838-c38e-4d8b-923f-eb68862a6d63"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:57:55.205793 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.205580    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "cfef9838-c38e-4d8b-923f-eb68862a6d63" (UID: "cfef9838-c38e-4d8b-923f-eb68862a6d63"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:57:55.205994 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.205839    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "cfef9838-c38e-4d8b-923f-eb68862a6d63" (UID: "cfef9838-c38e-4d8b-923f-eb68862a6d63"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:57:55.207001 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.206158    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-config" (OuterVolumeSpecName: "config") pod "cfef9838-c38e-4d8b-923f-eb68862a6d63" (UID: "cfef9838-c38e-4d8b-923f-eb68862a6d63"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:57:55.207001 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.206398    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "cfef9838-c38e-4d8b-923f-eb68862a6d63" (UID: "cfef9838-c38e-4d8b-923f-eb68862a6d63"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:57:55.207001 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.206596    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "cfef9838-c38e-4d8b-923f-eb68862a6d63" (UID: "cfef9838-c38e-4d8b-923f-eb68862a6d63"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:57:55.207001 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.206670    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "cfef9838-c38e-4d8b-923f-eb68862a6d63" (UID: "cfef9838-c38e-4d8b-923f-eb68862a6d63"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:57:55.207001 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.206830    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "cfef9838-c38e-4d8b-923f-eb68862a6d63" (UID: "cfef9838-c38e-4d8b-923f-eb68862a6d63"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:57:55.207001 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.206858    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "cfef9838-c38e-4d8b-923f-eb68862a6d63" (UID: "cfef9838-c38e-4d8b-923f-eb68862a6d63"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:57:55.208243 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.208217    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfef9838-c38e-4d8b-923f-eb68862a6d63-kube-api-access-jv6ch" (OuterVolumeSpecName: "kube-api-access-jv6ch") pod "cfef9838-c38e-4d8b-923f-eb68862a6d63" (UID: "cfef9838-c38e-4d8b-923f-eb68862a6d63"). InnerVolumeSpecName "kube-api-access-jv6ch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:57:55.208375 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.208354    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "cfef9838-c38e-4d8b-923f-eb68862a6d63" (UID: "cfef9838-c38e-4d8b-923f-eb68862a6d63"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:57:55.208454 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.208399    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "cfef9838-c38e-4d8b-923f-eb68862a6d63" (UID: "cfef9838-c38e-4d8b-923f-eb68862a6d63"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:57:55.208688 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.208665    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "cfef9838-c38e-4d8b-923f-eb68862a6d63" (UID: "cfef9838-c38e-4d8b-923f-eb68862a6d63"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:57:55.208796 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.208777    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfef9838-c38e-4d8b-923f-eb68862a6d63-config-out" (OuterVolumeSpecName: "config-out") pod "cfef9838-c38e-4d8b-923f-eb68862a6d63" (UID: "cfef9838-c38e-4d8b-923f-eb68862a6d63"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:57:55.208933 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.208920    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfef9838-c38e-4d8b-923f-eb68862a6d63-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "cfef9838-c38e-4d8b-923f-eb68862a6d63" (UID: "cfef9838-c38e-4d8b-923f-eb68862a6d63"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:57:55.218134 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.218115    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-web-config" (OuterVolumeSpecName: "web-config") pod "cfef9838-c38e-4d8b-923f-eb68862a6d63" (UID: "cfef9838-c38e-4d8b-923f-eb68862a6d63"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:57:55.305763 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.305679    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfef9838-c38e-4d8b-923f-eb68862a6d63-config-out\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:55.305763 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.305711    2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:55.305763 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.305722    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv6ch\" (UniqueName: \"kubernetes.io/projected/cfef9838-c38e-4d8b-923f-eb68862a6d63-kube-api-access-jv6ch\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:55.305763 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.305733    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:55.305763 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.305742    2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-grpc-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:55.305763 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.305752    2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-metrics-client-certs\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:55.305763 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.305760    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:55.305763 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.305769    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfef9838-c38e-4d8b-923f-eb68862a6d63-tls-assets\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:55.306094 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.305785    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:55.306094 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.305794    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-web-config\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:55.306094 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.305802    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:55.306094 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.305809    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:55.306094 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.305817    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cfef9838-c38e-4d8b-923f-eb68862a6d63-prometheus-k8s-db\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:55.306094 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.305825    2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-config\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:55.306094 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.305833    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:55.306094 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.305841    2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfef9838-c38e-4d8b-923f-eb68862a6d63-secret-kube-rbac-proxy\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 21:57:55.732065 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.732027    2565 generic.go:356] "Generic (PLEG): container finished" podID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerID="8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d" exitCode=0
Jul 27 21:57:55.732065 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.732058    2565 generic.go:356] "Generic (PLEG): container finished" podID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerID="35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95" exitCode=0
Jul 27 21:57:55.732065 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.732064    2565 generic.go:356] "Generic (PLEG): container finished" podID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerID="3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7" exitCode=0
Jul 27 21:57:55.732540 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.732082    2565 generic.go:356] "Generic (PLEG): container finished" podID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerID="12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87" exitCode=0
Jul 27 21:57:55.732540 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.732089    2565 generic.go:356] "Generic (PLEG): container finished" podID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerID="58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095" exitCode=0
Jul 27 21:57:55.732540 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.732096    2565 generic.go:356] "Generic (PLEG): container finished" podID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerID="d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce" exitCode=0
Jul 27 21:57:55.732540 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.732100    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.732540 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.732109    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef9838-c38e-4d8b-923f-eb68862a6d63","Type":"ContainerDied","Data":"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d"}
Jul 27 21:57:55.732540 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.732199    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef9838-c38e-4d8b-923f-eb68862a6d63","Type":"ContainerDied","Data":"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95"}
Jul 27 21:57:55.732540 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.732228    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef9838-c38e-4d8b-923f-eb68862a6d63","Type":"ContainerDied","Data":"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7"}
Jul 27 21:57:55.732540 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.732259    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef9838-c38e-4d8b-923f-eb68862a6d63","Type":"ContainerDied","Data":"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87"}
Jul 27 21:57:55.732540 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.732269    2565 scope.go:117] "RemoveContainer" containerID="8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d"
Jul 27 21:57:55.732540 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.732294    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef9838-c38e-4d8b-923f-eb68862a6d63","Type":"ContainerDied","Data":"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095"}
Jul 27 21:57:55.732540 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.732347    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef9838-c38e-4d8b-923f-eb68862a6d63","Type":"ContainerDied","Data":"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce"}
Jul 27 21:57:55.732540 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.732386    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef9838-c38e-4d8b-923f-eb68862a6d63","Type":"ContainerDied","Data":"fa1af40db93f017180f72f73ade2d1cc032cd3a67f0506c8047e297f5a1e60e6"}
Jul 27 21:57:55.740772 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.740758    2565 scope.go:117] "RemoveContainer" containerID="35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95"
Jul 27 21:57:55.747530 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.747516    2565 scope.go:117] "RemoveContainer" containerID="3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7"
Jul 27 21:57:55.755679 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.755660    2565 scope.go:117] "RemoveContainer" containerID="12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87"
Jul 27 21:57:55.758174 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.758152    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 21:57:55.760998 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.760976    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 21:57:55.764129 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.764112    2565 scope.go:117] "RemoveContainer" containerID="58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095"
Jul 27 21:57:55.770447 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.770432    2565 scope.go:117] "RemoveContainer" containerID="d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce"
Jul 27 21:57:55.777066 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.777048    2565 scope.go:117] "RemoveContainer" containerID="3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5"
Jul 27 21:57:55.783788 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.783774    2565 scope.go:117] "RemoveContainer" containerID="8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d"
Jul 27 21:57:55.784058 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:57:55.784039    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d\": container with ID starting with 8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d not found: ID does not exist" containerID="8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d"
Jul 27 21:57:55.784105 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.784066    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d"} err="failed to get container status \"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d\": rpc error: code = NotFound desc = could not find container \"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d\": container with ID starting with 8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d not found: ID does not exist"
Jul 27 21:57:55.784105 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.784098    2565 scope.go:117] "RemoveContainer" containerID="35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95"
Jul 27 21:57:55.784321 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:57:55.784304    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95\": container with ID starting with 35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95 not found: ID does not exist" containerID="35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95"
Jul 27 21:57:55.784413 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.784326    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95"} err="failed to get container status \"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95\": rpc error: code = NotFound desc = could not find container \"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95\": container with ID starting with 35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95 not found: ID does not exist"
Jul 27 21:57:55.784413 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.784366    2565 scope.go:117] "RemoveContainer" containerID="3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7"
Jul 27 21:57:55.784588 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:57:55.784572    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7\": container with ID starting with 3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7 not found: ID does not exist" containerID="3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7"
Jul 27 21:57:55.784623 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.784592    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7"} err="failed to get container status \"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7\": rpc error: code = NotFound desc = could not find container \"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7\": container with ID starting with 3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7 not found: ID does not exist"
Jul 27 21:57:55.784623 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.784606    2565 scope.go:117] "RemoveContainer" containerID="12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87"
Jul 27 21:57:55.784805 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:57:55.784788    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87\": container with ID starting with 12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87 not found: ID does not exist" containerID="12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87"
Jul 27 21:57:55.784860 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.784812    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87"} err="failed to get container status \"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87\": rpc error: code = NotFound desc = could not find container \"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87\": container with ID starting with 12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87 not found: ID does not exist"
Jul 27 21:57:55.784860 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.784835    2565 scope.go:117] "RemoveContainer" containerID="58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095"
Jul 27 21:57:55.785058 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:57:55.785042    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095\": container with ID starting with 58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095 not found: ID does not exist" containerID="58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095"
Jul 27 21:57:55.785096 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.785060    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095"} err="failed to get container status \"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095\": rpc error: code = NotFound desc = could not find container \"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095\": container with ID starting with 58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095 not found: ID does not exist"
Jul 27 21:57:55.785096 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.785082    2565 scope.go:117] "RemoveContainer" containerID="d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce"
Jul 27 21:57:55.785284 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:57:55.785269    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce\": container with ID starting with d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce not found: ID does not exist" containerID="d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce"
Jul 27 21:57:55.785317 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.785287    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce"} err="failed to get container status \"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce\": rpc error: code = NotFound desc = could not find container \"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce\": container with ID starting with d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce not found: ID does not exist"
Jul 27 21:57:55.785317 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.785298    2565 scope.go:117] "RemoveContainer" containerID="3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5"
Jul 27 21:57:55.785496 ip-10-0-140-114 kubenswrapper[2565]: E0727 21:57:55.785481    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5\": container with ID starting with 3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5 not found: ID does not exist" containerID="3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5"
Jul 27 21:57:55.785534 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.785499    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5"} err="failed to get container status \"3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5\": rpc error: code = NotFound desc = could not find container \"3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5\": container with ID starting with 3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5 not found: ID does not exist"
Jul 27 21:57:55.785534 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.785511    2565 scope.go:117] "RemoveContainer" containerID="8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d"
Jul 27 21:57:55.785704 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.785686    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d"} err="failed to get container status \"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d\": rpc error: code = NotFound desc = could not find container \"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d\": container with ID starting with 8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d not found: ID does not exist"
Jul 27 21:57:55.785743 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.785705    2565 scope.go:117] "RemoveContainer" containerID="35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95"
Jul 27 21:57:55.785881 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.785863    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95"} err="failed to get container status \"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95\": rpc error: code = NotFound desc = could not find container \"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95\": container with ID starting with 35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95 not found: ID does not exist"
Jul 27 21:57:55.785920 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.785881    2565 scope.go:117] "RemoveContainer" containerID="3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7"
Jul 27 21:57:55.786046 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.786026    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7"} err="failed to get container status \"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7\": rpc error: code = NotFound desc = could not find container \"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7\": container with ID starting with 3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7 not found: ID does not exist"
Jul 27 21:57:55.786081 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.786050    2565 scope.go:117] "RemoveContainer" containerID="12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87"
Jul 27 21:57:55.786208 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.786193    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87"} err="failed to get container status \"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87\": rpc error: code = NotFound desc = could not find container \"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87\": container with ID starting with 12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87 not found: ID does not exist"
Jul 27 21:57:55.786245 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.786208    2565 scope.go:117] "RemoveContainer" containerID="58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095"
Jul 27 21:57:55.786419 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.786401    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095"} err="failed to get container status \"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095\": rpc error: code = NotFound desc = could not find container \"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095\": container with ID starting with 58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095 not found: ID does not exist"
Jul 27 21:57:55.786466 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.786418    2565 scope.go:117] "RemoveContainer" containerID="d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce"
Jul 27 21:57:55.786572 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.786557    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce"} err="failed to get container status \"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce\": rpc error: code = NotFound desc = could not find container \"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce\": container with ID starting with d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce not found: ID does not exist"
Jul 27 21:57:55.786612 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.786572    2565 scope.go:117] "RemoveContainer" containerID="3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5"
Jul 27 21:57:55.786768 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.786752    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5"} err="failed to get container status \"3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5\": rpc error: code = NotFound desc = could not find container \"3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5\": container with ID starting with 3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5 not found: ID does not exist"
Jul 27 21:57:55.786768 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.786767    2565 scope.go:117] "RemoveContainer" containerID="8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d"
Jul 27 21:57:55.787120 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.787091    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d"} err="failed to get container status \"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d\": rpc error: code = NotFound desc = could not find container \"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d\": container with ID starting with 8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d not found: ID does not exist"
Jul 27 21:57:55.787120 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.787119    2565 scope.go:117] "RemoveContainer" containerID="35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95"
Jul 27 21:57:55.787679 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.787625    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95"} err="failed to get container status \"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95\": rpc error: code = NotFound desc = could not find container \"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95\": container with ID starting with 35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95 not found: ID does not exist"
Jul 27 21:57:55.787679 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.787654    2565 scope.go:117] "RemoveContainer" containerID="3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7"
Jul 27 21:57:55.788058 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.788035    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7"} err="failed to get container status \"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7\": rpc error: code = NotFound desc = could not find container \"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7\": container with ID starting with 3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7 not found: ID does not exist"
Jul 27 21:57:55.788148 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.788060    2565 scope.go:117] "RemoveContainer" containerID="12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87"
Jul 27 21:57:55.788305 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.788284    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87"} err="failed to get container status \"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87\": rpc error: code = NotFound desc = could not find container \"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87\": container with ID starting with 12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87 not found: ID does not exist"
Jul 27 21:57:55.788377 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.788305    2565 scope.go:117] "RemoveContainer" containerID="58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095"
Jul 27 21:57:55.788555 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.788538    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095"} err="failed to get container status \"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095\": rpc error: code = NotFound desc = could not find container \"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095\": container with ID starting with 58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095 not found: ID does not exist"
Jul 27 21:57:55.788665 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.788555    2565 scope.go:117] "RemoveContainer" containerID="d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce"
Jul 27 21:57:55.788778 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.788758    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce"} err="failed to get container status \"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce\": rpc error: code = NotFound desc = could not find container \"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce\": container with ID starting with d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce not found: ID does not exist"
Jul 27 21:57:55.788833 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.788778    2565 scope.go:117] "RemoveContainer" containerID="3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5"
Jul 27 21:57:55.789015 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.788997    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5"} err="failed to get container status \"3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5\": rpc error: code = NotFound desc = could not find container \"3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5\": container with ID starting with 3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5 not found: ID does not exist"
Jul 27 21:57:55.789071 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789015    2565 scope.go:117] "RemoveContainer" containerID="8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d"
Jul 27 21:57:55.789118 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789068    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 21:57:55.789232 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789213    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d"} err="failed to get container status \"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d\": rpc error: code = NotFound desc = could not find container \"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d\": container with ID starting with 8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d not found: ID does not exist"
Jul 27 21:57:55.789287 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789233    2565 scope.go:117] "RemoveContainer" containerID="35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95"
Jul 27 21:57:55.789459 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789439    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95"} err="failed to get container status \"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95\": rpc error: code = NotFound desc = could not find container \"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95\": container with ID starting with 35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95 not found: ID does not exist"
Jul 27 21:57:55.789530 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789459    2565 scope.go:117] "RemoveContainer" containerID="3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7"
Jul 27 21:57:55.789530 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789461    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="config-reloader"
Jul 27 21:57:55.789530 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789478    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="config-reloader"
Jul 27 21:57:55.789530 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789503    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="init-config-reloader"
Jul 27 21:57:55.789530 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789512    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="init-config-reloader"
Jul 27 21:57:55.789530 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789524    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="prometheus"
Jul 27 21:57:55.789796 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789533    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="prometheus"
Jul 27 21:57:55.789796 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789545    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="kube-rbac-proxy-thanos"
Jul 27 21:57:55.789796 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789553    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="kube-rbac-proxy-thanos"
Jul 27 21:57:55.789796 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789566    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="kube-rbac-proxy-web"
Jul 27 21:57:55.789796 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789574    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="kube-rbac-proxy-web"
Jul 27 21:57:55.789796 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789583    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="kube-rbac-proxy"
Jul 27 21:57:55.789796 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789591    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="kube-rbac-proxy"
Jul 27 21:57:55.789796 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789603    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="thanos-sidecar"
Jul 27 21:57:55.789796 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789611    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="thanos-sidecar"
Jul 27 21:57:55.789796 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789632    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7"} err="failed to get container status \"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7\": rpc error: code = NotFound desc = could not find container \"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7\": container with ID starting with 3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7 not found: ID does not exist"
Jul 27 21:57:55.789796 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789645    2565 scope.go:117] "RemoveContainer" containerID="12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87"
Jul 27 21:57:55.789796 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789691    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="config-reloader"
Jul 27 21:57:55.789796 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789703    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="kube-rbac-proxy-thanos"
Jul 27 21:57:55.789796 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789715    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="kube-rbac-proxy"
Jul 27 21:57:55.789796 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789728    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="thanos-sidecar"
Jul 27 21:57:55.789796 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789736    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="kube-rbac-proxy-web"
Jul 27 21:57:55.789796 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789746    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" containerName="prometheus"
Jul 27 21:57:55.790578 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789838    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87"} err="failed to get container status \"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87\": rpc error: code = NotFound desc = could not find container \"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87\": container with ID starting with 12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87 not found: ID does not exist"
Jul 27 21:57:55.790578 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.789850    2565 scope.go:117] "RemoveContainer" containerID="58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095"
Jul 27 21:57:55.790578 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.790033    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095"} err="failed to get container status \"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095\": rpc error: code = NotFound desc = could not find container \"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095\": container with ID starting with 58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095 not found: ID does not exist"
Jul 27 21:57:55.790578 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.790044    2565 scope.go:117] "RemoveContainer" containerID="d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce"
Jul 27 21:57:55.790578 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.790205    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce"} err="failed to get container status \"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce\": rpc error: code = NotFound desc = could not find container \"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce\": container with ID starting with d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce not found: ID does not exist"
Jul 27 21:57:55.790578 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.790220    2565 scope.go:117] "RemoveContainer" containerID="3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5"
Jul 27 21:57:55.790578 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.790402    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5"} err="failed to get container status \"3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5\": rpc error: code = NotFound desc = could not find container \"3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5\": container with ID starting with 3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5 not found: ID does not exist"
Jul 27 21:57:55.790578 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.790419    2565 scope.go:117] "RemoveContainer" containerID="8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d"
Jul 27 21:57:55.790936 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.790601    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d"} err="failed to get container status \"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d\": rpc error: code = NotFound desc = could not find container \"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d\": container with ID starting with 8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d not found: ID does not exist"
Jul 27 21:57:55.790936 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.790617    2565 scope.go:117] "RemoveContainer" containerID="35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95"
Jul 27 21:57:55.790936 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.790814    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95"} err="failed to get container status \"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95\": rpc error: code = NotFound desc = could not find container \"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95\": container with ID starting with 35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95 not found: ID does not exist"
Jul 27 21:57:55.790936 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.790827    2565 scope.go:117] "RemoveContainer" containerID="3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7"
Jul 27 21:57:55.791171 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.790988    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7"} err="failed to get container status \"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7\": rpc error: code = NotFound desc = could not find container \"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7\": container with ID starting with 3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7 not found: ID does not exist"
Jul 27 21:57:55.791171 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.791003    2565 scope.go:117] "RemoveContainer" containerID="12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87"
Jul 27 21:57:55.791289 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.791252    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87"} err="failed to get container status \"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87\": rpc error: code = NotFound desc = could not find container \"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87\": container with ID starting with 12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87 not found: ID does not exist"
Jul 27 21:57:55.791372 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.791290    2565 scope.go:117] "RemoveContainer" containerID="58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095"
Jul 27 21:57:55.791534 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.791505    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095"} err="failed to get container status \"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095\": rpc error: code = NotFound desc = could not find container \"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095\": container with ID starting with 58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095 not found: ID does not exist"
Jul 27 21:57:55.791594 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.791534    2565 scope.go:117] "RemoveContainer" containerID="d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce"
Jul 27 21:57:55.791741 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.791724    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce"} err="failed to get container status \"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce\": rpc error: code = NotFound desc = could not find container \"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce\": container with ID starting with d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce not found: ID does not exist"
Jul 27 21:57:55.791785 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.791742    2565 scope.go:117] "RemoveContainer" containerID="3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5"
Jul 27 21:57:55.791958 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.791936    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5"} err="failed to get container status \"3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5\": rpc error: code = NotFound desc = could not find container \"3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5\": container with ID starting with 3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5 not found: ID does not exist"
Jul 27 21:57:55.791958 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.791957    2565 scope.go:117] "RemoveContainer" containerID="8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d"
Jul 27 21:57:55.792163 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.792148    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d"} err="failed to get container status \"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d\": rpc error: code = NotFound desc = could not find container \"8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d\": container with ID starting with 8d5ffb30b8b232f25c4371ed6ea7b111ed56f4a5848242d6ed3705c7bd312d6d not found: ID does not exist"
Jul 27 21:57:55.792163 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.792162    2565 scope.go:117] "RemoveContainer" containerID="35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95"
Jul 27 21:57:55.792370 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.792352    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95"} err="failed to get container status \"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95\": rpc error: code = NotFound desc = could not find container \"35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95\": container with ID starting with 35eeb6d672036e604727b5c4e53d2bf101d974553bb27a5bfa669268a2199a95 not found: ID does not exist"
Jul 27 21:57:55.792424 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.792370    2565 scope.go:117] "RemoveContainer" containerID="3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7"
Jul 27 21:57:55.792607 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.792555    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7"} err="failed to get container status \"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7\": rpc error: code = NotFound desc = could not find container \"3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7\": container with ID starting with 3dd1336c6052c4abc4f71679760638891c4a04f926ac7e6ab5064e37824a3be7 not found: ID does not exist"
Jul 27 21:57:55.792607 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.792596    2565 scope.go:117] "RemoveContainer" containerID="12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87"
Jul 27 21:57:55.792809 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.792793    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87"} err="failed to get container status \"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87\": rpc error: code = NotFound desc = could not find container \"12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87\": container with ID starting with 12600b72715b8322c66aa6aa934e6378304bde1b928b821704d70d69cec6aa87 not found: ID does not exist"
Jul 27 21:57:55.792854 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.792811    2565 scope.go:117] "RemoveContainer" containerID="58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095"
Jul 27 21:57:55.793024 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.793009    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095"} err="failed to get container status \"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095\": rpc error: code = NotFound desc = could not find container \"58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095\": container with ID starting with 58023ef23c6c65241b565f36530fc2b01025b9a5a71516991e9cfb3ca75be095 not found: ID does not exist"
Jul 27 21:57:55.793056 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.793025    2565 scope.go:117] "RemoveContainer" containerID="d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce"
Jul 27 21:57:55.793247 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.793230    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce"} err="failed to get container status \"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce\": rpc error: code = NotFound desc = could not find container \"d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce\": container with ID starting with d3c9cd559848d1906d3006e00cc33b866fec110110f3970b945281311c22bcce not found: ID does not exist"
Jul 27 21:57:55.793284 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.793250    2565 scope.go:117] "RemoveContainer" containerID="3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5"
Jul 27 21:57:55.793476 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.793460    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5"} err="failed to get container status \"3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5\": rpc error: code = NotFound desc = could not find container \"3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5\": container with ID starting with 3f4339315bdd2c813d164bf322f95739802b65c075edf5dbc78c8f948c57c8f5 not found: ID does not exist"
Jul 27 21:57:55.795573 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.795558    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.797844 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.797823    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 27 21:57:55.798071 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.797864    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 27 21:57:55.798178 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.798158    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 27 21:57:55.798274 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.798197    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 27 21:57:55.798413 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.798398    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e36kmsd9b2hll\""
Jul 27 21:57:55.798475 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.798463    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 27 21:57:55.798475 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.798470    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4wvtz\""
Jul 27 21:57:55.798573 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.798489    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 27 21:57:55.798573 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.798501    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 27 21:57:55.798573 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.798556    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 27 21:57:55.798695 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.798608    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 27 21:57:55.798784 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.798771    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 27 21:57:55.798950 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.798935    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 27 21:57:55.798997 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.798980    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 27 21:57:55.801556 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.801534    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 27 21:57:55.803598 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.803581    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 27 21:57:55.816642 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.816622    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfef9838-c38e-4d8b-923f-eb68862a6d63" path="/var/lib/kubelet/pods/cfef9838-c38e-4d8b-923f-eb68862a6d63/volumes"
Jul 27 21:57:55.817255 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.817238    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 21:57:55.909586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.909513    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.909706 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.909582    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzrt7\" (UniqueName: \"kubernetes.io/projected/d01d12b4-f388-474f-bb04-af21307608dc-kube-api-access-lzrt7\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.909706 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.909650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d01d12b4-f388-474f-bb04-af21307608dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.909706 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.909674    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.909706 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.909697    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.909839 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.909734    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.909839 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.909751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.909839 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.909773    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d01d12b4-f388-474f-bb04-af21307608dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.909839 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.909808    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.909839 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.909828    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d01d12b4-f388-474f-bb04-af21307608dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.909978 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.909852    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.909978 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.909867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.909978 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.909905    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.909978 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.909941    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.910500 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.910459    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.911491 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.910642    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.911491 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.910738    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.911491 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.910782    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.911491 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.910835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:55.911491 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:55.910982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-config\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.012144 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.012108    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.012144 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.012148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.012410 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.012170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.012410 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.012198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.012410 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.012229    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.012410 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.012250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.012410 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.012280    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.012410 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.012306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-config\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.012908 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.012882    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.013038 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.012951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.013038 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.012964    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.013038 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.012987    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzrt7\" (UniqueName: \"kubernetes.io/projected/d01d12b4-f388-474f-bb04-af21307608dc-kube-api-access-lzrt7\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.013038 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.013034    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d01d12b4-f388-474f-bb04-af21307608dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.013226 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.013070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.013226 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.013098    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.013226 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.013133    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.013226 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.013160    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.013226 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.013187    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d01d12b4-f388-474f-bb04-af21307608dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.013226 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.013211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.013555 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.013234    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d01d12b4-f388-474f-bb04-af21307608dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.013555 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.013268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.013555 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.013289    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.013555 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.013309    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.014097 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.014063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.014580 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.014555    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.015725 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.015294    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.015725 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.015315    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.015725 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.015414    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-config\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.015923 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.015888    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.016049 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.016026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.016199 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.016170    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d01d12b4-f388-474f-bb04-af21307608dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.016843 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.016816    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.017029 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.017007    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d01d12b4-f388-474f-bb04-af21307608dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.017423 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.017399    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d01d12b4-f388-474f-bb04-af21307608dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.017509 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.017427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.017563 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.017501    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d01d12b4-f388-474f-bb04-af21307608dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.018163 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.018144    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.018317 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.018300    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.018670 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.018652    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d01d12b4-f388-474f-bb04-af21307608dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.021384 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.021326    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzrt7\" (UniqueName: \"kubernetes.io/projected/d01d12b4-f388-474f-bb04-af21307608dc-kube-api-access-lzrt7\") pod \"prometheus-k8s-0\" (UID: \"d01d12b4-f388-474f-bb04-af21307608dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.105919 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.105887    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:57:56.248832 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.248808    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 21:57:56.251215 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:57:56.251187    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd01d12b4_f388_474f_bb04_af21307608dc.slice/crio-444e1d3041f8c2d943627ffe3669f9611b3860f883441a2d38515ee47efa114b WatchSource:0}: Error finding container 444e1d3041f8c2d943627ffe3669f9611b3860f883441a2d38515ee47efa114b: Status 404 returned error can't find the container with id 444e1d3041f8c2d943627ffe3669f9611b3860f883441a2d38515ee47efa114b
Jul 27 21:57:56.737444 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.737410    2565 generic.go:356] "Generic (PLEG): container finished" podID="d01d12b4-f388-474f-bb04-af21307608dc" containerID="a53796ab53988b8587cc1a40638093b10f55637727ffefe06328a7bc64c1b057" exitCode=0
Jul 27 21:57:56.737901 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.737558    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01d12b4-f388-474f-bb04-af21307608dc","Type":"ContainerDied","Data":"a53796ab53988b8587cc1a40638093b10f55637727ffefe06328a7bc64c1b057"}
Jul 27 21:57:56.737901 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:56.737643    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01d12b4-f388-474f-bb04-af21307608dc","Type":"ContainerStarted","Data":"444e1d3041f8c2d943627ffe3669f9611b3860f883441a2d38515ee47efa114b"}
Jul 27 21:57:57.745231 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:57.745195    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01d12b4-f388-474f-bb04-af21307608dc","Type":"ContainerStarted","Data":"34ac5b79c08c0ab16414e41cd2f59f3a33b9d972a2b7cca9ad054bb56e5db1aa"}
Jul 27 21:57:57.745644 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:57.745264    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01d12b4-f388-474f-bb04-af21307608dc","Type":"ContainerStarted","Data":"a1e2748de100dd89df5b780b363a2f6b4c742dbb71d7a1c71dbe33d3a6769228"}
Jul 27 21:57:57.745644 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:57.745291    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01d12b4-f388-474f-bb04-af21307608dc","Type":"ContainerStarted","Data":"a1d4fa10819f70cc8a5000378451dd5c219a9f8eac464d194166a873d07f61ee"}
Jul 27 21:57:57.745644 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:57.745313    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01d12b4-f388-474f-bb04-af21307608dc","Type":"ContainerStarted","Data":"e5e9edea91177f646433dd5fcf2d716aeb9a7a9919b4748a5a64dacd6841fe08"}
Jul 27 21:57:57.745644 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:57.745357    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01d12b4-f388-474f-bb04-af21307608dc","Type":"ContainerStarted","Data":"0745dfdb8ea1841f9cac6b8bc89595f803afc459f347d15240ecd862444aa69b"}
Jul 27 21:57:57.745644 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:57.745380    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01d12b4-f388-474f-bb04-af21307608dc","Type":"ContainerStarted","Data":"3902f9460bcef1c7db20b475ab319143d97ce92f20901af5d0c1527136daf2f3"}
Jul 27 21:57:57.772938 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:57:57.772882    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.755585158 podStartE2EDuration="2.772867463s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.282305ms" isStatefulPod=false podCreationTimestamp="2026-07-27 21:57:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:57:57.772577311 +0000 UTC m=+222.513712118" watchObservedRunningTime="2026-07-27 21:57:57.772867463 +0000 UTC m=+222.514002229"
Jul 27 21:58:01.106735 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:58:01.106695    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:58:56.106423 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:58:56.106386    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:58:56.121542 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:58:56.121509    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:58:56.991419 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:58:56.991391    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:59:15.734580 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:15.734552    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 21:59:29.325552 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:29.325518    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4m99x"]
Jul 27 21:59:29.329066 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:29.329050    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4m99x"
Jul 27 21:59:29.331647 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:29.331621    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-c9j62\""
Jul 27 21:59:29.331783 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:29.331628    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 21:59:29.332391 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:29.332373    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 21:59:29.338380 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:29.338359    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4m99x"]
Jul 27 21:59:29.405026 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:29.404994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk79h\" (UniqueName: \"kubernetes.io/projected/abb928ed-189b-4580-9c40-46a706897b0d-kube-api-access-rk79h\") pod \"cert-manager-55b4d954d5-4m99x\" (UID: \"abb928ed-189b-4580-9c40-46a706897b0d\") " pod="cert-manager/cert-manager-55b4d954d5-4m99x"
Jul 27 21:59:29.405201 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:29.405038    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abb928ed-189b-4580-9c40-46a706897b0d-bound-sa-token\") pod \"cert-manager-55b4d954d5-4m99x\" (UID: \"abb928ed-189b-4580-9c40-46a706897b0d\") " pod="cert-manager/cert-manager-55b4d954d5-4m99x"
Jul 27 21:59:29.506299 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:29.506261    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk79h\" (UniqueName: \"kubernetes.io/projected/abb928ed-189b-4580-9c40-46a706897b0d-kube-api-access-rk79h\") pod \"cert-manager-55b4d954d5-4m99x\" (UID: \"abb928ed-189b-4580-9c40-46a706897b0d\") " pod="cert-manager/cert-manager-55b4d954d5-4m99x"
Jul 27 21:59:29.506486 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:29.506322    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abb928ed-189b-4580-9c40-46a706897b0d-bound-sa-token\") pod \"cert-manager-55b4d954d5-4m99x\" (UID: \"abb928ed-189b-4580-9c40-46a706897b0d\") " pod="cert-manager/cert-manager-55b4d954d5-4m99x"
Jul 27 21:59:29.514781 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:29.514755    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abb928ed-189b-4580-9c40-46a706897b0d-bound-sa-token\") pod \"cert-manager-55b4d954d5-4m99x\" (UID: \"abb928ed-189b-4580-9c40-46a706897b0d\") " pod="cert-manager/cert-manager-55b4d954d5-4m99x"
Jul 27 21:59:29.515065 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:29.515032    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk79h\" (UniqueName: \"kubernetes.io/projected/abb928ed-189b-4580-9c40-46a706897b0d-kube-api-access-rk79h\") pod \"cert-manager-55b4d954d5-4m99x\" (UID: \"abb928ed-189b-4580-9c40-46a706897b0d\") " pod="cert-manager/cert-manager-55b4d954d5-4m99x"
Jul 27 21:59:29.652434 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:29.652353    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4m99x"
Jul 27 21:59:29.785350 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:29.785312    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4m99x"]
Jul 27 21:59:29.786468 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:59:29.786443    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabb928ed_189b_4580_9c40_46a706897b0d.slice/crio-ffdcce23cff1fd563af5a26d1a271605fead1467429bb63c434f72cc059445ec WatchSource:0}: Error finding container ffdcce23cff1fd563af5a26d1a271605fead1467429bb63c434f72cc059445ec: Status 404 returned error can't find the container with id ffdcce23cff1fd563af5a26d1a271605fead1467429bb63c434f72cc059445ec
Jul 27 21:59:29.788773 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:29.788754    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:59:30.116586 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:30.116550    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4m99x" event={"ID":"abb928ed-189b-4580-9c40-46a706897b0d","Type":"ContainerStarted","Data":"ffdcce23cff1fd563af5a26d1a271605fead1467429bb63c434f72cc059445ec"}
Jul 27 21:59:32.686677 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:32.686641    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmxj5"]
Jul 27 21:59:32.689859 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:32.689837    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmxj5"
Jul 27 21:59:32.692471 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:32.692445    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 21:59:32.692590 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:32.692473    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 21:59:32.693448 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:32.693427    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-8dsjv\""
Jul 27 21:59:32.698980 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:32.698950    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmxj5"]
Jul 27 21:59:32.837899 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:32.837867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gndhf\" (UniqueName: \"kubernetes.io/projected/f0467fde-84d9-4801-b106-da03164f2aac-kube-api-access-gndhf\") pod \"openshift-lws-operator-fd8ccff4c-cmxj5\" (UID: \"f0467fde-84d9-4801-b106-da03164f2aac\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmxj5"
Jul 27 21:59:32.838063 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:32.837932    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0467fde-84d9-4801-b106-da03164f2aac-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cmxj5\" (UID: \"f0467fde-84d9-4801-b106-da03164f2aac\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmxj5"
Jul 27 21:59:32.938456 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:32.938310    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gndhf\" (UniqueName: \"kubernetes.io/projected/f0467fde-84d9-4801-b106-da03164f2aac-kube-api-access-gndhf\") pod \"openshift-lws-operator-fd8ccff4c-cmxj5\" (UID: \"f0467fde-84d9-4801-b106-da03164f2aac\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmxj5"
Jul 27 21:59:32.938612 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:32.938467    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0467fde-84d9-4801-b106-da03164f2aac-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cmxj5\" (UID: \"f0467fde-84d9-4801-b106-da03164f2aac\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmxj5"
Jul 27 21:59:32.938879 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:32.938859    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0467fde-84d9-4801-b106-da03164f2aac-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cmxj5\" (UID: \"f0467fde-84d9-4801-b106-da03164f2aac\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmxj5"
Jul 27 21:59:32.946724 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:32.946704    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gndhf\" (UniqueName: \"kubernetes.io/projected/f0467fde-84d9-4801-b106-da03164f2aac-kube-api-access-gndhf\") pod \"openshift-lws-operator-fd8ccff4c-cmxj5\" (UID: \"f0467fde-84d9-4801-b106-da03164f2aac\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmxj5"
Jul 27 21:59:33.000140 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:33.000111    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmxj5"
Jul 27 21:59:33.129883 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:33.129858    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmxj5"]
Jul 27 21:59:33.132543 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:59:33.132505    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0467fde_84d9_4801_b106_da03164f2aac.slice/crio-6cb90bb0fd301755f9fc3c6076c02b29dcca4ba4189015e2990ed8d360291539 WatchSource:0}: Error finding container 6cb90bb0fd301755f9fc3c6076c02b29dcca4ba4189015e2990ed8d360291539: Status 404 returned error can't find the container with id 6cb90bb0fd301755f9fc3c6076c02b29dcca4ba4189015e2990ed8d360291539
Jul 27 21:59:33.134016 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:33.133990    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4m99x" event={"ID":"abb928ed-189b-4580-9c40-46a706897b0d","Type":"ContainerStarted","Data":"8865b554446a7cb741f34869ccacbaa961dbb1bb87e56beb2ebbb8913108201b"}
Jul 27 21:59:33.152688 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:33.152643    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-4m99x" podStartSLOduration=1.239752324 podStartE2EDuration="4.152628071s" totalImagesPullingTime="2.912875747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:59:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:59:33.151121116 +0000 UTC m=+317.892255884" watchObservedRunningTime="2026-07-27 21:59:33.152628071 +0000 UTC m=+317.893762837"
Jul 27 21:59:34.140775 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:34.140733    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmxj5" event={"ID":"f0467fde-84d9-4801-b106-da03164f2aac","Type":"ContainerStarted","Data":"6cb90bb0fd301755f9fc3c6076c02b29dcca4ba4189015e2990ed8d360291539"}
Jul 27 21:59:36.151200 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:36.151161    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmxj5" event={"ID":"f0467fde-84d9-4801-b106-da03164f2aac","Type":"ContainerStarted","Data":"29b98e53858f8f4f92c940225cb58b029e309eeccac7c0b0e5180bbb6241ffb4"}
Jul 27 21:59:36.168138 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:36.168083    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cmxj5" podStartSLOduration=1.847775862 podStartE2EDuration="4.168068272s" totalImagesPullingTime="2.32029241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:59:36.166319068 +0000 UTC m=+320.907453836" watchObservedRunningTime="2026-07-27 21:59:36.168068272 +0000 UTC m=+320.909203109"
Jul 27 21:59:55.273546 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.273512    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"]
Jul 27 21:59:55.280203 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.280176    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"
Jul 27 21:59:55.284116 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.284095    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 21:59:55.291552 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.291531    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 21:59:55.291552 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.291540    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pt8cs\""
Jul 27 21:59:55.292175 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.292158    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 21:59:55.292756 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.292744    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 21:59:55.314884 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.314854    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"]
Jul 27 21:59:55.445786 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.445753    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a466e60-b6c1-4d8f-ad29-5c723788c772-tmp\") pod \"opendatahub-operator-controller-manager-5f8fb7b654-bb268\" (UID: \"9a466e60-b6c1-4d8f-ad29-5c723788c772\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"
Jul 27 21:59:55.445979 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.445796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a466e60-b6c1-4d8f-ad29-5c723788c772-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f8fb7b654-bb268\" (UID: \"9a466e60-b6c1-4d8f-ad29-5c723788c772\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"
Jul 27 21:59:55.445979 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.445823    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a466e60-b6c1-4d8f-ad29-5c723788c772-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f8fb7b654-bb268\" (UID: \"9a466e60-b6c1-4d8f-ad29-5c723788c772\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"
Jul 27 21:59:55.445979 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.445845    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fndbn\" (UniqueName: \"kubernetes.io/projected/9a466e60-b6c1-4d8f-ad29-5c723788c772-kube-api-access-fndbn\") pod \"opendatahub-operator-controller-manager-5f8fb7b654-bb268\" (UID: \"9a466e60-b6c1-4d8f-ad29-5c723788c772\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"
Jul 27 21:59:55.446123 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.445990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a466e60-b6c1-4d8f-ad29-5c723788c772-manifests\") pod \"opendatahub-operator-controller-manager-5f8fb7b654-bb268\" (UID: \"9a466e60-b6c1-4d8f-ad29-5c723788c772\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"
Jul 27 21:59:55.546804 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.546704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a466e60-b6c1-4d8f-ad29-5c723788c772-manifests\") pod \"opendatahub-operator-controller-manager-5f8fb7b654-bb268\" (UID: \"9a466e60-b6c1-4d8f-ad29-5c723788c772\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"
Jul 27 21:59:55.546804 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.546756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a466e60-b6c1-4d8f-ad29-5c723788c772-tmp\") pod \"opendatahub-operator-controller-manager-5f8fb7b654-bb268\" (UID: \"9a466e60-b6c1-4d8f-ad29-5c723788c772\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"
Jul 27 21:59:55.547027 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.546870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a466e60-b6c1-4d8f-ad29-5c723788c772-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f8fb7b654-bb268\" (UID: \"9a466e60-b6c1-4d8f-ad29-5c723788c772\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"
Jul 27 21:59:55.547027 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.546905    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a466e60-b6c1-4d8f-ad29-5c723788c772-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f8fb7b654-bb268\" (UID: \"9a466e60-b6c1-4d8f-ad29-5c723788c772\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"
Jul 27 21:59:55.547027 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.546924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fndbn\" (UniqueName: \"kubernetes.io/projected/9a466e60-b6c1-4d8f-ad29-5c723788c772-kube-api-access-fndbn\") pod \"opendatahub-operator-controller-manager-5f8fb7b654-bb268\" (UID: \"9a466e60-b6c1-4d8f-ad29-5c723788c772\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"
Jul 27 21:59:55.547262 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.547238    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a466e60-b6c1-4d8f-ad29-5c723788c772-manifests\") pod \"opendatahub-operator-controller-manager-5f8fb7b654-bb268\" (UID: \"9a466e60-b6c1-4d8f-ad29-5c723788c772\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"
Jul 27 21:59:55.549065 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.549037    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a466e60-b6c1-4d8f-ad29-5c723788c772-tmp\") pod \"opendatahub-operator-controller-manager-5f8fb7b654-bb268\" (UID: \"9a466e60-b6c1-4d8f-ad29-5c723788c772\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"
Jul 27 21:59:55.549306 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.549290    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a466e60-b6c1-4d8f-ad29-5c723788c772-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f8fb7b654-bb268\" (UID: \"9a466e60-b6c1-4d8f-ad29-5c723788c772\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"
Jul 27 21:59:55.549403 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.549290    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a466e60-b6c1-4d8f-ad29-5c723788c772-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f8fb7b654-bb268\" (UID: \"9a466e60-b6c1-4d8f-ad29-5c723788c772\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"
Jul 27 21:59:55.556461 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.556433    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fndbn\" (UniqueName: \"kubernetes.io/projected/9a466e60-b6c1-4d8f-ad29-5c723788c772-kube-api-access-fndbn\") pod \"opendatahub-operator-controller-manager-5f8fb7b654-bb268\" (UID: \"9a466e60-b6c1-4d8f-ad29-5c723788c772\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"
Jul 27 21:59:55.590198 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.590160    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"
Jul 27 21:59:55.735691 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:55.735655    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"]
Jul 27 21:59:55.737995 ip-10-0-140-114 kubenswrapper[2565]: W0727 21:59:55.737972    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a466e60_b6c1_4d8f_ad29_5c723788c772.slice/crio-e5992fae32e2b5445d5f02025a712ecb490f59508e59ee4ab6e4c9841ea73cb3 WatchSource:0}: Error finding container e5992fae32e2b5445d5f02025a712ecb490f59508e59ee4ab6e4c9841ea73cb3: Status 404 returned error can't find the container with id e5992fae32e2b5445d5f02025a712ecb490f59508e59ee4ab6e4c9841ea73cb3
Jul 27 21:59:56.233728 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:56.233690    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268" event={"ID":"9a466e60-b6c1-4d8f-ad29-5c723788c772","Type":"ContainerStarted","Data":"e5992fae32e2b5445d5f02025a712ecb490f59508e59ee4ab6e4c9841ea73cb3"}
Jul 27 21:59:59.250396 ip-10-0-140-114 kubenswrapper[2565]: I0727 21:59:59.250355    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268" event={"ID":"9a466e60-b6c1-4d8f-ad29-5c723788c772","Type":"ContainerStarted","Data":"247533d8bba81e4c977bee3fcc96e374bfa6ce8d82a872f467b7addc82750144"}
Jul 27 22:00:00.256711 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:00.256680    2565 generic.go:356] "Generic (PLEG): container finished" podID="9a466e60-b6c1-4d8f-ad29-5c723788c772" containerID="247533d8bba81e4c977bee3fcc96e374bfa6ce8d82a872f467b7addc82750144" exitCode=0
Jul 27 22:00:00.257123 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:00.256726    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268" event={"ID":"9a466e60-b6c1-4d8f-ad29-5c723788c772","Type":"ContainerDied","Data":"247533d8bba81e4c977bee3fcc96e374bfa6ce8d82a872f467b7addc82750144"}
Jul 27 22:00:01.263429 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:01.263388    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268" event={"ID":"9a466e60-b6c1-4d8f-ad29-5c723788c772","Type":"ContainerStarted","Data":"a6a2eec8e04837a672eccff6b05786091e72be18fc5c589ecb28c12ada34f962"}
Jul 27 22:00:01.263912 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:01.263497    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"
Jul 27 22:00:01.287552 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:01.287492    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268" podStartSLOduration=1.685084402 podStartE2EDuration="6.287474985s" totalImagesPullingTime="3.571797278s" totalInitContainerRuntime="1.030593305s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:59:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:00:01.285555185 +0000 UTC m=+346.026689962" watchObservedRunningTime="2026-07-27 22:00:01.287474985 +0000 UTC m=+346.028609754"
Jul 27 22:00:12.270784 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:12.270708    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f8fb7b654-bb268"
Jul 27 22:00:23.917503 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:23.917464    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"]
Jul 27 22:00:23.922390 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:23.922369    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"
Jul 27 22:00:23.925845 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:23.925824    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 27 22:00:23.925944 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:23.925826    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 27 22:00:23.925944 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:23.925888    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 27 22:00:23.925944 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:23.925888    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-58jf7\""
Jul 27 22:00:23.932802 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:23.932781    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"]
Jul 27 22:00:24.002629 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.002589    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4qjt\" (UniqueName: \"kubernetes.io/projected/63baaaab-ef85-45b3-b50b-737436ae758a-kube-api-access-j4qjt\") pod \"lws-controller-manager-8444c4f6f9-nktbk\" (UID: \"63baaaab-ef85-45b3-b50b-737436ae758a\") " pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"
Jul 27 22:00:24.002806 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.002657    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63baaaab-ef85-45b3-b50b-737436ae758a-cert\") pod \"lws-controller-manager-8444c4f6f9-nktbk\" (UID: \"63baaaab-ef85-45b3-b50b-737436ae758a\") " pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"
Jul 27 22:00:24.002806 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.002700    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63baaaab-ef85-45b3-b50b-737436ae758a-metrics-cert\") pod \"lws-controller-manager-8444c4f6f9-nktbk\" (UID: \"63baaaab-ef85-45b3-b50b-737436ae758a\") " pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"
Jul 27 22:00:24.002806 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.002718    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63baaaab-ef85-45b3-b50b-737436ae758a-manager-config\") pod \"lws-controller-manager-8444c4f6f9-nktbk\" (UID: \"63baaaab-ef85-45b3-b50b-737436ae758a\") " pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"
Jul 27 22:00:24.104204 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.104156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63baaaab-ef85-45b3-b50b-737436ae758a-cert\") pod \"lws-controller-manager-8444c4f6f9-nktbk\" (UID: \"63baaaab-ef85-45b3-b50b-737436ae758a\") " pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"
Jul 27 22:00:24.104424 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.104240    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63baaaab-ef85-45b3-b50b-737436ae758a-metrics-cert\") pod \"lws-controller-manager-8444c4f6f9-nktbk\" (UID: \"63baaaab-ef85-45b3-b50b-737436ae758a\") " pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"
Jul 27 22:00:24.104424 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.104267    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63baaaab-ef85-45b3-b50b-737436ae758a-manager-config\") pod \"lws-controller-manager-8444c4f6f9-nktbk\" (UID: \"63baaaab-ef85-45b3-b50b-737436ae758a\") " pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"
Jul 27 22:00:24.104424 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.104308    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4qjt\" (UniqueName: \"kubernetes.io/projected/63baaaab-ef85-45b3-b50b-737436ae758a-kube-api-access-j4qjt\") pod \"lws-controller-manager-8444c4f6f9-nktbk\" (UID: \"63baaaab-ef85-45b3-b50b-737436ae758a\") " pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"
Jul 27 22:00:24.105822 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.105790    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/63baaaab-ef85-45b3-b50b-737436ae758a-manager-config\") pod \"lws-controller-manager-8444c4f6f9-nktbk\" (UID: \"63baaaab-ef85-45b3-b50b-737436ae758a\") " pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"
Jul 27 22:00:24.108125 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.108093    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63baaaab-ef85-45b3-b50b-737436ae758a-cert\") pod \"lws-controller-manager-8444c4f6f9-nktbk\" (UID: \"63baaaab-ef85-45b3-b50b-737436ae758a\") " pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"
Jul 27 22:00:24.109733 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.109705    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/63baaaab-ef85-45b3-b50b-737436ae758a-metrics-cert\") pod \"lws-controller-manager-8444c4f6f9-nktbk\" (UID: \"63baaaab-ef85-45b3-b50b-737436ae758a\") " pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"
Jul 27 22:00:24.115574 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.115541    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4qjt\" (UniqueName: \"kubernetes.io/projected/63baaaab-ef85-45b3-b50b-737436ae758a-kube-api-access-j4qjt\") pod \"lws-controller-manager-8444c4f6f9-nktbk\" (UID: \"63baaaab-ef85-45b3-b50b-737436ae758a\") " pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"
Jul 27 22:00:24.231735 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.231699    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"
Jul 27 22:00:24.370036 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.370003    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"]
Jul 27 22:00:24.373546 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:00:24.373518    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63baaaab_ef85_45b3_b50b_737436ae758a.slice/crio-00752fa068281d7bdc1cae7753eb4cc1fa6137189b392dc9a58849a5ed52defa WatchSource:0}: Error finding container 00752fa068281d7bdc1cae7753eb4cc1fa6137189b392dc9a58849a5ed52defa: Status 404 returned error can't find the container with id 00752fa068281d7bdc1cae7753eb4cc1fa6137189b392dc9a58849a5ed52defa
Jul 27 22:00:24.620907 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.620819    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"]
Jul 27 22:00:24.625137 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.625117    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.628751 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.628727    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5g57t\""
Jul 27 22:00:24.628857 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.628727    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 22:00:24.628914 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.628895    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 22:00:24.629087 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.629073    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 22:00:24.629126 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.629109    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 22:00:24.629188 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.629166    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 22:00:24.629388 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.629370    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 22:00:24.636791 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.636768    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"]
Jul 27 22:00:24.709995 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.709959    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/449f2f7f-1f03-494c-b28c-fbbb472bea86-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.709995 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.710004    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/449f2f7f-1f03-494c-b28c-fbbb472bea86-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.710224 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.710024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/449f2f7f-1f03-494c-b28c-fbbb472bea86-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.710224 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.710076    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/449f2f7f-1f03-494c-b28c-fbbb472bea86-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.710224 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.710168    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/449f2f7f-1f03-494c-b28c-fbbb472bea86-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.710321 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.710251    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7m8j\" (UniqueName: \"kubernetes.io/projected/449f2f7f-1f03-494c-b28c-fbbb472bea86-kube-api-access-h7m8j\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.710321 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.710287    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/449f2f7f-1f03-494c-b28c-fbbb472bea86-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.811245 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.811216    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/449f2f7f-1f03-494c-b28c-fbbb472bea86-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.811453 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.811265    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/449f2f7f-1f03-494c-b28c-fbbb472bea86-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.811453 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.811306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7m8j\" (UniqueName: \"kubernetes.io/projected/449f2f7f-1f03-494c-b28c-fbbb472bea86-kube-api-access-h7m8j\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.811453 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.811325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/449f2f7f-1f03-494c-b28c-fbbb472bea86-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.811453 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.811365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/449f2f7f-1f03-494c-b28c-fbbb472bea86-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.811453 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.811398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/449f2f7f-1f03-494c-b28c-fbbb472bea86-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.811453 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.811421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/449f2f7f-1f03-494c-b28c-fbbb472bea86-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.812207 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.812178    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/449f2f7f-1f03-494c-b28c-fbbb472bea86-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.813619 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.813595    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/449f2f7f-1f03-494c-b28c-fbbb472bea86-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.813699 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.813621    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/449f2f7f-1f03-494c-b28c-fbbb472bea86-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.813745 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.813704    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/449f2f7f-1f03-494c-b28c-fbbb472bea86-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.813745 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.813713    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/449f2f7f-1f03-494c-b28c-fbbb472bea86-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.820291 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.820269    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7m8j\" (UniqueName: \"kubernetes.io/projected/449f2f7f-1f03-494c-b28c-fbbb472bea86-kube-api-access-h7m8j\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.820407 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.820373    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/449f2f7f-1f03-494c-b28c-fbbb472bea86-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-n9gg8\" (UID: \"449f2f7f-1f03-494c-b28c-fbbb472bea86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:24.934476 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:24.934380    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:25.105622 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:25.105541    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"]
Jul 27 22:00:25.109591 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:00:25.109563    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449f2f7f_1f03_494c_b28c_fbbb472bea86.slice/crio-8489b32cdefd91151783463219437d03c56a0c9271a36a78983c959b556baf9a WatchSource:0}: Error finding container 8489b32cdefd91151783463219437d03c56a0c9271a36a78983c959b556baf9a: Status 404 returned error can't find the container with id 8489b32cdefd91151783463219437d03c56a0c9271a36a78983c959b556baf9a
Jul 27 22:00:25.383616 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:25.383581    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8" event={"ID":"449f2f7f-1f03-494c-b28c-fbbb472bea86","Type":"ContainerStarted","Data":"8489b32cdefd91151783463219437d03c56a0c9271a36a78983c959b556baf9a"}
Jul 27 22:00:25.384604 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:25.384584    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk" event={"ID":"63baaaab-ef85-45b3-b50b-737436ae758a","Type":"ContainerStarted","Data":"00752fa068281d7bdc1cae7753eb4cc1fa6137189b392dc9a58849a5ed52defa"}
Jul 27 22:00:27.396062 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:27.396025    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk" event={"ID":"63baaaab-ef85-45b3-b50b-737436ae758a","Type":"ContainerStarted","Data":"3c5bc36a4751f1f7311a484f2b74a54677ae02dddcb00e61a11e6b608b2d877b"}
Jul 27 22:00:27.396490 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:27.396172    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"
Jul 27 22:00:27.413268 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:27.413209    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk" podStartSLOduration=2.33088653 podStartE2EDuration="4.413194084s" totalImagesPullingTime="2.082307554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:00:27.412227398 +0000 UTC m=+372.153362175" watchObservedRunningTime="2026-07-27 22:00:27.413194084 +0000 UTC m=+372.154328850"
Jul 27 22:00:29.629947 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:29.629908    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 22:00:29.630173 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:29.629984    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 22:00:30.414956 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:30.414914    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8" event={"ID":"449f2f7f-1f03-494c-b28c-fbbb472bea86","Type":"ContainerStarted","Data":"6c1042fdc69d433f00211f51208929d8569601219ec869a6b394776f8a8a6869"}
Jul 27 22:00:30.415236 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:30.415106    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:30.416711 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:30.416678    2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-n9gg8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 22:00:30.416847 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:30.416766    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8" podUID="449f2f7f-1f03-494c-b28c-fbbb472bea86" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 22:00:30.438537 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:30.438483    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8" podStartSLOduration=1.920436197 podStartE2EDuration="6.438463592s" totalImagesPullingTime="4.518027395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:00:30.436180914 +0000 UTC m=+375.177315719" watchObservedRunningTime="2026-07-27 22:00:30.438463592 +0000 UTC m=+375.179598369"
Jul 27 22:00:31.419968 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:31.419939    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9gg8"
Jul 27 22:00:38.404459 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:00:38.404424    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"
Jul 27 22:02:07.616127 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:07.616085    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z7fxr"]
Jul 27 22:02:07.619643 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:07.619619    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z7fxr"
Jul 27 22:02:07.623206 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:07.623182    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 22:02:07.623363 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:07.623236    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 22:02:07.623484 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:07.623470    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gb9r2\""
Jul 27 22:02:07.635111 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:07.635087    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z7fxr"]
Jul 27 22:02:07.718942 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:07.718909    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z7fxr"]
Jul 27 22:02:07.719202 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:02:07.719183    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-dtd5g], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z7fxr" podUID="2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b"
Jul 27 22:02:07.734415 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:07.734383    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z7fxr\" (UID: \"2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z7fxr"
Jul 27 22:02:07.734545 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:07.734447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtd5g\" (UniqueName: \"kubernetes.io/projected/2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b-kube-api-access-dtd5g\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z7fxr\" (UID: \"2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z7fxr"
Jul 27 22:02:07.835104 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:07.835068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtd5g\" (UniqueName: \"kubernetes.io/projected/2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b-kube-api-access-dtd5g\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z7fxr\" (UID: \"2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z7fxr"
Jul 27 22:02:07.835290 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:07.835145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z7fxr\" (UID: \"2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z7fxr"
Jul 27 22:02:07.835537 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:07.835517    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z7fxr\" (UID: \"2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z7fxr"
Jul 27 22:02:07.853809 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:07.853771    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtd5g\" (UniqueName: \"kubernetes.io/projected/2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b-kube-api-access-dtd5g\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z7fxr\" (UID: \"2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z7fxr"
Jul 27 22:02:07.870284 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:07.870222    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z7fxr"
Jul 27 22:02:07.877121 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:07.877100    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z7fxr"
Jul 27 22:02:07.936298 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:07.936277    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtd5g\" (UniqueName: \"kubernetes.io/projected/2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b-kube-api-access-dtd5g\") pod \"2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b\" (UID: \"2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b\") "
Jul 27 22:02:07.936454 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:07.936327    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b-extensions-socket-volume\") pod \"2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b\" (UID: \"2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b\") "
Jul 27 22:02:07.936593 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:07.936569    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b" (UID: "2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 22:02:07.938383 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:07.938360    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b-kube-api-access-dtd5g" (OuterVolumeSpecName: "kube-api-access-dtd5g") pod "2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b" (UID: "2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b"). InnerVolumeSpecName "kube-api-access-dtd5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:02:08.037239 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:08.037194    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b-extensions-socket-volume\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:02:08.037239 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:08.037231    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtd5g\" (UniqueName: \"kubernetes.io/projected/2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b-kube-api-access-dtd5g\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:02:08.214056 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:08.214022    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z7fxr"]
Jul 27 22:02:08.225034 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:08.225004    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z7fxr"]
Jul 27 22:02:08.265869 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:08.265840    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6"]
Jul 27 22:02:08.269288 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:08.269263    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6"
Jul 27 22:02:08.290825 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:08.290798    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6"]
Jul 27 22:02:08.340511 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:08.340479    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmdd2\" (UniqueName: \"kubernetes.io/projected/0b6dc35b-b876-402c-8018-f350fc155c2e-kube-api-access-xmdd2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7mmt6\" (UID: \"0b6dc35b-b876-402c-8018-f350fc155c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6"
Jul 27 22:02:08.340659 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:08.340592    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b6dc35b-b876-402c-8018-f350fc155c2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7mmt6\" (UID: \"0b6dc35b-b876-402c-8018-f350fc155c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6"
Jul 27 22:02:08.441534 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:08.441499    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b6dc35b-b876-402c-8018-f350fc155c2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7mmt6\" (UID: \"0b6dc35b-b876-402c-8018-f350fc155c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6"
Jul 27 22:02:08.441696 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:08.441567    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmdd2\" (UniqueName: \"kubernetes.io/projected/0b6dc35b-b876-402c-8018-f350fc155c2e-kube-api-access-xmdd2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7mmt6\" (UID: \"0b6dc35b-b876-402c-8018-f350fc155c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6"
Jul 27 22:02:08.441878 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:08.441858    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b6dc35b-b876-402c-8018-f350fc155c2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7mmt6\" (UID: \"0b6dc35b-b876-402c-8018-f350fc155c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6"
Jul 27 22:02:08.450403 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:08.450380    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmdd2\" (UniqueName: \"kubernetes.io/projected/0b6dc35b-b876-402c-8018-f350fc155c2e-kube-api-access-xmdd2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7mmt6\" (UID: \"0b6dc35b-b876-402c-8018-f350fc155c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6"
Jul 27 22:02:08.581479 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:08.581383    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6"
Jul 27 22:02:08.714723 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:08.714693    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6"]
Jul 27 22:02:08.718585 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:02:08.718563    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b6dc35b_b876_402c_8018_f350fc155c2e.slice/crio-074ca3ea5702c4ef4396dd7501fb721850d119a64df4407597676bb4a6ad5103 WatchSource:0}: Error finding container 074ca3ea5702c4ef4396dd7501fb721850d119a64df4407597676bb4a6ad5103: Status 404 returned error can't find the container with id 074ca3ea5702c4ef4396dd7501fb721850d119a64df4407597676bb4a6ad5103
Jul 27 22:02:08.876176 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:08.876090    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6" event={"ID":"0b6dc35b-b876-402c-8018-f350fc155c2e","Type":"ContainerStarted","Data":"074ca3ea5702c4ef4396dd7501fb721850d119a64df4407597676bb4a6ad5103"}
Jul 27 22:02:08.876176 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:08.876112    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z7fxr"
Jul 27 22:02:08.878629 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:02:08.878607    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-z7fxr\" is forbidden: User \"system:node:ip-10-0-140-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-114.ec2.internal' and this object" podUID="2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z7fxr"
Jul 27 22:02:08.884544 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:02:08.884517    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-z7fxr\" is forbidden: User \"system:node:ip-10-0-140-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-114.ec2.internal' and this object" podUID="2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z7fxr"
Jul 27 22:02:09.818878 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:09.818827    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b" path="/var/lib/kubelet/pods/2241a4b3-f2cb-4faf-ae1e-b71a13ac6b7b/volumes"
Jul 27 22:02:13.915179 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:13.915083    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6" event={"ID":"0b6dc35b-b876-402c-8018-f350fc155c2e","Type":"ContainerStarted","Data":"88a821669864412ca501ad698a5d763e93ad3eb59f01ecf4a4b1f308ceb8676c"}
Jul 27 22:02:13.915623 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:13.915200    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6"
Jul 27 22:02:13.938038 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:13.937982    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6" podStartSLOduration=1.192511147 podStartE2EDuration="5.937963204s" totalImagesPullingTime="4.745452057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:02:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:02:13.936588867 +0000 UTC m=+478.677723660" watchObservedRunningTime="2026-07-27 22:02:13.937963204 +0000 UTC m=+478.679097975"
Jul 27 22:02:24.922016 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:24.921984    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6"
Jul 27 22:02:32.580137 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:32.580066    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6"]
Jul 27 22:02:32.580646 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:32.580347    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6" podUID="0b6dc35b-b876-402c-8018-f350fc155c2e" containerName="manager" containerID="cri-o://88a821669864412ca501ad698a5d763e93ad3eb59f01ecf4a4b1f308ceb8676c" gracePeriod=10
Jul 27 22:02:33.526557 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:33.526530    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6"
Jul 27 22:02:33.572985 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:33.572893    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmdd2\" (UniqueName: \"kubernetes.io/projected/0b6dc35b-b876-402c-8018-f350fc155c2e-kube-api-access-xmdd2\") pod \"0b6dc35b-b876-402c-8018-f350fc155c2e\" (UID: \"0b6dc35b-b876-402c-8018-f350fc155c2e\") "
Jul 27 22:02:33.573157 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:33.573010    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b6dc35b-b876-402c-8018-f350fc155c2e-extensions-socket-volume\") pod \"0b6dc35b-b876-402c-8018-f350fc155c2e\" (UID: \"0b6dc35b-b876-402c-8018-f350fc155c2e\") "
Jul 27 22:02:33.573392 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:33.573368    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b6dc35b-b876-402c-8018-f350fc155c2e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0b6dc35b-b876-402c-8018-f350fc155c2e" (UID: "0b6dc35b-b876-402c-8018-f350fc155c2e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 22:02:33.575110 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:33.575082    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b6dc35b-b876-402c-8018-f350fc155c2e-kube-api-access-xmdd2" (OuterVolumeSpecName: "kube-api-access-xmdd2") pod "0b6dc35b-b876-402c-8018-f350fc155c2e" (UID: "0b6dc35b-b876-402c-8018-f350fc155c2e"). InnerVolumeSpecName "kube-api-access-xmdd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:02:33.673767 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:33.673733    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmdd2\" (UniqueName: \"kubernetes.io/projected/0b6dc35b-b876-402c-8018-f350fc155c2e-kube-api-access-xmdd2\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:02:33.673767 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:33.673762    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b6dc35b-b876-402c-8018-f350fc155c2e-extensions-socket-volume\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:02:34.019311 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:34.019275    2565 generic.go:356] "Generic (PLEG): container finished" podID="0b6dc35b-b876-402c-8018-f350fc155c2e" containerID="88a821669864412ca501ad698a5d763e93ad3eb59f01ecf4a4b1f308ceb8676c" exitCode=0
Jul 27 22:02:34.019487 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:34.019324    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6"
Jul 27 22:02:34.019487 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:34.019365    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6" event={"ID":"0b6dc35b-b876-402c-8018-f350fc155c2e","Type":"ContainerDied","Data":"88a821669864412ca501ad698a5d763e93ad3eb59f01ecf4a4b1f308ceb8676c"}
Jul 27 22:02:34.019487 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:34.019424    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6" event={"ID":"0b6dc35b-b876-402c-8018-f350fc155c2e","Type":"ContainerDied","Data":"074ca3ea5702c4ef4396dd7501fb721850d119a64df4407597676bb4a6ad5103"}
Jul 27 22:02:34.019487 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:34.019453    2565 scope.go:117] "RemoveContainer" containerID="88a821669864412ca501ad698a5d763e93ad3eb59f01ecf4a4b1f308ceb8676c"
Jul 27 22:02:34.028233 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:34.028215    2565 scope.go:117] "RemoveContainer" containerID="88a821669864412ca501ad698a5d763e93ad3eb59f01ecf4a4b1f308ceb8676c"
Jul 27 22:02:34.028503 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:02:34.028487    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88a821669864412ca501ad698a5d763e93ad3eb59f01ecf4a4b1f308ceb8676c\": container with ID starting with 88a821669864412ca501ad698a5d763e93ad3eb59f01ecf4a4b1f308ceb8676c not found: ID does not exist" containerID="88a821669864412ca501ad698a5d763e93ad3eb59f01ecf4a4b1f308ceb8676c"
Jul 27 22:02:34.028562 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:34.028511    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88a821669864412ca501ad698a5d763e93ad3eb59f01ecf4a4b1f308ceb8676c"} err="failed to get container status \"88a821669864412ca501ad698a5d763e93ad3eb59f01ecf4a4b1f308ceb8676c\": rpc error: code = NotFound desc = could not find container \"88a821669864412ca501ad698a5d763e93ad3eb59f01ecf4a4b1f308ceb8676c\": container with ID starting with 88a821669864412ca501ad698a5d763e93ad3eb59f01ecf4a4b1f308ceb8676c not found: ID does not exist"
Jul 27 22:02:34.044544 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:34.044516    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6"]
Jul 27 22:02:34.057638 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:34.057612    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mmt6"]
Jul 27 22:02:35.816720 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:35.816689    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b6dc35b-b876-402c-8018-f350fc155c2e" path="/var/lib/kubelet/pods/0b6dc35b-b876-402c-8018-f350fc155c2e/volumes"
Jul 27 22:02:52.309167 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:52.309134    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-45btz"]
Jul 27 22:02:52.309551 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:52.309520    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b6dc35b-b876-402c-8018-f350fc155c2e" containerName="manager"
Jul 27 22:02:52.309551 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:52.309532    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b6dc35b-b876-402c-8018-f350fc155c2e" containerName="manager"
Jul 27 22:02:52.309624 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:52.309599    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b6dc35b-b876-402c-8018-f350fc155c2e" containerName="manager"
Jul 27 22:02:52.311574 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:52.311547    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-45btz"
Jul 27 22:02:52.314121 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:52.314100    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 22:02:52.314264 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:52.314167    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 22:02:52.314264 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:52.314217    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 22:02:52.315087 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:52.315070    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4h78d\""
Jul 27 22:02:52.326979 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:52.326955    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-45btz"]
Jul 27 22:02:52.409308 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:52.408978    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-45btz"]
Jul 27 22:02:52.447430 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:52.447391    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbp5t\" (UniqueName: \"kubernetes.io/projected/0f530464-ef11-4584-8db9-2c053ed2234d-kube-api-access-vbp5t\") pod \"limitador-limitador-64c94fd64f-45btz\" (UID: \"0f530464-ef11-4584-8db9-2c053ed2234d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-45btz"
Jul 27 22:02:52.447591 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:52.447498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f530464-ef11-4584-8db9-2c053ed2234d-config-file\") pod \"limitador-limitador-64c94fd64f-45btz\" (UID: \"0f530464-ef11-4584-8db9-2c053ed2234d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-45btz"
Jul 27 22:02:52.548268 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:52.548225    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbp5t\" (UniqueName: \"kubernetes.io/projected/0f530464-ef11-4584-8db9-2c053ed2234d-kube-api-access-vbp5t\") pod \"limitador-limitador-64c94fd64f-45btz\" (UID: \"0f530464-ef11-4584-8db9-2c053ed2234d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-45btz"
Jul 27 22:02:52.548452 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:52.548290    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f530464-ef11-4584-8db9-2c053ed2234d-config-file\") pod \"limitador-limitador-64c94fd64f-45btz\" (UID: \"0f530464-ef11-4584-8db9-2c053ed2234d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-45btz"
Jul 27 22:02:52.549001 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:52.548980    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f530464-ef11-4584-8db9-2c053ed2234d-config-file\") pod \"limitador-limitador-64c94fd64f-45btz\" (UID: \"0f530464-ef11-4584-8db9-2c053ed2234d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-45btz"
Jul 27 22:02:52.555685 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:52.555656    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbp5t\" (UniqueName: \"kubernetes.io/projected/0f530464-ef11-4584-8db9-2c053ed2234d-kube-api-access-vbp5t\") pod \"limitador-limitador-64c94fd64f-45btz\" (UID: \"0f530464-ef11-4584-8db9-2c053ed2234d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-45btz"
Jul 27 22:02:52.622724 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:52.622640    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-45btz"
Jul 27 22:02:52.749270 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:52.749242    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-45btz"]
Jul 27 22:02:52.751794 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:02:52.751765    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f530464_ef11_4584_8db9_2c053ed2234d.slice/crio-b09dd663aa5d82332944dee0450af34e21ad84f842bd4dcba9b821139c44698a WatchSource:0}: Error finding container b09dd663aa5d82332944dee0450af34e21ad84f842bd4dcba9b821139c44698a: Status 404 returned error can't find the container with id b09dd663aa5d82332944dee0450af34e21ad84f842bd4dcba9b821139c44698a
Jul 27 22:02:53.109617 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:53.109580    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-45btz" event={"ID":"0f530464-ef11-4584-8db9-2c053ed2234d","Type":"ContainerStarted","Data":"b09dd663aa5d82332944dee0450af34e21ad84f842bd4dcba9b821139c44698a"}
Jul 27 22:02:56.126041 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:56.125995    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-45btz" event={"ID":"0f530464-ef11-4584-8db9-2c053ed2234d","Type":"ContainerStarted","Data":"3826882a0ed624d5c14e054d8f5d6621e69a895304904acb43aaa7b596225a93"}
Jul 27 22:02:56.126605 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:56.126127    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-45btz"
Jul 27 22:02:56.144411 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:02:56.144358    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-45btz" podStartSLOduration=1.533904725 podStartE2EDuration="4.14432167s" totalImagesPullingTime="2.610416945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:02:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:02:56.142018705 +0000 UTC m=+520.883153524" watchObservedRunningTime="2026-07-27 22:02:56.14432167 +0000 UTC m=+520.885456513"
Jul 27 22:03:07.132739 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:07.132701    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-45btz"
Jul 27 22:03:09.720005 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:09.719966    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-45btz"]
Jul 27 22:03:09.720468 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:09.720226    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-45btz" podUID="0f530464-ef11-4584-8db9-2c053ed2234d" containerName="limitador" containerID="cri-o://3826882a0ed624d5c14e054d8f5d6621e69a895304904acb43aaa7b596225a93" gracePeriod=30
Jul 27 22:03:10.194511 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:10.194473    2565 generic.go:356] "Generic (PLEG): container finished" podID="0f530464-ef11-4584-8db9-2c053ed2234d" containerID="3826882a0ed624d5c14e054d8f5d6621e69a895304904acb43aaa7b596225a93" exitCode=0
Jul 27 22:03:10.194627 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:10.194530    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-45btz" event={"ID":"0f530464-ef11-4584-8db9-2c053ed2234d","Type":"ContainerDied","Data":"3826882a0ed624d5c14e054d8f5d6621e69a895304904acb43aaa7b596225a93"}
Jul 27 22:03:10.268945 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:10.268924    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-45btz"
Jul 27 22:03:10.410843 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:10.410759    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbp5t\" (UniqueName: \"kubernetes.io/projected/0f530464-ef11-4584-8db9-2c053ed2234d-kube-api-access-vbp5t\") pod \"0f530464-ef11-4584-8db9-2c053ed2234d\" (UID: \"0f530464-ef11-4584-8db9-2c053ed2234d\") "
Jul 27 22:03:10.410843 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:10.410830    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f530464-ef11-4584-8db9-2c053ed2234d-config-file\") pod \"0f530464-ef11-4584-8db9-2c053ed2234d\" (UID: \"0f530464-ef11-4584-8db9-2c053ed2234d\") "
Jul 27 22:03:10.411212 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:10.411187    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f530464-ef11-4584-8db9-2c053ed2234d-config-file" (OuterVolumeSpecName: "config-file") pod "0f530464-ef11-4584-8db9-2c053ed2234d" (UID: "0f530464-ef11-4584-8db9-2c053ed2234d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:03:10.412932 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:10.412913    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f530464-ef11-4584-8db9-2c053ed2234d-kube-api-access-vbp5t" (OuterVolumeSpecName: "kube-api-access-vbp5t") pod "0f530464-ef11-4584-8db9-2c053ed2234d" (UID: "0f530464-ef11-4584-8db9-2c053ed2234d"). InnerVolumeSpecName "kube-api-access-vbp5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:03:10.512111 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:10.512072    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbp5t\" (UniqueName: \"kubernetes.io/projected/0f530464-ef11-4584-8db9-2c053ed2234d-kube-api-access-vbp5t\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:03:10.512111 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:10.512104    2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f530464-ef11-4584-8db9-2c053ed2234d-config-file\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:03:11.200047 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:11.200017    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-45btz"
Jul 27 22:03:11.200500 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:11.200060    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-45btz" event={"ID":"0f530464-ef11-4584-8db9-2c053ed2234d","Type":"ContainerDied","Data":"b09dd663aa5d82332944dee0450af34e21ad84f842bd4dcba9b821139c44698a"}
Jul 27 22:03:11.200500 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:11.200120    2565 scope.go:117] "RemoveContainer" containerID="3826882a0ed624d5c14e054d8f5d6621e69a895304904acb43aaa7b596225a93"
Jul 27 22:03:11.222758 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:11.222725    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-45btz"]
Jul 27 22:03:11.226305 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:11.226284    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-45btz"]
Jul 27 22:03:11.817079 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:11.817049    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f530464-ef11-4584-8db9-2c053ed2234d" path="/var/lib/kubelet/pods/0f530464-ef11-4584-8db9-2c053ed2234d/volumes"
Jul 27 22:03:12.830904 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:12.830874    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ssqmd"]
Jul 27 22:03:12.831268 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:12.831257    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f530464-ef11-4584-8db9-2c053ed2234d" containerName="limitador"
Jul 27 22:03:12.831308 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:12.831269    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f530464-ef11-4584-8db9-2c053ed2234d" containerName="limitador"
Jul 27 22:03:12.831366 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:12.831329    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f530464-ef11-4584-8db9-2c053ed2234d" containerName="limitador"
Jul 27 22:03:12.835436 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:12.835417    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ssqmd"
Jul 27 22:03:12.837951 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:12.837923    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 27 22:03:12.837951 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:12.837952    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 22:03:12.838813 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:12.838797    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-wjbqv\""
Jul 27 22:03:12.838939 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:12.838869    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 22:03:12.841686 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:12.841663    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ssqmd"]
Jul 27 22:03:13.033897 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:13.033867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c3a8aab2-8b41-4aa2-a996-a8bcd21ddfb3-data\") pod \"postgres-69fb4594cf-ssqmd\" (UID: \"c3a8aab2-8b41-4aa2-a996-a8bcd21ddfb3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ssqmd"
Jul 27 22:03:13.034103 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:13.033913    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqx8s\" (UniqueName: \"kubernetes.io/projected/c3a8aab2-8b41-4aa2-a996-a8bcd21ddfb3-kube-api-access-dqx8s\") pod \"postgres-69fb4594cf-ssqmd\" (UID: \"c3a8aab2-8b41-4aa2-a996-a8bcd21ddfb3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ssqmd"
Jul 27 22:03:13.135150 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:13.135055    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c3a8aab2-8b41-4aa2-a996-a8bcd21ddfb3-data\") pod \"postgres-69fb4594cf-ssqmd\" (UID: \"c3a8aab2-8b41-4aa2-a996-a8bcd21ddfb3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ssqmd"
Jul 27 22:03:13.135150 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:13.135114    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqx8s\" (UniqueName: \"kubernetes.io/projected/c3a8aab2-8b41-4aa2-a996-a8bcd21ddfb3-kube-api-access-dqx8s\") pod \"postgres-69fb4594cf-ssqmd\" (UID: \"c3a8aab2-8b41-4aa2-a996-a8bcd21ddfb3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ssqmd"
Jul 27 22:03:13.135560 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:13.135536    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c3a8aab2-8b41-4aa2-a996-a8bcd21ddfb3-data\") pod \"postgres-69fb4594cf-ssqmd\" (UID: \"c3a8aab2-8b41-4aa2-a996-a8bcd21ddfb3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ssqmd"
Jul 27 22:03:13.144053 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:13.144025    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqx8s\" (UniqueName: \"kubernetes.io/projected/c3a8aab2-8b41-4aa2-a996-a8bcd21ddfb3-kube-api-access-dqx8s\") pod \"postgres-69fb4594cf-ssqmd\" (UID: \"c3a8aab2-8b41-4aa2-a996-a8bcd21ddfb3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ssqmd"
Jul 27 22:03:13.145808 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:13.145786    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ssqmd"
Jul 27 22:03:13.274914 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:13.274891    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ssqmd"]
Jul 27 22:03:13.277392 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:03:13.277363    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a8aab2_8b41_4aa2_a996_a8bcd21ddfb3.slice/crio-24175d43d81785744851a21e0e49a675af1893e135af771c0c75b4be5d278ce8 WatchSource:0}: Error finding container 24175d43d81785744851a21e0e49a675af1893e135af771c0c75b4be5d278ce8: Status 404 returned error can't find the container with id 24175d43d81785744851a21e0e49a675af1893e135af771c0c75b4be5d278ce8
Jul 27 22:03:14.221898 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:14.221818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ssqmd" event={"ID":"c3a8aab2-8b41-4aa2-a996-a8bcd21ddfb3","Type":"ContainerStarted","Data":"24175d43d81785744851a21e0e49a675af1893e135af771c0c75b4be5d278ce8"}
Jul 27 22:03:18.291487 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:18.291459    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 27 22:03:19.249301 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:19.249265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ssqmd" event={"ID":"c3a8aab2-8b41-4aa2-a996-a8bcd21ddfb3","Type":"ContainerStarted","Data":"737c2e4c51e1c7ab00baa944195dbc5d5f199af0ea821d0007524ffd30e56422"}
Jul 27 22:03:19.249489 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:19.249388    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ssqmd"
Jul 27 22:03:19.269434 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:19.269380    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ssqmd" podStartSLOduration=2.259582697 podStartE2EDuration="7.269360193s" totalImagesPullingTime="5.009777496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:03:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:03:19.268174253 +0000 UTC m=+544.009309021" watchObservedRunningTime="2026-07-27 22:03:19.269360193 +0000 UTC m=+544.010494962"
Jul 27 22:03:25.282099 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:25.282069    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ssqmd"
Jul 27 22:03:31.908745 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:31.908712    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76d6bcc65b-slfqb"]
Jul 27 22:03:31.930893 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:31.930867    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76d6bcc65b-slfqb"]
Jul 27 22:03:31.931040 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:31.930976    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76d6bcc65b-slfqb"
Jul 27 22:03:31.937908 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:31.937885    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 22:03:31.938192 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:31.938108    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nck8d\""
Jul 27 22:03:31.938294 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:31.938217    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 22:03:32.001193 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:32.001154    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc4ea6cc-30bd-4807-b4da-1b2aa8110687-webhook-cert\") pod \"maas-controller-76d6bcc65b-slfqb\" (UID: \"fc4ea6cc-30bd-4807-b4da-1b2aa8110687\") " pod="opendatahub/maas-controller-76d6bcc65b-slfqb"
Jul 27 22:03:32.001433 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:32.001330    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67kwf\" (UniqueName: \"kubernetes.io/projected/fc4ea6cc-30bd-4807-b4da-1b2aa8110687-kube-api-access-67kwf\") pod \"maas-controller-76d6bcc65b-slfqb\" (UID: \"fc4ea6cc-30bd-4807-b4da-1b2aa8110687\") " pod="opendatahub/maas-controller-76d6bcc65b-slfqb"
Jul 27 22:03:32.102142 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:32.102098    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67kwf\" (UniqueName: \"kubernetes.io/projected/fc4ea6cc-30bd-4807-b4da-1b2aa8110687-kube-api-access-67kwf\") pod \"maas-controller-76d6bcc65b-slfqb\" (UID: \"fc4ea6cc-30bd-4807-b4da-1b2aa8110687\") " pod="opendatahub/maas-controller-76d6bcc65b-slfqb"
Jul 27 22:03:32.102142 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:32.102149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc4ea6cc-30bd-4807-b4da-1b2aa8110687-webhook-cert\") pod \"maas-controller-76d6bcc65b-slfqb\" (UID: \"fc4ea6cc-30bd-4807-b4da-1b2aa8110687\") " pod="opendatahub/maas-controller-76d6bcc65b-slfqb"
Jul 27 22:03:32.104633 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:32.104610    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc4ea6cc-30bd-4807-b4da-1b2aa8110687-webhook-cert\") pod \"maas-controller-76d6bcc65b-slfqb\" (UID: \"fc4ea6cc-30bd-4807-b4da-1b2aa8110687\") " pod="opendatahub/maas-controller-76d6bcc65b-slfqb"
Jul 27 22:03:32.113712 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:32.113684    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67kwf\" (UniqueName: \"kubernetes.io/projected/fc4ea6cc-30bd-4807-b4da-1b2aa8110687-kube-api-access-67kwf\") pod \"maas-controller-76d6bcc65b-slfqb\" (UID: \"fc4ea6cc-30bd-4807-b4da-1b2aa8110687\") " pod="opendatahub/maas-controller-76d6bcc65b-slfqb"
Jul 27 22:03:32.129387 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:32.129359    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68bdf46b89-wwgr5"]
Jul 27 22:03:32.131737 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:32.131720    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68bdf46b89-wwgr5"
Jul 27 22:03:32.145299 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:32.145272    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68bdf46b89-wwgr5"]
Jul 27 22:03:32.203669 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:32.203572    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1db18dda-536b-41b4-aae6-1cba670fa1b2-webhook-cert\") pod \"maas-controller-68bdf46b89-wwgr5\" (UID: \"1db18dda-536b-41b4-aae6-1cba670fa1b2\") " pod="opendatahub/maas-controller-68bdf46b89-wwgr5"
Jul 27 22:03:32.203669 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:32.203619    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh6xx\" (UniqueName: \"kubernetes.io/projected/1db18dda-536b-41b4-aae6-1cba670fa1b2-kube-api-access-kh6xx\") pod \"maas-controller-68bdf46b89-wwgr5\" (UID: \"1db18dda-536b-41b4-aae6-1cba670fa1b2\") " pod="opendatahub/maas-controller-68bdf46b89-wwgr5"
Jul 27 22:03:32.241453 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:32.241418    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76d6bcc65b-slfqb"
Jul 27 22:03:32.306747 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:32.305773    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1db18dda-536b-41b4-aae6-1cba670fa1b2-webhook-cert\") pod \"maas-controller-68bdf46b89-wwgr5\" (UID: \"1db18dda-536b-41b4-aae6-1cba670fa1b2\") " pod="opendatahub/maas-controller-68bdf46b89-wwgr5"
Jul 27 22:03:32.306747 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:32.305837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh6xx\" (UniqueName: \"kubernetes.io/projected/1db18dda-536b-41b4-aae6-1cba670fa1b2-kube-api-access-kh6xx\") pod \"maas-controller-68bdf46b89-wwgr5\" (UID: \"1db18dda-536b-41b4-aae6-1cba670fa1b2\") " pod="opendatahub/maas-controller-68bdf46b89-wwgr5"
Jul 27 22:03:32.309326 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:32.309281    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1db18dda-536b-41b4-aae6-1cba670fa1b2-webhook-cert\") pod \"maas-controller-68bdf46b89-wwgr5\" (UID: \"1db18dda-536b-41b4-aae6-1cba670fa1b2\") " pod="opendatahub/maas-controller-68bdf46b89-wwgr5"
Jul 27 22:03:32.315047 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:32.315011    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh6xx\" (UniqueName: \"kubernetes.io/projected/1db18dda-536b-41b4-aae6-1cba670fa1b2-kube-api-access-kh6xx\") pod \"maas-controller-68bdf46b89-wwgr5\" (UID: \"1db18dda-536b-41b4-aae6-1cba670fa1b2\") " pod="opendatahub/maas-controller-68bdf46b89-wwgr5"
Jul 27 22:03:32.375618 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:32.375593    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76d6bcc65b-slfqb"]
Jul 27 22:03:32.377383 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:03:32.377359    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc4ea6cc_30bd_4807_b4da_1b2aa8110687.slice/crio-7a949c1e143425a5dda7dee2381a5a2d610b522a90a60095cdfb92813a1b189d WatchSource:0}: Error finding container 7a949c1e143425a5dda7dee2381a5a2d610b522a90a60095cdfb92813a1b189d: Status 404 returned error can't find the container with id 7a949c1e143425a5dda7dee2381a5a2d610b522a90a60095cdfb92813a1b189d
Jul 27 22:03:32.442137 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:32.442104    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68bdf46b89-wwgr5"
Jul 27 22:03:32.570497 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:32.570472    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68bdf46b89-wwgr5"]
Jul 27 22:03:32.572556 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:03:32.572532    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1db18dda_536b_41b4_aae6_1cba670fa1b2.slice/crio-67ae2b2baa33e4f32782a6884ee591c81613d1298d50c81bd7dd0d9e890c2270 WatchSource:0}: Error finding container 67ae2b2baa33e4f32782a6884ee591c81613d1298d50c81bd7dd0d9e890c2270: Status 404 returned error can't find the container with id 67ae2b2baa33e4f32782a6884ee591c81613d1298d50c81bd7dd0d9e890c2270
Jul 27 22:03:33.320782 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:33.320744    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68bdf46b89-wwgr5" event={"ID":"1db18dda-536b-41b4-aae6-1cba670fa1b2","Type":"ContainerStarted","Data":"67ae2b2baa33e4f32782a6884ee591c81613d1298d50c81bd7dd0d9e890c2270"}
Jul 27 22:03:33.322654 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:33.322590    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76d6bcc65b-slfqb" event={"ID":"fc4ea6cc-30bd-4807-b4da-1b2aa8110687","Type":"ContainerStarted","Data":"7a949c1e143425a5dda7dee2381a5a2d610b522a90a60095cdfb92813a1b189d"}
Jul 27 22:03:35.334812 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:35.334772    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76d6bcc65b-slfqb" event={"ID":"fc4ea6cc-30bd-4807-b4da-1b2aa8110687","Type":"ContainerStarted","Data":"96478c3c9db2bbfe49958b61361be7cb5945d6897bd8bc035a46d0e23c7caf5c"}
Jul 27 22:03:35.335300 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:35.334843    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76d6bcc65b-slfqb"
Jul 27 22:03:35.336626 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:35.336600    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68bdf46b89-wwgr5" event={"ID":"1db18dda-536b-41b4-aae6-1cba670fa1b2","Type":"ContainerStarted","Data":"ee3539f41fb4e20602740579e982f57058fc743de9c58da07f10b34dee2fd645"}
Jul 27 22:03:35.336754 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:35.336651    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68bdf46b89-wwgr5"
Jul 27 22:03:35.354569 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:35.354519    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76d6bcc65b-slfqb" podStartSLOduration=1.798711141 podStartE2EDuration="4.354505575s" totalImagesPullingTime="2.555794434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:03:35.351846543 +0000 UTC m=+560.092981312" watchObservedRunningTime="2026-07-27 22:03:35.354505575 +0000 UTC m=+560.095640342"
Jul 27 22:03:35.374479 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:35.374428    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68bdf46b89-wwgr5" podStartSLOduration=1.00684812 podStartE2EDuration="3.374411584s" totalImagesPullingTime="2.367563464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:03:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:03:35.372875749 +0000 UTC m=+560.114010518" watchObservedRunningTime="2026-07-27 22:03:35.374411584 +0000 UTC m=+560.115546351"
Jul 27 22:03:46.344244 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:46.344211    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68bdf46b89-wwgr5"
Jul 27 22:03:46.344656 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:46.344290    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76d6bcc65b-slfqb"
Jul 27 22:03:46.408400 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:46.408371    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76d6bcc65b-slfqb"]
Jul 27 22:03:46.408573 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:46.408541    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76d6bcc65b-slfqb" podUID="fc4ea6cc-30bd-4807-b4da-1b2aa8110687" containerName="manager" containerID="cri-o://96478c3c9db2bbfe49958b61361be7cb5945d6897bd8bc035a46d0e23c7caf5c" gracePeriod=30
Jul 27 22:03:46.651867 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:46.651842    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76d6bcc65b-slfqb"
Jul 27 22:03:46.745646 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:46.745612    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67kwf\" (UniqueName: \"kubernetes.io/projected/fc4ea6cc-30bd-4807-b4da-1b2aa8110687-kube-api-access-67kwf\") pod \"fc4ea6cc-30bd-4807-b4da-1b2aa8110687\" (UID: \"fc4ea6cc-30bd-4807-b4da-1b2aa8110687\") "
Jul 27 22:03:46.745646 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:46.745647    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc4ea6cc-30bd-4807-b4da-1b2aa8110687-webhook-cert\") pod \"fc4ea6cc-30bd-4807-b4da-1b2aa8110687\" (UID: \"fc4ea6cc-30bd-4807-b4da-1b2aa8110687\") "
Jul 27 22:03:46.747773 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:46.747739    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc4ea6cc-30bd-4807-b4da-1b2aa8110687-kube-api-access-67kwf" (OuterVolumeSpecName: "kube-api-access-67kwf") pod "fc4ea6cc-30bd-4807-b4da-1b2aa8110687" (UID: "fc4ea6cc-30bd-4807-b4da-1b2aa8110687"). InnerVolumeSpecName "kube-api-access-67kwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:03:46.747773 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:46.747752    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc4ea6cc-30bd-4807-b4da-1b2aa8110687-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fc4ea6cc-30bd-4807-b4da-1b2aa8110687" (UID: "fc4ea6cc-30bd-4807-b4da-1b2aa8110687"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:03:46.846384 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:46.846360    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67kwf\" (UniqueName: \"kubernetes.io/projected/fc4ea6cc-30bd-4807-b4da-1b2aa8110687-kube-api-access-67kwf\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:03:46.846384 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:46.846382    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc4ea6cc-30bd-4807-b4da-1b2aa8110687-webhook-cert\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:03:47.397020 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:47.396986    2565 generic.go:356] "Generic (PLEG): container finished" podID="fc4ea6cc-30bd-4807-b4da-1b2aa8110687" containerID="96478c3c9db2bbfe49958b61361be7cb5945d6897bd8bc035a46d0e23c7caf5c" exitCode=0
Jul 27 22:03:47.397551 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:47.397032    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76d6bcc65b-slfqb" event={"ID":"fc4ea6cc-30bd-4807-b4da-1b2aa8110687","Type":"ContainerDied","Data":"96478c3c9db2bbfe49958b61361be7cb5945d6897bd8bc035a46d0e23c7caf5c"}
Jul 27 22:03:47.397551 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:47.397066    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76d6bcc65b-slfqb" event={"ID":"fc4ea6cc-30bd-4807-b4da-1b2aa8110687","Type":"ContainerDied","Data":"7a949c1e143425a5dda7dee2381a5a2d610b522a90a60095cdfb92813a1b189d"}
Jul 27 22:03:47.397551 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:47.397088    2565 scope.go:117] "RemoveContainer" containerID="96478c3c9db2bbfe49958b61361be7cb5945d6897bd8bc035a46d0e23c7caf5c"
Jul 27 22:03:47.397551 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:47.397032    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76d6bcc65b-slfqb"
Jul 27 22:03:47.409488 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:47.409308    2565 scope.go:117] "RemoveContainer" containerID="96478c3c9db2bbfe49958b61361be7cb5945d6897bd8bc035a46d0e23c7caf5c"
Jul 27 22:03:47.409659 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:03:47.409634    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96478c3c9db2bbfe49958b61361be7cb5945d6897bd8bc035a46d0e23c7caf5c\": container with ID starting with 96478c3c9db2bbfe49958b61361be7cb5945d6897bd8bc035a46d0e23c7caf5c not found: ID does not exist" containerID="96478c3c9db2bbfe49958b61361be7cb5945d6897bd8bc035a46d0e23c7caf5c"
Jul 27 22:03:47.409725 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:47.409673    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96478c3c9db2bbfe49958b61361be7cb5945d6897bd8bc035a46d0e23c7caf5c"} err="failed to get container status \"96478c3c9db2bbfe49958b61361be7cb5945d6897bd8bc035a46d0e23c7caf5c\": rpc error: code = NotFound desc = could not find container \"96478c3c9db2bbfe49958b61361be7cb5945d6897bd8bc035a46d0e23c7caf5c\": container with ID starting with 96478c3c9db2bbfe49958b61361be7cb5945d6897bd8bc035a46d0e23c7caf5c not found: ID does not exist"
Jul 27 22:03:47.427910 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:47.427887    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76d6bcc65b-slfqb"]
Jul 27 22:03:47.430719 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:47.430697    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76d6bcc65b-slfqb"]
Jul 27 22:03:47.816230 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:03:47.816199    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc4ea6cc-30bd-4807-b4da-1b2aa8110687" path="/var/lib/kubelet/pods/fc4ea6cc-30bd-4807-b4da-1b2aa8110687/volumes"
Jul 27 22:04:07.779091 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:07.779057    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5c6b8f6b54-c8r9c"]
Jul 27 22:04:07.779643 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:07.779502    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc4ea6cc-30bd-4807-b4da-1b2aa8110687" containerName="manager"
Jul 27 22:04:07.779643 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:07.779515    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc4ea6cc-30bd-4807-b4da-1b2aa8110687" containerName="manager"
Jul 27 22:04:07.779643 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:07.779587    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc4ea6cc-30bd-4807-b4da-1b2aa8110687" containerName="manager"
Jul 27 22:04:07.784283 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:07.784261    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c6b8f6b54-c8r9c"
Jul 27 22:04:07.786985 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:07.786953    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 27 22:04:07.787118 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:07.786990    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c8nhg\""
Jul 27 22:04:07.793674 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:07.793643    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c6b8f6b54-c8r9c"]
Jul 27 22:04:07.839251 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:07.839223    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xm9j\" (UniqueName: \"kubernetes.io/projected/52e0e968-50d1-4be8-bd61-d3d9036b1fe5-kube-api-access-5xm9j\") pod \"maas-api-5c6b8f6b54-c8r9c\" (UID: \"52e0e968-50d1-4be8-bd61-d3d9036b1fe5\") " pod="odh-ai-gateway-infra/maas-api-5c6b8f6b54-c8r9c"
Jul 27 22:04:07.839430 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:07.839290    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52e0e968-50d1-4be8-bd61-d3d9036b1fe5-openshift-service-ca\") pod \"maas-api-5c6b8f6b54-c8r9c\" (UID: \"52e0e968-50d1-4be8-bd61-d3d9036b1fe5\") " pod="odh-ai-gateway-infra/maas-api-5c6b8f6b54-c8r9c"
Jul 27 22:04:07.839430 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:07.839391    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52e0e968-50d1-4be8-bd61-d3d9036b1fe5-maas-api-tls\") pod \"maas-api-5c6b8f6b54-c8r9c\" (UID: \"52e0e968-50d1-4be8-bd61-d3d9036b1fe5\") " pod="odh-ai-gateway-infra/maas-api-5c6b8f6b54-c8r9c"
Jul 27 22:04:07.940595 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:07.940556    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52e0e968-50d1-4be8-bd61-d3d9036b1fe5-openshift-service-ca\") pod \"maas-api-5c6b8f6b54-c8r9c\" (UID: \"52e0e968-50d1-4be8-bd61-d3d9036b1fe5\") " pod="odh-ai-gateway-infra/maas-api-5c6b8f6b54-c8r9c"
Jul 27 22:04:07.940595 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:07.940599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52e0e968-50d1-4be8-bd61-d3d9036b1fe5-maas-api-tls\") pod \"maas-api-5c6b8f6b54-c8r9c\" (UID: \"52e0e968-50d1-4be8-bd61-d3d9036b1fe5\") " pod="odh-ai-gateway-infra/maas-api-5c6b8f6b54-c8r9c"
Jul 27 22:04:07.940812 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:07.940647    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xm9j\" (UniqueName: \"kubernetes.io/projected/52e0e968-50d1-4be8-bd61-d3d9036b1fe5-kube-api-access-5xm9j\") pod \"maas-api-5c6b8f6b54-c8r9c\" (UID: \"52e0e968-50d1-4be8-bd61-d3d9036b1fe5\") " pod="odh-ai-gateway-infra/maas-api-5c6b8f6b54-c8r9c"
Jul 27 22:04:07.941330 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:07.941311    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52e0e968-50d1-4be8-bd61-d3d9036b1fe5-openshift-service-ca\") pod \"maas-api-5c6b8f6b54-c8r9c\" (UID: \"52e0e968-50d1-4be8-bd61-d3d9036b1fe5\") " pod="odh-ai-gateway-infra/maas-api-5c6b8f6b54-c8r9c"
Jul 27 22:04:07.943131 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:07.943111    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52e0e968-50d1-4be8-bd61-d3d9036b1fe5-maas-api-tls\") pod \"maas-api-5c6b8f6b54-c8r9c\" (UID: \"52e0e968-50d1-4be8-bd61-d3d9036b1fe5\") " pod="odh-ai-gateway-infra/maas-api-5c6b8f6b54-c8r9c"
Jul 27 22:04:07.949595 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:07.949568    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xm9j\" (UniqueName: \"kubernetes.io/projected/52e0e968-50d1-4be8-bd61-d3d9036b1fe5-kube-api-access-5xm9j\") pod \"maas-api-5c6b8f6b54-c8r9c\" (UID: \"52e0e968-50d1-4be8-bd61-d3d9036b1fe5\") " pod="odh-ai-gateway-infra/maas-api-5c6b8f6b54-c8r9c"
Jul 27 22:04:08.096750 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.096662    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c6b8f6b54-c8r9c"
Jul 27 22:04:08.236798 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.236772    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c6b8f6b54-c8r9c"]
Jul 27 22:04:08.238978 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:04:08.238952    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52e0e968_50d1_4be8_bd61_d3d9036b1fe5.slice/crio-47ef9ce75ccbc3129f36f02958f750f803dd3d05985fe2a3fbc945644f9bce07 WatchSource:0}: Error finding container 47ef9ce75ccbc3129f36f02958f750f803dd3d05985fe2a3fbc945644f9bce07: Status 404 returned error can't find the container with id 47ef9ce75ccbc3129f36f02958f750f803dd3d05985fe2a3fbc945644f9bce07
Jul 27 22:04:08.430589 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.430501    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-gp7lh"]
Jul 27 22:04:08.436955 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.436923    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gp7lh"
Jul 27 22:04:08.439889 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.439855    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 27 22:04:08.440255 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.440238    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vp2sv\""
Jul 27 22:04:08.444672 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.444648    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-gp7lh"]
Jul 27 22:04:08.464424 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.464393    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-7pxk8"]
Jul 27 22:04:08.470574 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.470554    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-7pxk8"
Jul 27 22:04:08.477162 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.477133    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-7pxk8"]
Jul 27 22:04:08.505128 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.505096    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c6b8f6b54-c8r9c" event={"ID":"52e0e968-50d1-4be8-bd61-d3d9036b1fe5","Type":"ContainerStarted","Data":"47ef9ce75ccbc3129f36f02958f750f803dd3d05985fe2a3fbc945644f9bce07"}
Jul 27 22:04:08.545711 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.545677    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpsxj\" (UniqueName: \"kubernetes.io/projected/7f7aa7fc-a680-4f6c-ac91-b8eaf74b1b99-kube-api-access-xpsxj\") pod \"payload-pre-processing-687dbb6cf6-gp7lh\" (UID: \"7f7aa7fc-a680-4f6c-ac91-b8eaf74b1b99\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gp7lh"
Jul 27 22:04:08.545839 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.545722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f7aa7fc-a680-4f6c-ac91-b8eaf74b1b99-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-gp7lh\" (UID: \"7f7aa7fc-a680-4f6c-ac91-b8eaf74b1b99\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gp7lh"
Jul 27 22:04:08.545839 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.545749    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw8gn\" (UniqueName: \"kubernetes.io/projected/0b3cc73b-6e37-4897-af8c-00f6f8bece07-kube-api-access-mw8gn\") pod \"payload-processing-5cc6cd444b-7pxk8\" (UID: \"0b3cc73b-6e37-4897-af8c-00f6f8bece07\") " pod="openshift-ingress/payload-processing-5cc6cd444b-7pxk8"
Jul 27 22:04:08.545839 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.545822    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b3cc73b-6e37-4897-af8c-00f6f8bece07-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-7pxk8\" (UID: \"0b3cc73b-6e37-4897-af8c-00f6f8bece07\") " pod="openshift-ingress/payload-processing-5cc6cd444b-7pxk8"
Jul 27 22:04:08.647244 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.647210    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpsxj\" (UniqueName: \"kubernetes.io/projected/7f7aa7fc-a680-4f6c-ac91-b8eaf74b1b99-kube-api-access-xpsxj\") pod \"payload-pre-processing-687dbb6cf6-gp7lh\" (UID: \"7f7aa7fc-a680-4f6c-ac91-b8eaf74b1b99\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gp7lh"
Jul 27 22:04:08.647468 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.647270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f7aa7fc-a680-4f6c-ac91-b8eaf74b1b99-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-gp7lh\" (UID: \"7f7aa7fc-a680-4f6c-ac91-b8eaf74b1b99\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gp7lh"
Jul 27 22:04:08.647468 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.647297    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw8gn\" (UniqueName: \"kubernetes.io/projected/0b3cc73b-6e37-4897-af8c-00f6f8bece07-kube-api-access-mw8gn\") pod \"payload-processing-5cc6cd444b-7pxk8\" (UID: \"0b3cc73b-6e37-4897-af8c-00f6f8bece07\") " pod="openshift-ingress/payload-processing-5cc6cd444b-7pxk8"
Jul 27 22:04:08.647468 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.647429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b3cc73b-6e37-4897-af8c-00f6f8bece07-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-7pxk8\" (UID: \"0b3cc73b-6e37-4897-af8c-00f6f8bece07\") " pod="openshift-ingress/payload-processing-5cc6cd444b-7pxk8"
Jul 27 22:04:08.648071 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.648048    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f7aa7fc-a680-4f6c-ac91-b8eaf74b1b99-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-gp7lh\" (UID: \"7f7aa7fc-a680-4f6c-ac91-b8eaf74b1b99\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gp7lh"
Jul 27 22:04:08.648195 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.648176    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b3cc73b-6e37-4897-af8c-00f6f8bece07-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-7pxk8\" (UID: \"0b3cc73b-6e37-4897-af8c-00f6f8bece07\") " pod="openshift-ingress/payload-processing-5cc6cd444b-7pxk8"
Jul 27 22:04:08.655600 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.655575    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw8gn\" (UniqueName: \"kubernetes.io/projected/0b3cc73b-6e37-4897-af8c-00f6f8bece07-kube-api-access-mw8gn\") pod \"payload-processing-5cc6cd444b-7pxk8\" (UID: \"0b3cc73b-6e37-4897-af8c-00f6f8bece07\") " pod="openshift-ingress/payload-processing-5cc6cd444b-7pxk8"
Jul 27 22:04:08.655723 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.655661    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpsxj\" (UniqueName: \"kubernetes.io/projected/7f7aa7fc-a680-4f6c-ac91-b8eaf74b1b99-kube-api-access-xpsxj\") pod \"payload-pre-processing-687dbb6cf6-gp7lh\" (UID: \"7f7aa7fc-a680-4f6c-ac91-b8eaf74b1b99\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gp7lh"
Jul 27 22:04:08.750126 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.750092    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gp7lh"
Jul 27 22:04:08.781817 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.781786    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-7pxk8"
Jul 27 22:04:08.892351 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.892304    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-gp7lh"]
Jul 27 22:04:08.894866 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:04:08.894838    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f7aa7fc_a680_4f6c_ac91_b8eaf74b1b99.slice/crio-e780cc128d76e711969667e0952b152fca39be5db6b0c2166c9d946b2c46b9b2 WatchSource:0}: Error finding container e780cc128d76e711969667e0952b152fca39be5db6b0c2166c9d946b2c46b9b2: Status 404 returned error can't find the container with id e780cc128d76e711969667e0952b152fca39be5db6b0c2166c9d946b2c46b9b2
Jul 27 22:04:08.926119 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:08.926091    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-7pxk8"]
Jul 27 22:04:08.928569 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:04:08.928540    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3cc73b_6e37_4897_af8c_00f6f8bece07.slice/crio-e36cc8a6edd7f809039899c66631fcfe3fca34272809e942af6fa8e0e7e9b395 WatchSource:0}: Error finding container e36cc8a6edd7f809039899c66631fcfe3fca34272809e942af6fa8e0e7e9b395: Status 404 returned error can't find the container with id e36cc8a6edd7f809039899c66631fcfe3fca34272809e942af6fa8e0e7e9b395
Jul 27 22:04:09.516238 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:09.516103    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-7pxk8" event={"ID":"0b3cc73b-6e37-4897-af8c-00f6f8bece07","Type":"ContainerStarted","Data":"e36cc8a6edd7f809039899c66631fcfe3fca34272809e942af6fa8e0e7e9b395"}
Jul 27 22:04:09.519757 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:09.519659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gp7lh" event={"ID":"7f7aa7fc-a680-4f6c-ac91-b8eaf74b1b99","Type":"ContainerStarted","Data":"e780cc128d76e711969667e0952b152fca39be5db6b0c2166c9d946b2c46b9b2"}
Jul 27 22:04:10.529440 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:10.529402    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c6b8f6b54-c8r9c" event={"ID":"52e0e968-50d1-4be8-bd61-d3d9036b1fe5","Type":"ContainerStarted","Data":"e3d074b27faae3097f49c7e62b022e2c8c8e6a61fb2485064f2e6e6db9124009"}
Jul 27 22:04:10.529933 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:10.529561    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5c6b8f6b54-c8r9c"
Jul 27 22:04:10.548181 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:10.548122    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5c6b8f6b54-c8r9c" podStartSLOduration=1.461301955 podStartE2EDuration="3.548106593s" totalImagesPullingTime="2.086804638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:04:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:04:10.545462673 +0000 UTC m=+595.286597464" watchObservedRunningTime="2026-07-27 22:04:10.548106593 +0000 UTC m=+595.289241361"
Jul 27 22:04:11.537120 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:11.537076    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gp7lh" event={"ID":"7f7aa7fc-a680-4f6c-ac91-b8eaf74b1b99","Type":"ContainerStarted","Data":"5c848070aa958f83fd32897d621b4257cc3835a3609b2ca6dfd467672fe066f6"}
Jul 27 22:04:11.537636 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:11.537148    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gp7lh"
Jul 27 22:04:11.538719 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:11.538693    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-7pxk8" event={"ID":"0b3cc73b-6e37-4897-af8c-00f6f8bece07","Type":"ContainerStarted","Data":"b56dbd150295653fdfc83f3b50809966b1c324eadcdb93843ea5052cd49f01fd"}
Jul 27 22:04:11.538838 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:11.538762    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-7pxk8"
Jul 27 22:04:11.555994 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:11.555928    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gp7lh" podStartSLOduration=1.6500330760000002 podStartE2EDuration="3.55590807s" totalImagesPullingTime="1.905874994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:04:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:04:11.553354011 +0000 UTC m=+596.294488777" watchObservedRunningTime="2026-07-27 22:04:11.55590807 +0000 UTC m=+596.297042840"
Jul 27 22:04:11.571746 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:11.571692    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-7pxk8" podStartSLOduration=1.704871327 podStartE2EDuration="3.571674003s" totalImagesPullingTime="1.866802676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:04:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:04:11.570611399 +0000 UTC m=+596.311746183" watchObservedRunningTime="2026-07-27 22:04:11.571674003 +0000 UTC m=+596.312808771"
Jul 27 22:04:16.544441 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:16.544414    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5c6b8f6b54-c8r9c"
Jul 27 22:04:22.546030 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:22.546000    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gp7lh"
Jul 27 22:04:22.546441 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:22.546150    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-7pxk8"
Jul 27 22:04:43.660562 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.660478    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"]
Jul 27 22:04:43.664317 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.664300    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:43.666999 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.666969    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 27 22:04:43.667124 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.667059    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 22:04:43.668016 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.668001    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 22:04:43.668067 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.668004    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mjxw8\""
Jul 27 22:04:43.674542 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.674521    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"]
Jul 27 22:04:43.784078 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.784035    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0a8eae4-940c-46d2-8bb4-791c7d531800-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c\" (UID: \"d0a8eae4-940c-46d2-8bb4-791c7d531800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:43.784078 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.784081    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a8eae4-940c-46d2-8bb4-791c7d531800-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c\" (UID: \"d0a8eae4-940c-46d2-8bb4-791c7d531800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:43.784298 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.784103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0a8eae4-940c-46d2-8bb4-791c7d531800-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c\" (UID: \"d0a8eae4-940c-46d2-8bb4-791c7d531800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:43.784298 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.784200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0a8eae4-940c-46d2-8bb4-791c7d531800-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c\" (UID: \"d0a8eae4-940c-46d2-8bb4-791c7d531800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:43.784298 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.784229    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss8zg\" (UniqueName: \"kubernetes.io/projected/d0a8eae4-940c-46d2-8bb4-791c7d531800-kube-api-access-ss8zg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c\" (UID: \"d0a8eae4-940c-46d2-8bb4-791c7d531800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:43.784298 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.784254    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0a8eae4-940c-46d2-8bb4-791c7d531800-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c\" (UID: \"d0a8eae4-940c-46d2-8bb4-791c7d531800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:43.885287 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.885253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0a8eae4-940c-46d2-8bb4-791c7d531800-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c\" (UID: \"d0a8eae4-940c-46d2-8bb4-791c7d531800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:43.885475 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.885303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a8eae4-940c-46d2-8bb4-791c7d531800-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c\" (UID: \"d0a8eae4-940c-46d2-8bb4-791c7d531800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:43.885475 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.885430    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0a8eae4-940c-46d2-8bb4-791c7d531800-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c\" (UID: \"d0a8eae4-940c-46d2-8bb4-791c7d531800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:43.885572 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.885514    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0a8eae4-940c-46d2-8bb4-791c7d531800-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c\" (UID: \"d0a8eae4-940c-46d2-8bb4-791c7d531800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:43.885572 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.885544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss8zg\" (UniqueName: \"kubernetes.io/projected/d0a8eae4-940c-46d2-8bb4-791c7d531800-kube-api-access-ss8zg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c\" (UID: \"d0a8eae4-940c-46d2-8bb4-791c7d531800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:43.885676 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.885577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0a8eae4-940c-46d2-8bb4-791c7d531800-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c\" (UID: \"d0a8eae4-940c-46d2-8bb4-791c7d531800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:43.885676 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.885637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a8eae4-940c-46d2-8bb4-791c7d531800-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c\" (UID: \"d0a8eae4-940c-46d2-8bb4-791c7d531800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:43.885778 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.885689    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0a8eae4-940c-46d2-8bb4-791c7d531800-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c\" (UID: \"d0a8eae4-940c-46d2-8bb4-791c7d531800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:43.885833 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.885772    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0a8eae4-940c-46d2-8bb4-791c7d531800-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c\" (UID: \"d0a8eae4-940c-46d2-8bb4-791c7d531800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:43.887717 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.887695    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0a8eae4-940c-46d2-8bb4-791c7d531800-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c\" (UID: \"d0a8eae4-940c-46d2-8bb4-791c7d531800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:43.888090 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.888069    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0a8eae4-940c-46d2-8bb4-791c7d531800-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c\" (UID: \"d0a8eae4-940c-46d2-8bb4-791c7d531800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:43.896099 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.896073    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss8zg\" (UniqueName: \"kubernetes.io/projected/d0a8eae4-940c-46d2-8bb4-791c7d531800-kube-api-access-ss8zg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c\" (UID: \"d0a8eae4-940c-46d2-8bb4-791c7d531800\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:43.975029 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:43.974992    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:44.116422 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:44.116394    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"]
Jul 27 22:04:44.118566 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:04:44.118539    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0a8eae4_940c_46d2_8bb4_791c7d531800.slice/crio-d283ffafe00b602b289719282a82eeee1a2a8f5f5938bcb3d731b5473aac0224 WatchSource:0}: Error finding container d283ffafe00b602b289719282a82eeee1a2a8f5f5938bcb3d731b5473aac0224: Status 404 returned error can't find the container with id d283ffafe00b602b289719282a82eeee1a2a8f5f5938bcb3d731b5473aac0224
Jul 27 22:04:44.120049 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:44.120027    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 22:04:44.708440 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:44.708400    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c" event={"ID":"d0a8eae4-940c-46d2-8bb4-791c7d531800","Type":"ContainerStarted","Data":"d283ffafe00b602b289719282a82eeee1a2a8f5f5938bcb3d731b5473aac0224"}
Jul 27 22:04:45.714622 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:45.714579    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c" event={"ID":"d0a8eae4-940c-46d2-8bb4-791c7d531800","Type":"ContainerStarted","Data":"c06a21c650b753e2752935fdaff4a412a4d0995a374c164784f8f383b7d01cee"}
Jul 27 22:04:45.733393 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:45.733326    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c" podStartSLOduration=1.570756464 podStartE2EDuration="2.73331061s" totalImagesPullingTime="1.162554146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:04:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:04:45.731373815 +0000 UTC m=+630.472508583" watchObservedRunningTime="2026-07-27 22:04:45.73331061 +0000 UTC m=+630.474445377"
Jul 27 22:04:53.975943 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:53.975904    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:53.976373 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:53.975973    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:53.988543 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:53.988516    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:54.767561 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:54.767530    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c"
Jul 27 22:04:55.762409 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:55.762373    2565 generic.go:356] "Generic (PLEG): container finished" podID="63baaaab-ef85-45b3-b50b-737436ae758a" containerID="3c5bc36a4751f1f7311a484f2b74a54677ae02dddcb00e61a11e6b608b2d877b" exitCode=1
Jul 27 22:04:55.762800 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:55.762448    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk" event={"ID":"63baaaab-ef85-45b3-b50b-737436ae758a","Type":"ContainerDied","Data":"3c5bc36a4751f1f7311a484f2b74a54677ae02dddcb00e61a11e6b608b2d877b"}
Jul 27 22:04:55.762955 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:55.762939    2565 scope.go:117] "RemoveContainer" containerID="3c5bc36a4751f1f7311a484f2b74a54677ae02dddcb00e61a11e6b608b2d877b"
Jul 27 22:04:56.769317 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:56.769284    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk" event={"ID":"63baaaab-ef85-45b3-b50b-737436ae758a","Type":"ContainerStarted","Data":"88b28bfa1f7411181ca2ad32846ed04edf6fb527dc176291b17c5399877788cc"}
Jul 27 22:04:56.769715 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:04:56.769497    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"
Jul 27 22:05:07.066196 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.066161    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"]
Jul 27 22:05:07.070076 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.070056    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:07.072877 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.072849    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 27 22:05:07.084251 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.084228    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"]
Jul 27 22:05:07.110824 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.110785    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm2fb\" (UniqueName: \"kubernetes.io/projected/1474d49c-d080-461e-ac4d-55697bf83430-kube-api-access-zm2fb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kmp66\" (UID: \"1474d49c-d080-461e-ac4d-55697bf83430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:07.110966 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.110833    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1474d49c-d080-461e-ac4d-55697bf83430-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kmp66\" (UID: \"1474d49c-d080-461e-ac4d-55697bf83430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:07.110966 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.110944    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1474d49c-d080-461e-ac4d-55697bf83430-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kmp66\" (UID: \"1474d49c-d080-461e-ac4d-55697bf83430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:07.110966 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.110962    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1474d49c-d080-461e-ac4d-55697bf83430-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kmp66\" (UID: \"1474d49c-d080-461e-ac4d-55697bf83430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:07.111084 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.111032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1474d49c-d080-461e-ac4d-55697bf83430-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kmp66\" (UID: \"1474d49c-d080-461e-ac4d-55697bf83430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:07.111084 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.111054    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1474d49c-d080-461e-ac4d-55697bf83430-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kmp66\" (UID: \"1474d49c-d080-461e-ac4d-55697bf83430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:07.212048 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.212009    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1474d49c-d080-461e-ac4d-55697bf83430-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kmp66\" (UID: \"1474d49c-d080-461e-ac4d-55697bf83430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:07.212048 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.212051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1474d49c-d080-461e-ac4d-55697bf83430-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kmp66\" (UID: \"1474d49c-d080-461e-ac4d-55697bf83430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:07.212284 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.212093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1474d49c-d080-461e-ac4d-55697bf83430-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kmp66\" (UID: \"1474d49c-d080-461e-ac4d-55697bf83430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:07.212284 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.212113    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1474d49c-d080-461e-ac4d-55697bf83430-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kmp66\" (UID: \"1474d49c-d080-461e-ac4d-55697bf83430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:07.212284 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.212144    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm2fb\" (UniqueName: \"kubernetes.io/projected/1474d49c-d080-461e-ac4d-55697bf83430-kube-api-access-zm2fb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kmp66\" (UID: \"1474d49c-d080-461e-ac4d-55697bf83430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:07.212522 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.212310    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1474d49c-d080-461e-ac4d-55697bf83430-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kmp66\" (UID: \"1474d49c-d080-461e-ac4d-55697bf83430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:07.212577 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.212541    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1474d49c-d080-461e-ac4d-55697bf83430-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kmp66\" (UID: \"1474d49c-d080-461e-ac4d-55697bf83430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:07.212620 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.212575    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1474d49c-d080-461e-ac4d-55697bf83430-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kmp66\" (UID: \"1474d49c-d080-461e-ac4d-55697bf83430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:07.212656 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.212641    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1474d49c-d080-461e-ac4d-55697bf83430-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kmp66\" (UID: \"1474d49c-d080-461e-ac4d-55697bf83430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:07.214423 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.214400    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1474d49c-d080-461e-ac4d-55697bf83430-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kmp66\" (UID: \"1474d49c-d080-461e-ac4d-55697bf83430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:07.214667 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.214648    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1474d49c-d080-461e-ac4d-55697bf83430-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kmp66\" (UID: \"1474d49c-d080-461e-ac4d-55697bf83430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:07.220618 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.220593    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm2fb\" (UniqueName: \"kubernetes.io/projected/1474d49c-d080-461e-ac4d-55697bf83430-kube-api-access-zm2fb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kmp66\" (UID: \"1474d49c-d080-461e-ac4d-55697bf83430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:07.380437 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.380314    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:07.517248 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.517211    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"]
Jul 27 22:05:07.520168 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:05:07.520144    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1474d49c_d080_461e_ac4d_55697bf83430.slice/crio-56253b4f84e5614e72bfdbec8e42bc884a1f816980d6886ac90c0afeab987dfd WatchSource:0}: Error finding container 56253b4f84e5614e72bfdbec8e42bc884a1f816980d6886ac90c0afeab987dfd: Status 404 returned error can't find the container with id 56253b4f84e5614e72bfdbec8e42bc884a1f816980d6886ac90c0afeab987dfd
Jul 27 22:05:07.777043 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.777020    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8444c4f6f9-nktbk"
Jul 27 22:05:07.823192 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.823156    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66" event={"ID":"1474d49c-d080-461e-ac4d-55697bf83430","Type":"ContainerStarted","Data":"ad72a55150196d9bc8a8125dc709c05fcfc6e3cf4b8e682d595c95d96506815a"}
Jul 27 22:05:07.823405 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.823228    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66" event={"ID":"1474d49c-d080-461e-ac4d-55697bf83430","Type":"ContainerStarted","Data":"56253b4f84e5614e72bfdbec8e42bc884a1f816980d6886ac90c0afeab987dfd"}
Jul 27 22:05:07.842839 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:07.842792    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66" podStartSLOduration=0.658078499 podStartE2EDuration="842.775886ms" totalImagesPullingTime="184.697387ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:05:07.841070656 +0000 UTC m=+652.582205425" watchObservedRunningTime="2026-07-27 22:05:07.842775886 +0000 UTC m=+652.583910654"
Jul 27 22:05:17.380467 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:17.380433    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:17.380967 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:17.380589    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:17.393053 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:17.393025    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:17.881352 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:17.881306    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kmp66"
Jul 27 22:05:19.970667 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:19.970634    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"]
Jul 27 22:05:19.974162 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:19.974141    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:19.977309 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:19.977289    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 27 22:05:19.998002 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:19.997980    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"]
Jul 27 22:05:20.028637 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.028608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf0d4bce-1d57-4af9-a49b-3f693741301f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq\" (UID: \"cf0d4bce-1d57-4af9-a49b-3f693741301f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:20.028774 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.028651    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf0d4bce-1d57-4af9-a49b-3f693741301f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq\" (UID: \"cf0d4bce-1d57-4af9-a49b-3f693741301f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:20.028774 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.028731    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf0d4bce-1d57-4af9-a49b-3f693741301f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq\" (UID: \"cf0d4bce-1d57-4af9-a49b-3f693741301f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:20.028774 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.028751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf0d4bce-1d57-4af9-a49b-3f693741301f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq\" (UID: \"cf0d4bce-1d57-4af9-a49b-3f693741301f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:20.028774 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.028768    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf0d4bce-1d57-4af9-a49b-3f693741301f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq\" (UID: \"cf0d4bce-1d57-4af9-a49b-3f693741301f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:20.028913 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.028863    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgcwc\" (UniqueName: \"kubernetes.io/projected/cf0d4bce-1d57-4af9-a49b-3f693741301f-kube-api-access-hgcwc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq\" (UID: \"cf0d4bce-1d57-4af9-a49b-3f693741301f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:20.129547 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.129511    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf0d4bce-1d57-4af9-a49b-3f693741301f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq\" (UID: \"cf0d4bce-1d57-4af9-a49b-3f693741301f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:20.129721 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.129576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf0d4bce-1d57-4af9-a49b-3f693741301f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq\" (UID: \"cf0d4bce-1d57-4af9-a49b-3f693741301f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:20.129721 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.129599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf0d4bce-1d57-4af9-a49b-3f693741301f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq\" (UID: \"cf0d4bce-1d57-4af9-a49b-3f693741301f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:20.129721 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.129614    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf0d4bce-1d57-4af9-a49b-3f693741301f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq\" (UID: \"cf0d4bce-1d57-4af9-a49b-3f693741301f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:20.129721 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.129658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgcwc\" (UniqueName: \"kubernetes.io/projected/cf0d4bce-1d57-4af9-a49b-3f693741301f-kube-api-access-hgcwc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq\" (UID: \"cf0d4bce-1d57-4af9-a49b-3f693741301f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:20.129902 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.129734    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf0d4bce-1d57-4af9-a49b-3f693741301f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq\" (UID: \"cf0d4bce-1d57-4af9-a49b-3f693741301f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:20.130007 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.129978    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf0d4bce-1d57-4af9-a49b-3f693741301f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq\" (UID: \"cf0d4bce-1d57-4af9-a49b-3f693741301f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:20.130079 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.129988    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf0d4bce-1d57-4af9-a49b-3f693741301f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq\" (UID: \"cf0d4bce-1d57-4af9-a49b-3f693741301f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:20.130161 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.130141    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf0d4bce-1d57-4af9-a49b-3f693741301f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq\" (UID: \"cf0d4bce-1d57-4af9-a49b-3f693741301f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:20.131900 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.131872    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf0d4bce-1d57-4af9-a49b-3f693741301f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq\" (UID: \"cf0d4bce-1d57-4af9-a49b-3f693741301f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:20.132215 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.132196    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf0d4bce-1d57-4af9-a49b-3f693741301f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq\" (UID: \"cf0d4bce-1d57-4af9-a49b-3f693741301f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:20.143643 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.143615    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgcwc\" (UniqueName: \"kubernetes.io/projected/cf0d4bce-1d57-4af9-a49b-3f693741301f-kube-api-access-hgcwc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq\" (UID: \"cf0d4bce-1d57-4af9-a49b-3f693741301f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:20.284990 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.284905    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:20.440311 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.440286    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"]
Jul 27 22:05:20.441387 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:05:20.441361    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf0d4bce_1d57_4af9_a49b_3f693741301f.slice/crio-9ca8f6e400236eeaf5517539a80662e8d07cae4d4065d90751bc0ae2d5251fcf WatchSource:0}: Error finding container 9ca8f6e400236eeaf5517539a80662e8d07cae4d4065d90751bc0ae2d5251fcf: Status 404 returned error can't find the container with id 9ca8f6e400236eeaf5517539a80662e8d07cae4d4065d90751bc0ae2d5251fcf
Jul 27 22:05:20.885482 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.885398    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq" event={"ID":"cf0d4bce-1d57-4af9-a49b-3f693741301f","Type":"ContainerStarted","Data":"fe1e85843dfb19a849bfd6bb8e0c9a5e1368ac8f40885203f83c88a4f155824d"}
Jul 27 22:05:20.885482 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.885450    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq" event={"ID":"cf0d4bce-1d57-4af9-a49b-3f693741301f","Type":"ContainerStarted","Data":"9ca8f6e400236eeaf5517539a80662e8d07cae4d4065d90751bc0ae2d5251fcf"}
Jul 27 22:05:20.917117 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:20.917065    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq" podStartSLOduration=1.7553226259999999 podStartE2EDuration="1.917051911s" totalImagesPullingTime="161.729285ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:05:20.916448638 +0000 UTC m=+665.657583405" watchObservedRunningTime="2026-07-27 22:05:20.917051911 +0000 UTC m=+665.658186679"
Jul 27 22:05:30.285253 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:30.285219    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:30.285632 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:30.285288    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:30.297391 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:30.297367    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:05:30.954105 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:05:30.954077    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq"
Jul 27 22:07:25.959948 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:07:25.959906    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68bdf46b89-wwgr5"]
Jul 27 22:07:25.960575 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:07:25.960121    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-68bdf46b89-wwgr5" podUID="1db18dda-536b-41b4-aae6-1cba670fa1b2" containerName="manager" containerID="cri-o://ee3539f41fb4e20602740579e982f57058fc743de9c58da07f10b34dee2fd645" gracePeriod=30
Jul 27 22:07:26.208826 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:07:26.208795    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68bdf46b89-wwgr5"
Jul 27 22:07:26.319058 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:07:26.318974    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh6xx\" (UniqueName: \"kubernetes.io/projected/1db18dda-536b-41b4-aae6-1cba670fa1b2-kube-api-access-kh6xx\") pod \"1db18dda-536b-41b4-aae6-1cba670fa1b2\" (UID: \"1db18dda-536b-41b4-aae6-1cba670fa1b2\") "
Jul 27 22:07:26.319201 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:07:26.319116    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1db18dda-536b-41b4-aae6-1cba670fa1b2-webhook-cert\") pod \"1db18dda-536b-41b4-aae6-1cba670fa1b2\" (UID: \"1db18dda-536b-41b4-aae6-1cba670fa1b2\") "
Jul 27 22:07:26.321051 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:07:26.321019    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1db18dda-536b-41b4-aae6-1cba670fa1b2-kube-api-access-kh6xx" (OuterVolumeSpecName: "kube-api-access-kh6xx") pod "1db18dda-536b-41b4-aae6-1cba670fa1b2" (UID: "1db18dda-536b-41b4-aae6-1cba670fa1b2"). InnerVolumeSpecName "kube-api-access-kh6xx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:07:26.321188 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:07:26.321065    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1db18dda-536b-41b4-aae6-1cba670fa1b2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1db18dda-536b-41b4-aae6-1cba670fa1b2" (UID: "1db18dda-536b-41b4-aae6-1cba670fa1b2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:07:26.420883 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:07:26.420840    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh6xx\" (UniqueName: \"kubernetes.io/projected/1db18dda-536b-41b4-aae6-1cba670fa1b2-kube-api-access-kh6xx\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:07:26.420883 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:07:26.420878    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1db18dda-536b-41b4-aae6-1cba670fa1b2-webhook-cert\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:07:26.506763 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:07:26.506727    2565 generic.go:356] "Generic (PLEG): container finished" podID="1db18dda-536b-41b4-aae6-1cba670fa1b2" containerID="ee3539f41fb4e20602740579e982f57058fc743de9c58da07f10b34dee2fd645" exitCode=0
Jul 27 22:07:26.506909 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:07:26.506776    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68bdf46b89-wwgr5"
Jul 27 22:07:26.506909 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:07:26.506815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68bdf46b89-wwgr5" event={"ID":"1db18dda-536b-41b4-aae6-1cba670fa1b2","Type":"ContainerDied","Data":"ee3539f41fb4e20602740579e982f57058fc743de9c58da07f10b34dee2fd645"}
Jul 27 22:07:26.506909 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:07:26.506871    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68bdf46b89-wwgr5" event={"ID":"1db18dda-536b-41b4-aae6-1cba670fa1b2","Type":"ContainerDied","Data":"67ae2b2baa33e4f32782a6884ee591c81613d1298d50c81bd7dd0d9e890c2270"}
Jul 27 22:07:26.506909 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:07:26.506895    2565 scope.go:117] "RemoveContainer" containerID="ee3539f41fb4e20602740579e982f57058fc743de9c58da07f10b34dee2fd645"
Jul 27 22:07:26.515700 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:07:26.515683    2565 scope.go:117] "RemoveContainer" containerID="ee3539f41fb4e20602740579e982f57058fc743de9c58da07f10b34dee2fd645"
Jul 27 22:07:26.515938 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:07:26.515921    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee3539f41fb4e20602740579e982f57058fc743de9c58da07f10b34dee2fd645\": container with ID starting with ee3539f41fb4e20602740579e982f57058fc743de9c58da07f10b34dee2fd645 not found: ID does not exist" containerID="ee3539f41fb4e20602740579e982f57058fc743de9c58da07f10b34dee2fd645"
Jul 27 22:07:26.515985 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:07:26.515946    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee3539f41fb4e20602740579e982f57058fc743de9c58da07f10b34dee2fd645"} err="failed to get container status \"ee3539f41fb4e20602740579e982f57058fc743de9c58da07f10b34dee2fd645\": rpc error: code = NotFound desc = could not find container \"ee3539f41fb4e20602740579e982f57058fc743de9c58da07f10b34dee2fd645\": container with ID starting with ee3539f41fb4e20602740579e982f57058fc743de9c58da07f10b34dee2fd645 not found: ID does not exist"
Jul 27 22:07:26.529191 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:07:26.529171    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68bdf46b89-wwgr5"]
Jul 27 22:07:26.532942 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:07:26.532923    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68bdf46b89-wwgr5"]
Jul 27 22:07:27.816840 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:07:27.816806    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1db18dda-536b-41b4-aae6-1cba670fa1b2" path="/var/lib/kubelet/pods/1db18dda-536b-41b4-aae6-1cba670fa1b2/volumes"
Jul 27 22:08:27.307451 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:27.307417    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68bdf46b89-mcjts"]
Jul 27 22:08:27.307877 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:27.307821    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1db18dda-536b-41b4-aae6-1cba670fa1b2" containerName="manager"
Jul 27 22:08:27.307877 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:27.307831    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1db18dda-536b-41b4-aae6-1cba670fa1b2" containerName="manager"
Jul 27 22:08:27.307959 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:27.307890    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1db18dda-536b-41b4-aae6-1cba670fa1b2" containerName="manager"
Jul 27 22:08:27.311119 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:27.311096    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68bdf46b89-mcjts"
Jul 27 22:08:27.314242 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:27.314225    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 22:08:27.315311 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:27.315285    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nck8d\""
Jul 27 22:08:27.315410 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:27.315329    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 22:08:27.326364 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:27.326326    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68bdf46b89-mcjts"]
Jul 27 22:08:27.402466 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:27.402434    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1beb706c-bf2d-4f67-a9c9-0e43958100d1-webhook-cert\") pod \"maas-controller-68bdf46b89-mcjts\" (UID: \"1beb706c-bf2d-4f67-a9c9-0e43958100d1\") " pod="opendatahub/maas-controller-68bdf46b89-mcjts"
Jul 27 22:08:27.402616 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:27.402476    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8k7j\" (UniqueName: \"kubernetes.io/projected/1beb706c-bf2d-4f67-a9c9-0e43958100d1-kube-api-access-p8k7j\") pod \"maas-controller-68bdf46b89-mcjts\" (UID: \"1beb706c-bf2d-4f67-a9c9-0e43958100d1\") " pod="opendatahub/maas-controller-68bdf46b89-mcjts"
Jul 27 22:08:27.503630 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:27.503603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1beb706c-bf2d-4f67-a9c9-0e43958100d1-webhook-cert\") pod \"maas-controller-68bdf46b89-mcjts\" (UID: \"1beb706c-bf2d-4f67-a9c9-0e43958100d1\") " pod="opendatahub/maas-controller-68bdf46b89-mcjts"
Jul 27 22:08:27.503738 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:27.503640    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8k7j\" (UniqueName: \"kubernetes.io/projected/1beb706c-bf2d-4f67-a9c9-0e43958100d1-kube-api-access-p8k7j\") pod \"maas-controller-68bdf46b89-mcjts\" (UID: \"1beb706c-bf2d-4f67-a9c9-0e43958100d1\") " pod="opendatahub/maas-controller-68bdf46b89-mcjts"
Jul 27 22:08:27.505995 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:27.505970    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1beb706c-bf2d-4f67-a9c9-0e43958100d1-webhook-cert\") pod \"maas-controller-68bdf46b89-mcjts\" (UID: \"1beb706c-bf2d-4f67-a9c9-0e43958100d1\") " pod="opendatahub/maas-controller-68bdf46b89-mcjts"
Jul 27 22:08:27.519083 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:27.519056    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8k7j\" (UniqueName: \"kubernetes.io/projected/1beb706c-bf2d-4f67-a9c9-0e43958100d1-kube-api-access-p8k7j\") pod \"maas-controller-68bdf46b89-mcjts\" (UID: \"1beb706c-bf2d-4f67-a9c9-0e43958100d1\") " pod="opendatahub/maas-controller-68bdf46b89-mcjts"
Jul 27 22:08:27.621260 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:27.621196    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68bdf46b89-mcjts"
Jul 27 22:08:27.754451 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:27.754427    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68bdf46b89-mcjts"]
Jul 27 22:08:27.756578 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:08:27.756550    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1beb706c_bf2d_4f67_a9c9_0e43958100d1.slice/crio-88b9f4093696aaced7bf0fa30ff2df2838f7219550efd4423274bedc8235db20 WatchSource:0}: Error finding container 88b9f4093696aaced7bf0fa30ff2df2838f7219550efd4423274bedc8235db20: Status 404 returned error can't find the container with id 88b9f4093696aaced7bf0fa30ff2df2838f7219550efd4423274bedc8235db20
Jul 27 22:08:27.807107 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:27.807077    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68bdf46b89-mcjts" event={"ID":"1beb706c-bf2d-4f67-a9c9-0e43958100d1","Type":"ContainerStarted","Data":"88b9f4093696aaced7bf0fa30ff2df2838f7219550efd4423274bedc8235db20"}
Jul 27 22:08:28.817239 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:28.817194    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68bdf46b89-mcjts" event={"ID":"1beb706c-bf2d-4f67-a9c9-0e43958100d1","Type":"ContainerStarted","Data":"6a5bb2c0960f2f19f5d5c7a06e03e5eafc6ca462c09623932ca54ee58e1653dc"}
Jul 27 22:08:28.817704 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:28.817299    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68bdf46b89-mcjts"
Jul 27 22:08:28.838247 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:28.838192    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68bdf46b89-mcjts" podStartSLOduration=1.397103085 podStartE2EDuration="1.838179812s" totalImagesPullingTime="441.076727ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:08:28.835863648 +0000 UTC m=+853.576998415" watchObservedRunningTime="2026-07-27 22:08:28.838179812 +0000 UTC m=+853.579314578"
Jul 27 22:08:39.823882 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:39.823853    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68bdf46b89-mcjts"
Jul 27 22:08:44.460033 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:44.459993    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68bdf46b89-mcjts"]
Jul 27 22:08:44.460533 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:44.460197    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-68bdf46b89-mcjts" podUID="1beb706c-bf2d-4f67-a9c9-0e43958100d1" containerName="manager" containerID="cri-o://6a5bb2c0960f2f19f5d5c7a06e03e5eafc6ca462c09623932ca54ee58e1653dc" gracePeriod=30
Jul 27 22:08:44.705762 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:44.705737    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68bdf46b89-mcjts"
Jul 27 22:08:44.759159 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:44.759084    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1beb706c-bf2d-4f67-a9c9-0e43958100d1-webhook-cert\") pod \"1beb706c-bf2d-4f67-a9c9-0e43958100d1\" (UID: \"1beb706c-bf2d-4f67-a9c9-0e43958100d1\") "
Jul 27 22:08:44.759320 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:44.759182    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8k7j\" (UniqueName: \"kubernetes.io/projected/1beb706c-bf2d-4f67-a9c9-0e43958100d1-kube-api-access-p8k7j\") pod \"1beb706c-bf2d-4f67-a9c9-0e43958100d1\" (UID: \"1beb706c-bf2d-4f67-a9c9-0e43958100d1\") "
Jul 27 22:08:44.761090 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:44.761052    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1beb706c-bf2d-4f67-a9c9-0e43958100d1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1beb706c-bf2d-4f67-a9c9-0e43958100d1" (UID: "1beb706c-bf2d-4f67-a9c9-0e43958100d1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:08:44.761290 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:44.761269    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1beb706c-bf2d-4f67-a9c9-0e43958100d1-kube-api-access-p8k7j" (OuterVolumeSpecName: "kube-api-access-p8k7j") pod "1beb706c-bf2d-4f67-a9c9-0e43958100d1" (UID: "1beb706c-bf2d-4f67-a9c9-0e43958100d1"). InnerVolumeSpecName "kube-api-access-p8k7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:08:44.860771 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:44.860740    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1beb706c-bf2d-4f67-a9c9-0e43958100d1-webhook-cert\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:08:44.860771 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:44.860767    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8k7j\" (UniqueName: \"kubernetes.io/projected/1beb706c-bf2d-4f67-a9c9-0e43958100d1-kube-api-access-p8k7j\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:08:44.897325 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:44.897295    2565 generic.go:356] "Generic (PLEG): container finished" podID="1beb706c-bf2d-4f67-a9c9-0e43958100d1" containerID="6a5bb2c0960f2f19f5d5c7a06e03e5eafc6ca462c09623932ca54ee58e1653dc" exitCode=0
Jul 27 22:08:44.897462 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:44.897365    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68bdf46b89-mcjts"
Jul 27 22:08:44.897462 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:44.897365    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68bdf46b89-mcjts" event={"ID":"1beb706c-bf2d-4f67-a9c9-0e43958100d1","Type":"ContainerDied","Data":"6a5bb2c0960f2f19f5d5c7a06e03e5eafc6ca462c09623932ca54ee58e1653dc"}
Jul 27 22:08:44.897462 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:44.897426    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68bdf46b89-mcjts" event={"ID":"1beb706c-bf2d-4f67-a9c9-0e43958100d1","Type":"ContainerDied","Data":"88b9f4093696aaced7bf0fa30ff2df2838f7219550efd4423274bedc8235db20"}
Jul 27 22:08:44.897462 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:44.897451    2565 scope.go:117] "RemoveContainer" containerID="6a5bb2c0960f2f19f5d5c7a06e03e5eafc6ca462c09623932ca54ee58e1653dc"
Jul 27 22:08:44.906407 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:44.906390    2565 scope.go:117] "RemoveContainer" containerID="6a5bb2c0960f2f19f5d5c7a06e03e5eafc6ca462c09623932ca54ee58e1653dc"
Jul 27 22:08:44.906650 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:08:44.906631    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a5bb2c0960f2f19f5d5c7a06e03e5eafc6ca462c09623932ca54ee58e1653dc\": container with ID starting with 6a5bb2c0960f2f19f5d5c7a06e03e5eafc6ca462c09623932ca54ee58e1653dc not found: ID does not exist" containerID="6a5bb2c0960f2f19f5d5c7a06e03e5eafc6ca462c09623932ca54ee58e1653dc"
Jul 27 22:08:44.906718 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:44.906660    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a5bb2c0960f2f19f5d5c7a06e03e5eafc6ca462c09623932ca54ee58e1653dc"} err="failed to get container status \"6a5bb2c0960f2f19f5d5c7a06e03e5eafc6ca462c09623932ca54ee58e1653dc\": rpc error: code = NotFound desc = could not find container \"6a5bb2c0960f2f19f5d5c7a06e03e5eafc6ca462c09623932ca54ee58e1653dc\": container with ID starting with 6a5bb2c0960f2f19f5d5c7a06e03e5eafc6ca462c09623932ca54ee58e1653dc not found: ID does not exist"
Jul 27 22:08:44.919207 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:44.919183    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68bdf46b89-mcjts"]
Jul 27 22:08:44.926056 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:44.926027    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68bdf46b89-mcjts"]
Jul 27 22:08:45.729847 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:45.729815    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68bdf46b89-zxmsb"]
Jul 27 22:08:45.730247 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:45.730235    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1beb706c-bf2d-4f67-a9c9-0e43958100d1" containerName="manager"
Jul 27 22:08:45.730291 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:45.730248    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1beb706c-bf2d-4f67-a9c9-0e43958100d1" containerName="manager"
Jul 27 22:08:45.730325 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:45.730312    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1beb706c-bf2d-4f67-a9c9-0e43958100d1" containerName="manager"
Jul 27 22:08:45.734664 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:45.734646    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68bdf46b89-zxmsb"
Jul 27 22:08:45.738774 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:45.738754    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 22:08:45.738774 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:45.738772    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 22:08:45.738961 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:45.738772    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nck8d\""
Jul 27 22:08:45.749155 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:45.749127    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68bdf46b89-zxmsb"]
Jul 27 22:08:45.818099 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:45.818069    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1beb706c-bf2d-4f67-a9c9-0e43958100d1" path="/var/lib/kubelet/pods/1beb706c-bf2d-4f67-a9c9-0e43958100d1/volumes"
Jul 27 22:08:45.869911 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:45.869882    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89cdc\" (UniqueName: \"kubernetes.io/projected/2e2d9203-9763-4d0b-b59c-298d1058ee35-kube-api-access-89cdc\") pod \"maas-controller-68bdf46b89-zxmsb\" (UID: \"2e2d9203-9763-4d0b-b59c-298d1058ee35\") " pod="opendatahub/maas-controller-68bdf46b89-zxmsb"
Jul 27 22:08:45.870055 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:45.870009    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e2d9203-9763-4d0b-b59c-298d1058ee35-webhook-cert\") pod \"maas-controller-68bdf46b89-zxmsb\" (UID: \"2e2d9203-9763-4d0b-b59c-298d1058ee35\") " pod="opendatahub/maas-controller-68bdf46b89-zxmsb"
Jul 27 22:08:45.970429 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:45.970398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e2d9203-9763-4d0b-b59c-298d1058ee35-webhook-cert\") pod \"maas-controller-68bdf46b89-zxmsb\" (UID: \"2e2d9203-9763-4d0b-b59c-298d1058ee35\") " pod="opendatahub/maas-controller-68bdf46b89-zxmsb"
Jul 27 22:08:45.970429 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:45.970432    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89cdc\" (UniqueName: \"kubernetes.io/projected/2e2d9203-9763-4d0b-b59c-298d1058ee35-kube-api-access-89cdc\") pod \"maas-controller-68bdf46b89-zxmsb\" (UID: \"2e2d9203-9763-4d0b-b59c-298d1058ee35\") " pod="opendatahub/maas-controller-68bdf46b89-zxmsb"
Jul 27 22:08:45.972786 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:45.972760    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e2d9203-9763-4d0b-b59c-298d1058ee35-webhook-cert\") pod \"maas-controller-68bdf46b89-zxmsb\" (UID: \"2e2d9203-9763-4d0b-b59c-298d1058ee35\") " pod="opendatahub/maas-controller-68bdf46b89-zxmsb"
Jul 27 22:08:45.979547 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:45.979523    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89cdc\" (UniqueName: \"kubernetes.io/projected/2e2d9203-9763-4d0b-b59c-298d1058ee35-kube-api-access-89cdc\") pod \"maas-controller-68bdf46b89-zxmsb\" (UID: \"2e2d9203-9763-4d0b-b59c-298d1058ee35\") " pod="opendatahub/maas-controller-68bdf46b89-zxmsb"
Jul 27 22:08:46.045391 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:46.045291    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68bdf46b89-zxmsb"
Jul 27 22:08:46.183683 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:46.183653    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68bdf46b89-zxmsb"]
Jul 27 22:08:46.185752 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:08:46.185723    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e2d9203_9763_4d0b_b59c_298d1058ee35.slice/crio-05bb723b8fdf09520a006969a8655af219b54b2d183258a1a8cd4f4d960d6f32 WatchSource:0}: Error finding container 05bb723b8fdf09520a006969a8655af219b54b2d183258a1a8cd4f4d960d6f32: Status 404 returned error can't find the container with id 05bb723b8fdf09520a006969a8655af219b54b2d183258a1a8cd4f4d960d6f32
Jul 27 22:08:46.909000 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:46.908897    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68bdf46b89-zxmsb" event={"ID":"2e2d9203-9763-4d0b-b59c-298d1058ee35","Type":"ContainerStarted","Data":"7b04ac8a5279ebb813122a2808823bfc5923464f2077749cf877e446193f4aea"}
Jul 27 22:08:46.909000 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:46.908947    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68bdf46b89-zxmsb" event={"ID":"2e2d9203-9763-4d0b-b59c-298d1058ee35","Type":"ContainerStarted","Data":"05bb723b8fdf09520a006969a8655af219b54b2d183258a1a8cd4f4d960d6f32"}
Jul 27 22:08:46.909000 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:46.908992    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68bdf46b89-zxmsb"
Jul 27 22:08:46.929743 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:46.929695    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68bdf46b89-zxmsb" podStartSLOduration=1.4966393230000001 podStartE2EDuration="1.929680589s" totalImagesPullingTime="433.041266ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:08:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:08:46.927795245 +0000 UTC m=+871.668930024" watchObservedRunningTime="2026-07-27 22:08:46.929680589 +0000 UTC m=+871.670815355"
Jul 27 22:08:57.916427 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:08:57.916397    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68bdf46b89-zxmsb"
Jul 27 22:21:56.067514 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:56.067471    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"]
Jul 27 22:21:56.071781 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:56.071759    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"
Jul 27 22:21:56.074418 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:56.074389    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b8ed72f2-serving-cert\""
Jul 27 22:21:56.083419 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:56.083394    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"]
Jul 27 22:21:56.216229 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:56.216194    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9611b33-c0f9-4d87-b482-9a38f8127658-maas-api-tls\") pod \"maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p\" (UID: \"e9611b33-c0f9-4d87-b482-9a38f8127658\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"
Jul 27 22:21:56.216467 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:56.216326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9611b33-c0f9-4d87-b482-9a38f8127658-openshift-service-ca\") pod \"maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p\" (UID: \"e9611b33-c0f9-4d87-b482-9a38f8127658\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"
Jul 27 22:21:56.216467 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:56.216450    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjfv7\" (UniqueName: \"kubernetes.io/projected/e9611b33-c0f9-4d87-b482-9a38f8127658-kube-api-access-mjfv7\") pod \"maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p\" (UID: \"e9611b33-c0f9-4d87-b482-9a38f8127658\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"
Jul 27 22:21:56.317996 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:56.317900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9611b33-c0f9-4d87-b482-9a38f8127658-openshift-service-ca\") pod \"maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p\" (UID: \"e9611b33-c0f9-4d87-b482-9a38f8127658\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"
Jul 27 22:21:56.318177 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:56.317995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjfv7\" (UniqueName: \"kubernetes.io/projected/e9611b33-c0f9-4d87-b482-9a38f8127658-kube-api-access-mjfv7\") pod \"maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p\" (UID: \"e9611b33-c0f9-4d87-b482-9a38f8127658\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"
Jul 27 22:21:56.318177 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:56.318037    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9611b33-c0f9-4d87-b482-9a38f8127658-maas-api-tls\") pod \"maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p\" (UID: \"e9611b33-c0f9-4d87-b482-9a38f8127658\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"
Jul 27 22:21:56.318331 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:21:56.318201    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-serving-cert: secret "maas-api-e2e-ait-b8ed72f2-serving-cert" not found
Jul 27 22:21:56.318331 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:21:56.318271    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9611b33-c0f9-4d87-b482-9a38f8127658-maas-api-tls podName:e9611b33-c0f9-4d87-b482-9a38f8127658 nodeName:}" failed. No retries permitted until 2026-07-27 22:21:56.818249812 +0000 UTC m=+1661.559384575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e9611b33-c0f9-4d87-b482-9a38f8127658-maas-api-tls") pod "maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p" (UID: "e9611b33-c0f9-4d87-b482-9a38f8127658") : secret "maas-api-e2e-ait-b8ed72f2-serving-cert" not found
Jul 27 22:21:56.318753 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:56.318726    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9611b33-c0f9-4d87-b482-9a38f8127658-openshift-service-ca\") pod \"maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p\" (UID: \"e9611b33-c0f9-4d87-b482-9a38f8127658\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"
Jul 27 22:21:56.330166 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:56.330136    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjfv7\" (UniqueName: \"kubernetes.io/projected/e9611b33-c0f9-4d87-b482-9a38f8127658-kube-api-access-mjfv7\") pod \"maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p\" (UID: \"e9611b33-c0f9-4d87-b482-9a38f8127658\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"
Jul 27 22:21:56.823120 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:56.823088    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9611b33-c0f9-4d87-b482-9a38f8127658-maas-api-tls\") pod \"maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p\" (UID: \"e9611b33-c0f9-4d87-b482-9a38f8127658\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"
Jul 27 22:21:56.825508 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:56.825488    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9611b33-c0f9-4d87-b482-9a38f8127658-maas-api-tls\") pod \"maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p\" (UID: \"e9611b33-c0f9-4d87-b482-9a38f8127658\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"
Jul 27 22:21:56.984130 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:56.984097    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"
Jul 27 22:21:57.131447 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:57.131413    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"]
Jul 27 22:21:57.135543 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:21:57.135514    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9611b33_c0f9_4d87_b482_9a38f8127658.slice/crio-1bf2036b6b785608068d3e04adcafcaaab331428ade7047f7b750b2e96078b40 WatchSource:0}: Error finding container 1bf2036b6b785608068d3e04adcafcaaab331428ade7047f7b750b2e96078b40: Status 404 returned error can't find the container with id 1bf2036b6b785608068d3e04adcafcaaab331428ade7047f7b750b2e96078b40
Jul 27 22:21:57.137032 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:57.137010    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 22:21:57.825488 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:57.825453    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p" event={"ID":"e9611b33-c0f9-4d87-b482-9a38f8127658","Type":"ContainerStarted","Data":"1bf2036b6b785608068d3e04adcafcaaab331428ade7047f7b750b2e96078b40"}
Jul 27 22:21:58.831862 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:58.831827    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p" event={"ID":"e9611b33-c0f9-4d87-b482-9a38f8127658","Type":"ContainerStarted","Data":"a664df85514d95885979bab9ceeb7a666d13abb4cca5ecf84f4170df05e6cab6"}
Jul 27 22:21:58.832251 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:58.831932    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"
Jul 27 22:21:58.848748 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:21:58.848698    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p" podStartSLOduration=2.142396271 podStartE2EDuration="2.848685708s" totalImagesPullingTime="706.289437ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:21:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:21:58.848399927 +0000 UTC m=+1663.589534708" watchObservedRunningTime="2026-07-27 22:21:58.848685708 +0000 UTC m=+1663.589820475"
Jul 27 22:22:04.842280 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:04.842244    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"
Jul 27 22:22:32.080037 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:32.080003    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"]
Jul 27 22:22:32.080797 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:32.080275    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p" podUID="e9611b33-c0f9-4d87-b482-9a38f8127658" containerName="maas-api" containerID="cri-o://a664df85514d95885979bab9ceeb7a666d13abb4cca5ecf84f4170df05e6cab6" gracePeriod=30
Jul 27 22:22:32.332905 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:32.332836    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"
Jul 27 22:22:32.471641 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:32.471611    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjfv7\" (UniqueName: \"kubernetes.io/projected/e9611b33-c0f9-4d87-b482-9a38f8127658-kube-api-access-mjfv7\") pod \"e9611b33-c0f9-4d87-b482-9a38f8127658\" (UID: \"e9611b33-c0f9-4d87-b482-9a38f8127658\") "
Jul 27 22:22:32.471946 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:32.471921    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9611b33-c0f9-4d87-b482-9a38f8127658-openshift-service-ca\") pod \"e9611b33-c0f9-4d87-b482-9a38f8127658\" (UID: \"e9611b33-c0f9-4d87-b482-9a38f8127658\") "
Jul 27 22:22:32.472083 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:32.471970    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9611b33-c0f9-4d87-b482-9a38f8127658-maas-api-tls\") pod \"e9611b33-c0f9-4d87-b482-9a38f8127658\" (UID: \"e9611b33-c0f9-4d87-b482-9a38f8127658\") "
Jul 27 22:22:32.472501 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:32.472458    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9611b33-c0f9-4d87-b482-9a38f8127658-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e9611b33-c0f9-4d87-b482-9a38f8127658" (UID: "e9611b33-c0f9-4d87-b482-9a38f8127658"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:22:32.474323 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:32.474291    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9611b33-c0f9-4d87-b482-9a38f8127658-kube-api-access-mjfv7" (OuterVolumeSpecName: "kube-api-access-mjfv7") pod "e9611b33-c0f9-4d87-b482-9a38f8127658" (UID: "e9611b33-c0f9-4d87-b482-9a38f8127658"). InnerVolumeSpecName "kube-api-access-mjfv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:22:32.474461 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:32.474375    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9611b33-c0f9-4d87-b482-9a38f8127658-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e9611b33-c0f9-4d87-b482-9a38f8127658" (UID: "e9611b33-c0f9-4d87-b482-9a38f8127658"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:22:32.573128 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:32.573102    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjfv7\" (UniqueName: \"kubernetes.io/projected/e9611b33-c0f9-4d87-b482-9a38f8127658-kube-api-access-mjfv7\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:22:32.573128 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:32.573124    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9611b33-c0f9-4d87-b482-9a38f8127658-openshift-service-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:22:32.573275 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:32.573135    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9611b33-c0f9-4d87-b482-9a38f8127658-maas-api-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:22:33.017482 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:33.017452    2565 generic.go:356] "Generic (PLEG): container finished" podID="e9611b33-c0f9-4d87-b482-9a38f8127658" containerID="a664df85514d95885979bab9ceeb7a666d13abb4cca5ecf84f4170df05e6cab6" exitCode=0
Jul 27 22:22:33.017669 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:33.017491    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"
Jul 27 22:22:33.017669 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:33.017536    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p" event={"ID":"e9611b33-c0f9-4d87-b482-9a38f8127658","Type":"ContainerDied","Data":"a664df85514d95885979bab9ceeb7a666d13abb4cca5ecf84f4170df05e6cab6"}
Jul 27 22:22:33.017669 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:33.017584    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p" event={"ID":"e9611b33-c0f9-4d87-b482-9a38f8127658","Type":"ContainerDied","Data":"1bf2036b6b785608068d3e04adcafcaaab331428ade7047f7b750b2e96078b40"}
Jul 27 22:22:33.017669 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:33.017607    2565 scope.go:117] "RemoveContainer" containerID="a664df85514d95885979bab9ceeb7a666d13abb4cca5ecf84f4170df05e6cab6"
Jul 27 22:22:33.026963 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:33.026947    2565 scope.go:117] "RemoveContainer" containerID="a664df85514d95885979bab9ceeb7a666d13abb4cca5ecf84f4170df05e6cab6"
Jul 27 22:22:33.027195 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:22:33.027178    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a664df85514d95885979bab9ceeb7a666d13abb4cca5ecf84f4170df05e6cab6\": container with ID starting with a664df85514d95885979bab9ceeb7a666d13abb4cca5ecf84f4170df05e6cab6 not found: ID does not exist" containerID="a664df85514d95885979bab9ceeb7a666d13abb4cca5ecf84f4170df05e6cab6"
Jul 27 22:22:33.027240 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:33.027203    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a664df85514d95885979bab9ceeb7a666d13abb4cca5ecf84f4170df05e6cab6"} err="failed to get container status \"a664df85514d95885979bab9ceeb7a666d13abb4cca5ecf84f4170df05e6cab6\": rpc error: code = NotFound desc = could not find container \"a664df85514d95885979bab9ceeb7a666d13abb4cca5ecf84f4170df05e6cab6\": container with ID starting with a664df85514d95885979bab9ceeb7a666d13abb4cca5ecf84f4170df05e6cab6 not found: ID does not exist"
Jul 27 22:22:33.039575 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:33.039551    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"]
Jul 27 22:22:33.045179 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:33.045158    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b8ed72f2-874fdf9d7-9kq9p"]
Jul 27 22:22:33.818317 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:33.818281    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9611b33-c0f9-4d87-b482-9a38f8127658" path="/var/lib/kubelet/pods/e9611b33-c0f9-4d87-b482-9a38f8127658/volumes"
Jul 27 22:22:40.278967 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:40.278869    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"]
Jul 27 22:22:40.279633 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:40.279584    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9611b33-c0f9-4d87-b482-9a38f8127658" containerName="maas-api"
Jul 27 22:22:40.279633 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:40.279607    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9611b33-c0f9-4d87-b482-9a38f8127658" containerName="maas-api"
Jul 27 22:22:40.279838 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:40.279743    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9611b33-c0f9-4d87-b482-9a38f8127658" containerName="maas-api"
Jul 27 22:22:40.284694 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:40.284672    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"
Jul 27 22:22:40.287237 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:40.287215    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-732c17ff-serving-cert\""
Jul 27 22:22:40.294623 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:40.294005    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"]
Jul 27 22:22:40.449985 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:40.449952    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fd8baea-f46b-4eec-ad0d-f8852816a514-maas-api-tls\") pod \"maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh\" (UID: \"5fd8baea-f46b-4eec-ad0d-f8852816a514\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"
Jul 27 22:22:40.450159 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:40.450010    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fd8baea-f46b-4eec-ad0d-f8852816a514-openshift-service-ca\") pod \"maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh\" (UID: \"5fd8baea-f46b-4eec-ad0d-f8852816a514\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"
Jul 27 22:22:40.450159 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:40.450085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmb9k\" (UniqueName: \"kubernetes.io/projected/5fd8baea-f46b-4eec-ad0d-f8852816a514-kube-api-access-qmb9k\") pod \"maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh\" (UID: \"5fd8baea-f46b-4eec-ad0d-f8852816a514\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"
Jul 27 22:22:40.551017 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:40.550937    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fd8baea-f46b-4eec-ad0d-f8852816a514-maas-api-tls\") pod \"maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh\" (UID: \"5fd8baea-f46b-4eec-ad0d-f8852816a514\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"
Jul 27 22:22:40.551017 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:40.550998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fd8baea-f46b-4eec-ad0d-f8852816a514-openshift-service-ca\") pod \"maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh\" (UID: \"5fd8baea-f46b-4eec-ad0d-f8852816a514\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"
Jul 27 22:22:40.551199 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:40.551038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmb9k\" (UniqueName: \"kubernetes.io/projected/5fd8baea-f46b-4eec-ad0d-f8852816a514-kube-api-access-qmb9k\") pod \"maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh\" (UID: \"5fd8baea-f46b-4eec-ad0d-f8852816a514\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"
Jul 27 22:22:40.551749 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:40.551719    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fd8baea-f46b-4eec-ad0d-f8852816a514-openshift-service-ca\") pod \"maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh\" (UID: \"5fd8baea-f46b-4eec-ad0d-f8852816a514\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"
Jul 27 22:22:40.553459 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:40.553436    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fd8baea-f46b-4eec-ad0d-f8852816a514-maas-api-tls\") pod \"maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh\" (UID: \"5fd8baea-f46b-4eec-ad0d-f8852816a514\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"
Jul 27 22:22:40.559488 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:40.559468    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmb9k\" (UniqueName: \"kubernetes.io/projected/5fd8baea-f46b-4eec-ad0d-f8852816a514-kube-api-access-qmb9k\") pod \"maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh\" (UID: \"5fd8baea-f46b-4eec-ad0d-f8852816a514\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"
Jul 27 22:22:40.600474 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:40.600452    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"
Jul 27 22:22:40.745257 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:40.741126    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"]
Jul 27 22:22:40.748932 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:22:40.748904    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd8baea_f46b_4eec_ad0d_f8852816a514.slice/crio-b86f5384f1f0feef3d61819eaa8470db9574d418cd41bc3ede6a1d4bd6635f07 WatchSource:0}: Error finding container b86f5384f1f0feef3d61819eaa8470db9574d418cd41bc3ede6a1d4bd6635f07: Status 404 returned error can't find the container with id b86f5384f1f0feef3d61819eaa8470db9574d418cd41bc3ede6a1d4bd6635f07
Jul 27 22:22:41.064591 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:41.064557    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh" event={"ID":"5fd8baea-f46b-4eec-ad0d-f8852816a514","Type":"ContainerStarted","Data":"b86f5384f1f0feef3d61819eaa8470db9574d418cd41bc3ede6a1d4bd6635f07"}
Jul 27 22:22:42.071537 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:42.071501    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh" event={"ID":"5fd8baea-f46b-4eec-ad0d-f8852816a514","Type":"ContainerStarted","Data":"de89af67c8a2ef422dac3e00126334e43d5db4b7c98a7124f3adf31da2300605"}
Jul 27 22:22:42.071948 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:42.071617    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"
Jul 27 22:22:42.090147 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:42.090097    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh" podStartSLOduration=1.664255212 podStartE2EDuration="2.090081052s" totalImagesPullingTime="425.82584ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:22:42.08721103 +0000 UTC m=+1706.828345838" watchObservedRunningTime="2026-07-27 22:22:42.090081052 +0000 UTC m=+1706.831215820"
Jul 27 22:22:48.083869 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:22:48.083838    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"
Jul 27 22:23:15.726504 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:15.726466    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"]
Jul 27 22:23:15.727036 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:15.726723    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh" podUID="5fd8baea-f46b-4eec-ad0d-f8852816a514" containerName="maas-api" containerID="cri-o://de89af67c8a2ef422dac3e00126334e43d5db4b7c98a7124f3adf31da2300605" gracePeriod=30
Jul 27 22:23:15.980912 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:15.980845    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"
Jul 27 22:23:16.083749 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:16.083724    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmb9k\" (UniqueName: \"kubernetes.io/projected/5fd8baea-f46b-4eec-ad0d-f8852816a514-kube-api-access-qmb9k\") pod \"5fd8baea-f46b-4eec-ad0d-f8852816a514\" (UID: \"5fd8baea-f46b-4eec-ad0d-f8852816a514\") "
Jul 27 22:23:16.083900 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:16.083763    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fd8baea-f46b-4eec-ad0d-f8852816a514-maas-api-tls\") pod \"5fd8baea-f46b-4eec-ad0d-f8852816a514\" (UID: \"5fd8baea-f46b-4eec-ad0d-f8852816a514\") "
Jul 27 22:23:16.083900 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:16.083865    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fd8baea-f46b-4eec-ad0d-f8852816a514-openshift-service-ca\") pod \"5fd8baea-f46b-4eec-ad0d-f8852816a514\" (UID: \"5fd8baea-f46b-4eec-ad0d-f8852816a514\") "
Jul 27 22:23:16.084230 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:16.084201    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fd8baea-f46b-4eec-ad0d-f8852816a514-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5fd8baea-f46b-4eec-ad0d-f8852816a514" (UID: "5fd8baea-f46b-4eec-ad0d-f8852816a514"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:23:16.085814 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:16.085789    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fd8baea-f46b-4eec-ad0d-f8852816a514-kube-api-access-qmb9k" (OuterVolumeSpecName: "kube-api-access-qmb9k") pod "5fd8baea-f46b-4eec-ad0d-f8852816a514" (UID: "5fd8baea-f46b-4eec-ad0d-f8852816a514"). InnerVolumeSpecName "kube-api-access-qmb9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:23:16.085928 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:16.085825    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fd8baea-f46b-4eec-ad0d-f8852816a514-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5fd8baea-f46b-4eec-ad0d-f8852816a514" (UID: "5fd8baea-f46b-4eec-ad0d-f8852816a514"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:23:16.184819 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:16.184778    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fd8baea-f46b-4eec-ad0d-f8852816a514-openshift-service-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:23:16.184819 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:16.184807    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmb9k\" (UniqueName: \"kubernetes.io/projected/5fd8baea-f46b-4eec-ad0d-f8852816a514-kube-api-access-qmb9k\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:23:16.184819 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:16.184817    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fd8baea-f46b-4eec-ad0d-f8852816a514-maas-api-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:23:16.251183 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:16.251085    2565 generic.go:356] "Generic (PLEG): container finished" podID="5fd8baea-f46b-4eec-ad0d-f8852816a514" containerID="de89af67c8a2ef422dac3e00126334e43d5db4b7c98a7124f3adf31da2300605" exitCode=0
Jul 27 22:23:16.251183 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:16.251147    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"
Jul 27 22:23:16.251183 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:16.251170    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh" event={"ID":"5fd8baea-f46b-4eec-ad0d-f8852816a514","Type":"ContainerDied","Data":"de89af67c8a2ef422dac3e00126334e43d5db4b7c98a7124f3adf31da2300605"}
Jul 27 22:23:16.251523 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:16.251249    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh" event={"ID":"5fd8baea-f46b-4eec-ad0d-f8852816a514","Type":"ContainerDied","Data":"b86f5384f1f0feef3d61819eaa8470db9574d418cd41bc3ede6a1d4bd6635f07"}
Jul 27 22:23:16.251523 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:16.251279    2565 scope.go:117] "RemoveContainer" containerID="de89af67c8a2ef422dac3e00126334e43d5db4b7c98a7124f3adf31da2300605"
Jul 27 22:23:16.263767 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:16.263720    2565 scope.go:117] "RemoveContainer" containerID="de89af67c8a2ef422dac3e00126334e43d5db4b7c98a7124f3adf31da2300605"
Jul 27 22:23:16.264174 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:23:16.264151    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de89af67c8a2ef422dac3e00126334e43d5db4b7c98a7124f3adf31da2300605\": container with ID starting with de89af67c8a2ef422dac3e00126334e43d5db4b7c98a7124f3adf31da2300605 not found: ID does not exist" containerID="de89af67c8a2ef422dac3e00126334e43d5db4b7c98a7124f3adf31da2300605"
Jul 27 22:23:16.264260 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:16.264184    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de89af67c8a2ef422dac3e00126334e43d5db4b7c98a7124f3adf31da2300605"} err="failed to get container status \"de89af67c8a2ef422dac3e00126334e43d5db4b7c98a7124f3adf31da2300605\": rpc error: code = NotFound desc = could not find container \"de89af67c8a2ef422dac3e00126334e43d5db4b7c98a7124f3adf31da2300605\": container with ID starting with de89af67c8a2ef422dac3e00126334e43d5db4b7c98a7124f3adf31da2300605 not found: ID does not exist"
Jul 27 22:23:16.275422 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:16.275400    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"]
Jul 27 22:23:16.279822 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:16.279800    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-732c17ff-679646c8cc-nqvdh"]
Jul 27 22:23:17.816679 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:17.816646    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fd8baea-f46b-4eec-ad0d-f8852816a514" path="/var/lib/kubelet/pods/5fd8baea-f46b-4eec-ad0d-f8852816a514/volumes"
Jul 27 22:23:23.390828 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:23.390789    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"]
Jul 27 22:23:23.391327 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:23.391257    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fd8baea-f46b-4eec-ad0d-f8852816a514" containerName="maas-api"
Jul 27 22:23:23.391327 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:23.391268    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fd8baea-f46b-4eec-ad0d-f8852816a514" containerName="maas-api"
Jul 27 22:23:23.391510 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:23.391358    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fd8baea-f46b-4eec-ad0d-f8852816a514" containerName="maas-api"
Jul 27 22:23:23.394462 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:23.394441    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"
Jul 27 22:23:23.397544 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:23.397520    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-294097f5-serving-cert\""
Jul 27 22:23:23.406627 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:23.406608    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"]
Jul 27 22:23:23.559567 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:23.559534    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03b50d37-788e-42fe-817b-adc1426c32cc-maas-api-tls\") pod \"maas-api-e2e-ait-294097f5-56c65546b9-m99qx\" (UID: \"03b50d37-788e-42fe-817b-adc1426c32cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"
Jul 27 22:23:23.559792 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:23.559575    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03b50d37-788e-42fe-817b-adc1426c32cc-openshift-service-ca\") pod \"maas-api-e2e-ait-294097f5-56c65546b9-m99qx\" (UID: \"03b50d37-788e-42fe-817b-adc1426c32cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"
Jul 27 22:23:23.559792 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:23.559727    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99l8f\" (UniqueName: \"kubernetes.io/projected/03b50d37-788e-42fe-817b-adc1426c32cc-kube-api-access-99l8f\") pod \"maas-api-e2e-ait-294097f5-56c65546b9-m99qx\" (UID: \"03b50d37-788e-42fe-817b-adc1426c32cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"
Jul 27 22:23:23.660776 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:23.660681    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99l8f\" (UniqueName: \"kubernetes.io/projected/03b50d37-788e-42fe-817b-adc1426c32cc-kube-api-access-99l8f\") pod \"maas-api-e2e-ait-294097f5-56c65546b9-m99qx\" (UID: \"03b50d37-788e-42fe-817b-adc1426c32cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"
Jul 27 22:23:23.660776 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:23.660733    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03b50d37-788e-42fe-817b-adc1426c32cc-maas-api-tls\") pod \"maas-api-e2e-ait-294097f5-56c65546b9-m99qx\" (UID: \"03b50d37-788e-42fe-817b-adc1426c32cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"
Jul 27 22:23:23.660776 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:23.660759    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03b50d37-788e-42fe-817b-adc1426c32cc-openshift-service-ca\") pod \"maas-api-e2e-ait-294097f5-56c65546b9-m99qx\" (UID: \"03b50d37-788e-42fe-817b-adc1426c32cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"
Jul 27 22:23:23.661447 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:23.661420    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03b50d37-788e-42fe-817b-adc1426c32cc-openshift-service-ca\") pod \"maas-api-e2e-ait-294097f5-56c65546b9-m99qx\" (UID: \"03b50d37-788e-42fe-817b-adc1426c32cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"
Jul 27 22:23:23.663330 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:23.663294    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03b50d37-788e-42fe-817b-adc1426c32cc-maas-api-tls\") pod \"maas-api-e2e-ait-294097f5-56c65546b9-m99qx\" (UID: \"03b50d37-788e-42fe-817b-adc1426c32cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"
Jul 27 22:23:23.669968 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:23.669938    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99l8f\" (UniqueName: \"kubernetes.io/projected/03b50d37-788e-42fe-817b-adc1426c32cc-kube-api-access-99l8f\") pod \"maas-api-e2e-ait-294097f5-56c65546b9-m99qx\" (UID: \"03b50d37-788e-42fe-817b-adc1426c32cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"
Jul 27 22:23:23.707483 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:23.707445    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"
Jul 27 22:23:23.843978 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:23.843952    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"]
Jul 27 22:23:23.846928 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:23:23.846899    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03b50d37_788e_42fe_817b_adc1426c32cc.slice/crio-55f4e9ce2850fd3281c969bc789399e0592ba2dee8e126da01fa5fd3a223ad83 WatchSource:0}: Error finding container 55f4e9ce2850fd3281c969bc789399e0592ba2dee8e126da01fa5fd3a223ad83: Status 404 returned error can't find the container with id 55f4e9ce2850fd3281c969bc789399e0592ba2dee8e126da01fa5fd3a223ad83
Jul 27 22:23:24.301788 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:24.301753    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx" event={"ID":"03b50d37-788e-42fe-817b-adc1426c32cc","Type":"ContainerStarted","Data":"55f4e9ce2850fd3281c969bc789399e0592ba2dee8e126da01fa5fd3a223ad83"}
Jul 27 22:23:25.308101 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:25.308063    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx" event={"ID":"03b50d37-788e-42fe-817b-adc1426c32cc","Type":"ContainerStarted","Data":"f78dc7cf73e56800e57c6e7c5468b1e613965d59e57df29d574399772fc68093"}
Jul 27 22:23:25.308527 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:25.308150    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"
Jul 27 22:23:25.328386 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:25.328312    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx" podStartSLOduration=1.9932832029999998 podStartE2EDuration="2.328294557s" totalImagesPullingTime="335.011354ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:23:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:23:25.326219677 +0000 UTC m=+1750.067354465" watchObservedRunningTime="2026-07-27 22:23:25.328294557 +0000 UTC m=+1750.069429328"
Jul 27 22:23:31.318723 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:31.318693    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"
Jul 27 22:23:59.603510 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:59.603466    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"]
Jul 27 22:23:59.604130 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:59.603685    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx" podUID="03b50d37-788e-42fe-817b-adc1426c32cc" containerName="maas-api" containerID="cri-o://f78dc7cf73e56800e57c6e7c5468b1e613965d59e57df29d574399772fc68093" gracePeriod=30
Jul 27 22:23:59.860933 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:23:59.860873    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"
Jul 27 22:24:00.017812 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:00.017771    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03b50d37-788e-42fe-817b-adc1426c32cc-openshift-service-ca\") pod \"03b50d37-788e-42fe-817b-adc1426c32cc\" (UID: \"03b50d37-788e-42fe-817b-adc1426c32cc\") "
Jul 27 22:24:00.017992 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:00.017842    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99l8f\" (UniqueName: \"kubernetes.io/projected/03b50d37-788e-42fe-817b-adc1426c32cc-kube-api-access-99l8f\") pod \"03b50d37-788e-42fe-817b-adc1426c32cc\" (UID: \"03b50d37-788e-42fe-817b-adc1426c32cc\") "
Jul 27 22:24:00.017992 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:00.017909    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03b50d37-788e-42fe-817b-adc1426c32cc-maas-api-tls\") pod \"03b50d37-788e-42fe-817b-adc1426c32cc\" (UID: \"03b50d37-788e-42fe-817b-adc1426c32cc\") "
Jul 27 22:24:00.018151 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:00.018126    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03b50d37-788e-42fe-817b-adc1426c32cc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "03b50d37-788e-42fe-817b-adc1426c32cc" (UID: "03b50d37-788e-42fe-817b-adc1426c32cc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:24:00.020067 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:00.020033    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03b50d37-788e-42fe-817b-adc1426c32cc-kube-api-access-99l8f" (OuterVolumeSpecName: "kube-api-access-99l8f") pod "03b50d37-788e-42fe-817b-adc1426c32cc" (UID: "03b50d37-788e-42fe-817b-adc1426c32cc"). InnerVolumeSpecName "kube-api-access-99l8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:24:00.020067 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:00.020033    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b50d37-788e-42fe-817b-adc1426c32cc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "03b50d37-788e-42fe-817b-adc1426c32cc" (UID: "03b50d37-788e-42fe-817b-adc1426c32cc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:24:00.119557 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:00.119478    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99l8f\" (UniqueName: \"kubernetes.io/projected/03b50d37-788e-42fe-817b-adc1426c32cc-kube-api-access-99l8f\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:24:00.119557 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:00.119506    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03b50d37-788e-42fe-817b-adc1426c32cc-maas-api-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:24:00.119557 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:00.119516    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03b50d37-788e-42fe-817b-adc1426c32cc-openshift-service-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:24:00.496887 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:00.496854    2565 generic.go:356] "Generic (PLEG): container finished" podID="03b50d37-788e-42fe-817b-adc1426c32cc" containerID="f78dc7cf73e56800e57c6e7c5468b1e613965d59e57df29d574399772fc68093" exitCode=0
Jul 27 22:24:00.497088 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:00.496897    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx" event={"ID":"03b50d37-788e-42fe-817b-adc1426c32cc","Type":"ContainerDied","Data":"f78dc7cf73e56800e57c6e7c5468b1e613965d59e57df29d574399772fc68093"}
Jul 27 22:24:00.497088 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:00.496944    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx" event={"ID":"03b50d37-788e-42fe-817b-adc1426c32cc","Type":"ContainerDied","Data":"55f4e9ce2850fd3281c969bc789399e0592ba2dee8e126da01fa5fd3a223ad83"}
Jul 27 22:24:00.497088 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:00.496974    2565 scope.go:117] "RemoveContainer" containerID="f78dc7cf73e56800e57c6e7c5468b1e613965d59e57df29d574399772fc68093"
Jul 27 22:24:00.497088 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:00.496900    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"
Jul 27 22:24:00.506465 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:00.506446    2565 scope.go:117] "RemoveContainer" containerID="f78dc7cf73e56800e57c6e7c5468b1e613965d59e57df29d574399772fc68093"
Jul 27 22:24:00.506721 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:24:00.506702    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f78dc7cf73e56800e57c6e7c5468b1e613965d59e57df29d574399772fc68093\": container with ID starting with f78dc7cf73e56800e57c6e7c5468b1e613965d59e57df29d574399772fc68093 not found: ID does not exist" containerID="f78dc7cf73e56800e57c6e7c5468b1e613965d59e57df29d574399772fc68093"
Jul 27 22:24:00.506795 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:00.506731    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f78dc7cf73e56800e57c6e7c5468b1e613965d59e57df29d574399772fc68093"} err="failed to get container status \"f78dc7cf73e56800e57c6e7c5468b1e613965d59e57df29d574399772fc68093\": rpc error: code = NotFound desc = could not find container \"f78dc7cf73e56800e57c6e7c5468b1e613965d59e57df29d574399772fc68093\": container with ID starting with f78dc7cf73e56800e57c6e7c5468b1e613965d59e57df29d574399772fc68093 not found: ID does not exist"
Jul 27 22:24:00.520915 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:00.520891    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"]
Jul 27 22:24:00.525282 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:00.525261    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-294097f5-56c65546b9-m99qx"]
Jul 27 22:24:01.816926 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:01.816890    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03b50d37-788e-42fe-817b-adc1426c32cc" path="/var/lib/kubelet/pods/03b50d37-788e-42fe-817b-adc1426c32cc/volumes"
Jul 27 22:24:08.821207 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:08.821119    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"]
Jul 27 22:24:08.821656 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:08.821550    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03b50d37-788e-42fe-817b-adc1426c32cc" containerName="maas-api"
Jul 27 22:24:08.821656 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:08.821562    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="03b50d37-788e-42fe-817b-adc1426c32cc" containerName="maas-api"
Jul 27 22:24:08.821656 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:08.821650    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="03b50d37-788e-42fe-817b-adc1426c32cc" containerName="maas-api"
Jul 27 22:24:08.826622 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:08.826598    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"
Jul 27 22:24:08.829218 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:08.829194    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-858f23ab-serving-cert\""
Jul 27 22:24:08.838020 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:08.837983    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"]
Jul 27 22:24:09.006259 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:09.006222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30ad63c2-9048-4986-ba9f-731c5e23f079-openshift-service-ca\") pod \"maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9\" (UID: \"30ad63c2-9048-4986-ba9f-731c5e23f079\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"
Jul 27 22:24:09.006488 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:09.006286    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjrhc\" (UniqueName: \"kubernetes.io/projected/30ad63c2-9048-4986-ba9f-731c5e23f079-kube-api-access-gjrhc\") pod \"maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9\" (UID: \"30ad63c2-9048-4986-ba9f-731c5e23f079\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"
Jul 27 22:24:09.006488 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:09.006470    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30ad63c2-9048-4986-ba9f-731c5e23f079-maas-api-tls\") pod \"maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9\" (UID: \"30ad63c2-9048-4986-ba9f-731c5e23f079\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"
Jul 27 22:24:09.107107 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:09.107019    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjrhc\" (UniqueName: \"kubernetes.io/projected/30ad63c2-9048-4986-ba9f-731c5e23f079-kube-api-access-gjrhc\") pod \"maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9\" (UID: \"30ad63c2-9048-4986-ba9f-731c5e23f079\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"
Jul 27 22:24:09.107267 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:09.107127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30ad63c2-9048-4986-ba9f-731c5e23f079-maas-api-tls\") pod \"maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9\" (UID: \"30ad63c2-9048-4986-ba9f-731c5e23f079\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"
Jul 27 22:24:09.107267 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:09.107152    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30ad63c2-9048-4986-ba9f-731c5e23f079-openshift-service-ca\") pod \"maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9\" (UID: \"30ad63c2-9048-4986-ba9f-731c5e23f079\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"
Jul 27 22:24:09.107759 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:09.107740    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30ad63c2-9048-4986-ba9f-731c5e23f079-openshift-service-ca\") pod \"maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9\" (UID: \"30ad63c2-9048-4986-ba9f-731c5e23f079\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"
Jul 27 22:24:09.109563 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:09.109541    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30ad63c2-9048-4986-ba9f-731c5e23f079-maas-api-tls\") pod \"maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9\" (UID: \"30ad63c2-9048-4986-ba9f-731c5e23f079\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"
Jul 27 22:24:09.126552 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:09.126527    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjrhc\" (UniqueName: \"kubernetes.io/projected/30ad63c2-9048-4986-ba9f-731c5e23f079-kube-api-access-gjrhc\") pod \"maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9\" (UID: \"30ad63c2-9048-4986-ba9f-731c5e23f079\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"
Jul 27 22:24:09.138895 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:09.138873    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"
Jul 27 22:24:09.294462 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:09.294437    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"]
Jul 27 22:24:09.296983 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:24:09.296951    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ad63c2_9048_4986_ba9f_731c5e23f079.slice/crio-ea2e30b2183737cd02cd2bdc1fc43437932d3e32ee1d31e338f318fd676f8338 WatchSource:0}: Error finding container ea2e30b2183737cd02cd2bdc1fc43437932d3e32ee1d31e338f318fd676f8338: Status 404 returned error can't find the container with id ea2e30b2183737cd02cd2bdc1fc43437932d3e32ee1d31e338f318fd676f8338
Jul 27 22:24:09.547858 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:09.547826    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9" event={"ID":"30ad63c2-9048-4986-ba9f-731c5e23f079","Type":"ContainerStarted","Data":"ea2e30b2183737cd02cd2bdc1fc43437932d3e32ee1d31e338f318fd676f8338"}
Jul 27 22:24:10.554420 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:10.554367    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9" event={"ID":"30ad63c2-9048-4986-ba9f-731c5e23f079","Type":"ContainerStarted","Data":"6bef929832f73625c4e7b240d3002229743acb02f1ce26d92b19c101944b230e"}
Jul 27 22:24:10.554799 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:10.554456    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"
Jul 27 22:24:10.573437 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:10.573379    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9" podStartSLOduration=2.112177002 podStartE2EDuration="2.573358516s" totalImagesPullingTime="461.181514ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:24:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:24:10.571912308 +0000 UTC m=+1795.313047076" watchObservedRunningTime="2026-07-27 22:24:10.573358516 +0000 UTC m=+1795.314493284"
Jul 27 22:24:16.564564 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:16.564534    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"
Jul 27 22:24:44.076025 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.075985    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"]
Jul 27 22:24:44.076542 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.076195    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9" podUID="30ad63c2-9048-4986-ba9f-731c5e23f079" containerName="maas-api" containerID="cri-o://6bef929832f73625c4e7b240d3002229743acb02f1ce26d92b19c101944b230e" gracePeriod=30
Jul 27 22:24:44.339009 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.338942    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"
Jul 27 22:24:44.439944 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.439915    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30ad63c2-9048-4986-ba9f-731c5e23f079-maas-api-tls\") pod \"30ad63c2-9048-4986-ba9f-731c5e23f079\" (UID: \"30ad63c2-9048-4986-ba9f-731c5e23f079\") "
Jul 27 22:24:44.440105 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.440018    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30ad63c2-9048-4986-ba9f-731c5e23f079-openshift-service-ca\") pod \"30ad63c2-9048-4986-ba9f-731c5e23f079\" (UID: \"30ad63c2-9048-4986-ba9f-731c5e23f079\") "
Jul 27 22:24:44.440105 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.440051    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjrhc\" (UniqueName: \"kubernetes.io/projected/30ad63c2-9048-4986-ba9f-731c5e23f079-kube-api-access-gjrhc\") pod \"30ad63c2-9048-4986-ba9f-731c5e23f079\" (UID: \"30ad63c2-9048-4986-ba9f-731c5e23f079\") "
Jul 27 22:24:44.440446 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.440419    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30ad63c2-9048-4986-ba9f-731c5e23f079-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "30ad63c2-9048-4986-ba9f-731c5e23f079" (UID: "30ad63c2-9048-4986-ba9f-731c5e23f079"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:24:44.442063 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.442037    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30ad63c2-9048-4986-ba9f-731c5e23f079-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "30ad63c2-9048-4986-ba9f-731c5e23f079" (UID: "30ad63c2-9048-4986-ba9f-731c5e23f079"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:24:44.442265 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.442243    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30ad63c2-9048-4986-ba9f-731c5e23f079-kube-api-access-gjrhc" (OuterVolumeSpecName: "kube-api-access-gjrhc") pod "30ad63c2-9048-4986-ba9f-731c5e23f079" (UID: "30ad63c2-9048-4986-ba9f-731c5e23f079"). InnerVolumeSpecName "kube-api-access-gjrhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:24:44.541025 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.540999    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30ad63c2-9048-4986-ba9f-731c5e23f079-openshift-service-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:24:44.541025 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.541024    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjrhc\" (UniqueName: \"kubernetes.io/projected/30ad63c2-9048-4986-ba9f-731c5e23f079-kube-api-access-gjrhc\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:24:44.541202 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.541034    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30ad63c2-9048-4986-ba9f-731c5e23f079-maas-api-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:24:44.735414 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.735379    2565 generic.go:356] "Generic (PLEG): container finished" podID="30ad63c2-9048-4986-ba9f-731c5e23f079" containerID="6bef929832f73625c4e7b240d3002229743acb02f1ce26d92b19c101944b230e" exitCode=0
Jul 27 22:24:44.735592 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.735424    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"
Jul 27 22:24:44.735592 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.735471    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9" event={"ID":"30ad63c2-9048-4986-ba9f-731c5e23f079","Type":"ContainerDied","Data":"6bef929832f73625c4e7b240d3002229743acb02f1ce26d92b19c101944b230e"}
Jul 27 22:24:44.735592 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.735520    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9" event={"ID":"30ad63c2-9048-4986-ba9f-731c5e23f079","Type":"ContainerDied","Data":"ea2e30b2183737cd02cd2bdc1fc43437932d3e32ee1d31e338f318fd676f8338"}
Jul 27 22:24:44.735592 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.735545    2565 scope.go:117] "RemoveContainer" containerID="6bef929832f73625c4e7b240d3002229743acb02f1ce26d92b19c101944b230e"
Jul 27 22:24:44.744647 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.744631    2565 scope.go:117] "RemoveContainer" containerID="6bef929832f73625c4e7b240d3002229743acb02f1ce26d92b19c101944b230e"
Jul 27 22:24:44.744904 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:24:44.744887    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bef929832f73625c4e7b240d3002229743acb02f1ce26d92b19c101944b230e\": container with ID starting with 6bef929832f73625c4e7b240d3002229743acb02f1ce26d92b19c101944b230e not found: ID does not exist" containerID="6bef929832f73625c4e7b240d3002229743acb02f1ce26d92b19c101944b230e"
Jul 27 22:24:44.744960 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.744912    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bef929832f73625c4e7b240d3002229743acb02f1ce26d92b19c101944b230e"} err="failed to get container status \"6bef929832f73625c4e7b240d3002229743acb02f1ce26d92b19c101944b230e\": rpc error: code = NotFound desc = could not find container \"6bef929832f73625c4e7b240d3002229743acb02f1ce26d92b19c101944b230e\": container with ID starting with 6bef929832f73625c4e7b240d3002229743acb02f1ce26d92b19c101944b230e not found: ID does not exist"
Jul 27 22:24:44.758129 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.758109    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"]
Jul 27 22:24:44.765579 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:44.765559    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-858f23ab-dc9dc49f5-jstm9"]
Jul 27 22:24:45.816276 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:24:45.816246    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30ad63c2-9048-4986-ba9f-731c5e23f079" path="/var/lib/kubelet/pods/30ad63c2-9048-4986-ba9f-731c5e23f079/volumes"
Jul 27 22:26:31.200980 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:31.200907    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"]
Jul 27 22:26:31.205364 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:31.202090    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30ad63c2-9048-4986-ba9f-731c5e23f079" containerName="maas-api"
Jul 27 22:26:31.205364 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:31.202124    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="30ad63c2-9048-4986-ba9f-731c5e23f079" containerName="maas-api"
Jul 27 22:26:31.205364 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:31.202468    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="30ad63c2-9048-4986-ba9f-731c5e23f079" containerName="maas-api"
Jul 27 22:26:31.210307 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:31.210282    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"
Jul 27 22:26:31.213971 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:31.213944    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-92c78b5c-serving-cert\""
Jul 27 22:26:31.215876 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:31.215851    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"]
Jul 27 22:26:31.364650 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:31.364616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c8ff5b1-baa5-4563-9108-7d8924bdce6f-maas-api-tls\") pod \"maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g\" (UID: \"6c8ff5b1-baa5-4563-9108-7d8924bdce6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"
Jul 27 22:26:31.364650 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:31.364654    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c8ff5b1-baa5-4563-9108-7d8924bdce6f-openshift-service-ca\") pod \"maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g\" (UID: \"6c8ff5b1-baa5-4563-9108-7d8924bdce6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"
Jul 27 22:26:31.364890 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:31.364793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt29s\" (UniqueName: \"kubernetes.io/projected/6c8ff5b1-baa5-4563-9108-7d8924bdce6f-kube-api-access-tt29s\") pod \"maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g\" (UID: \"6c8ff5b1-baa5-4563-9108-7d8924bdce6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"
Jul 27 22:26:31.465546 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:31.465509    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt29s\" (UniqueName: \"kubernetes.io/projected/6c8ff5b1-baa5-4563-9108-7d8924bdce6f-kube-api-access-tt29s\") pod \"maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g\" (UID: \"6c8ff5b1-baa5-4563-9108-7d8924bdce6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"
Jul 27 22:26:31.465747 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:31.465601    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c8ff5b1-baa5-4563-9108-7d8924bdce6f-maas-api-tls\") pod \"maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g\" (UID: \"6c8ff5b1-baa5-4563-9108-7d8924bdce6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"
Jul 27 22:26:31.465747 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:31.465627    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c8ff5b1-baa5-4563-9108-7d8924bdce6f-openshift-service-ca\") pod \"maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g\" (UID: \"6c8ff5b1-baa5-4563-9108-7d8924bdce6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"
Jul 27 22:26:31.466306 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:31.466281    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c8ff5b1-baa5-4563-9108-7d8924bdce6f-openshift-service-ca\") pod \"maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g\" (UID: \"6c8ff5b1-baa5-4563-9108-7d8924bdce6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"
Jul 27 22:26:31.468005 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:31.467978    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c8ff5b1-baa5-4563-9108-7d8924bdce6f-maas-api-tls\") pod \"maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g\" (UID: \"6c8ff5b1-baa5-4563-9108-7d8924bdce6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"
Jul 27 22:26:31.475468 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:31.475446    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt29s\" (UniqueName: \"kubernetes.io/projected/6c8ff5b1-baa5-4563-9108-7d8924bdce6f-kube-api-access-tt29s\") pod \"maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g\" (UID: \"6c8ff5b1-baa5-4563-9108-7d8924bdce6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"
Jul 27 22:26:31.523474 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:31.523439    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"
Jul 27 22:26:31.875692 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:31.875666    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"]
Jul 27 22:26:31.878460 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:26:31.878433    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c8ff5b1_baa5_4563_9108_7d8924bdce6f.slice/crio-cda2517dd479daf66eff76e34279382c4daf76df565de3d7871df518226485be WatchSource:0}: Error finding container cda2517dd479daf66eff76e34279382c4daf76df565de3d7871df518226485be: Status 404 returned error can't find the container with id cda2517dd479daf66eff76e34279382c4daf76df565de3d7871df518226485be
Jul 27 22:26:32.300090 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:32.300058    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g" event={"ID":"6c8ff5b1-baa5-4563-9108-7d8924bdce6f","Type":"ContainerStarted","Data":"cda2517dd479daf66eff76e34279382c4daf76df565de3d7871df518226485be"}
Jul 27 22:26:33.306664 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:33.306616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g" event={"ID":"6c8ff5b1-baa5-4563-9108-7d8924bdce6f","Type":"ContainerStarted","Data":"cc9975714bcdd31a39b3f43e5b9eb7ce914f4f5737c023fd58f23ef06421ebd5"}
Jul 27 22:26:33.307089 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:33.306724    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"
Jul 27 22:26:33.324947 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:33.324899    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g" podStartSLOduration=1.831770817 podStartE2EDuration="2.324883768s" totalImagesPullingTime="493.112951ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:26:33.322948051 +0000 UTC m=+1938.064082824" watchObservedRunningTime="2026-07-27 22:26:33.324883768 +0000 UTC m=+1938.066018535"
Jul 27 22:26:39.318163 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:39.318129    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"
Jul 27 22:26:53.003324 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.003279    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"]
Jul 27 22:26:53.003893 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.003559    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g" podUID="6c8ff5b1-baa5-4563-9108-7d8924bdce6f" containerName="maas-api" containerID="cri-o://cc9975714bcdd31a39b3f43e5b9eb7ce914f4f5737c023fd58f23ef06421ebd5" gracePeriod=30
Jul 27 22:26:53.256863 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.256757    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"
Jul 27 22:26:53.277754 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.277723    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt29s\" (UniqueName: \"kubernetes.io/projected/6c8ff5b1-baa5-4563-9108-7d8924bdce6f-kube-api-access-tt29s\") pod \"6c8ff5b1-baa5-4563-9108-7d8924bdce6f\" (UID: \"6c8ff5b1-baa5-4563-9108-7d8924bdce6f\") "
Jul 27 22:26:53.278100 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.278074    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c8ff5b1-baa5-4563-9108-7d8924bdce6f-openshift-service-ca\") pod \"6c8ff5b1-baa5-4563-9108-7d8924bdce6f\" (UID: \"6c8ff5b1-baa5-4563-9108-7d8924bdce6f\") "
Jul 27 22:26:53.278230 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.278183    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c8ff5b1-baa5-4563-9108-7d8924bdce6f-maas-api-tls\") pod \"6c8ff5b1-baa5-4563-9108-7d8924bdce6f\" (UID: \"6c8ff5b1-baa5-4563-9108-7d8924bdce6f\") "
Jul 27 22:26:53.278480 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.278411    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c8ff5b1-baa5-4563-9108-7d8924bdce6f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6c8ff5b1-baa5-4563-9108-7d8924bdce6f" (UID: "6c8ff5b1-baa5-4563-9108-7d8924bdce6f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:26:53.278617 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.278563    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c8ff5b1-baa5-4563-9108-7d8924bdce6f-openshift-service-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:26:53.280093 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.280070    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c8ff5b1-baa5-4563-9108-7d8924bdce6f-kube-api-access-tt29s" (OuterVolumeSpecName: "kube-api-access-tt29s") pod "6c8ff5b1-baa5-4563-9108-7d8924bdce6f" (UID: "6c8ff5b1-baa5-4563-9108-7d8924bdce6f"). InnerVolumeSpecName "kube-api-access-tt29s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:26:53.280321 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.280286    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c8ff5b1-baa5-4563-9108-7d8924bdce6f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6c8ff5b1-baa5-4563-9108-7d8924bdce6f" (UID: "6c8ff5b1-baa5-4563-9108-7d8924bdce6f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:26:53.379737 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.379699    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c8ff5b1-baa5-4563-9108-7d8924bdce6f-maas-api-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:26:53.379737 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.379727    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt29s\" (UniqueName: \"kubernetes.io/projected/6c8ff5b1-baa5-4563-9108-7d8924bdce6f-kube-api-access-tt29s\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:26:53.418872 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.418840    2565 generic.go:356] "Generic (PLEG): container finished" podID="6c8ff5b1-baa5-4563-9108-7d8924bdce6f" containerID="cc9975714bcdd31a39b3f43e5b9eb7ce914f4f5737c023fd58f23ef06421ebd5" exitCode=0
Jul 27 22:26:53.419086 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.418893    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g" event={"ID":"6c8ff5b1-baa5-4563-9108-7d8924bdce6f","Type":"ContainerDied","Data":"cc9975714bcdd31a39b3f43e5b9eb7ce914f4f5737c023fd58f23ef06421ebd5"}
Jul 27 22:26:53.419086 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.418931    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g" event={"ID":"6c8ff5b1-baa5-4563-9108-7d8924bdce6f","Type":"ContainerDied","Data":"cda2517dd479daf66eff76e34279382c4daf76df565de3d7871df518226485be"}
Jul 27 22:26:53.419086 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.418951    2565 scope.go:117] "RemoveContainer" containerID="cc9975714bcdd31a39b3f43e5b9eb7ce914f4f5737c023fd58f23ef06421ebd5"
Jul 27 22:26:53.419086 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.418894    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"
Jul 27 22:26:53.428614 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.428591    2565 scope.go:117] "RemoveContainer" containerID="cc9975714bcdd31a39b3f43e5b9eb7ce914f4f5737c023fd58f23ef06421ebd5"
Jul 27 22:26:53.428870 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:26:53.428853    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc9975714bcdd31a39b3f43e5b9eb7ce914f4f5737c023fd58f23ef06421ebd5\": container with ID starting with cc9975714bcdd31a39b3f43e5b9eb7ce914f4f5737c023fd58f23ef06421ebd5 not found: ID does not exist" containerID="cc9975714bcdd31a39b3f43e5b9eb7ce914f4f5737c023fd58f23ef06421ebd5"
Jul 27 22:26:53.428909 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.428883    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc9975714bcdd31a39b3f43e5b9eb7ce914f4f5737c023fd58f23ef06421ebd5"} err="failed to get container status \"cc9975714bcdd31a39b3f43e5b9eb7ce914f4f5737c023fd58f23ef06421ebd5\": rpc error: code = NotFound desc = could not find container \"cc9975714bcdd31a39b3f43e5b9eb7ce914f4f5737c023fd58f23ef06421ebd5\": container with ID starting with cc9975714bcdd31a39b3f43e5b9eb7ce914f4f5737c023fd58f23ef06421ebd5 not found: ID does not exist"
Jul 27 22:26:53.447140 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.446822    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"]
Jul 27 22:26:53.447140 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.446884    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-92c78b5c-689c7d5747-7kj2g"]
Jul 27 22:26:53.817174 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:26:53.817137    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c8ff5b1-baa5-4563-9108-7d8924bdce6f" path="/var/lib/kubelet/pods/6c8ff5b1-baa5-4563-9108-7d8924bdce6f/volumes"
Jul 27 22:27:28.284105 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:28.284069    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"]
Jul 27 22:27:28.284738 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:28.284566    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c8ff5b1-baa5-4563-9108-7d8924bdce6f" containerName="maas-api"
Jul 27 22:27:28.284738 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:28.284581    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c8ff5b1-baa5-4563-9108-7d8924bdce6f" containerName="maas-api"
Jul 27 22:27:28.284738 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:28.284683    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c8ff5b1-baa5-4563-9108-7d8924bdce6f" containerName="maas-api"
Jul 27 22:27:28.288923 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:28.288905    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"
Jul 27 22:27:28.292481 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:28.292458    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-d2650623-serving-cert\""
Jul 27 22:27:28.314163 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:28.314134    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"]
Jul 27 22:27:28.324711 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:28.324680    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zbqj\" (UniqueName: \"kubernetes.io/projected/2408436f-c9b4-49b5-b84c-9055e44a56ce-kube-api-access-5zbqj\") pod \"maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr\" (UID: \"2408436f-c9b4-49b5-b84c-9055e44a56ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"
Jul 27 22:27:28.324864 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:28.324739    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2408436f-c9b4-49b5-b84c-9055e44a56ce-openshift-service-ca\") pod \"maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr\" (UID: \"2408436f-c9b4-49b5-b84c-9055e44a56ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"
Jul 27 22:27:28.324864 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:28.324791    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2408436f-c9b4-49b5-b84c-9055e44a56ce-maas-api-tls\") pod \"maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr\" (UID: \"2408436f-c9b4-49b5-b84c-9055e44a56ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"
Jul 27 22:27:28.425951 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:28.425919    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2408436f-c9b4-49b5-b84c-9055e44a56ce-maas-api-tls\") pod \"maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr\" (UID: \"2408436f-c9b4-49b5-b84c-9055e44a56ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"
Jul 27 22:27:28.426131 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:28.426000    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zbqj\" (UniqueName: \"kubernetes.io/projected/2408436f-c9b4-49b5-b84c-9055e44a56ce-kube-api-access-5zbqj\") pod \"maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr\" (UID: \"2408436f-c9b4-49b5-b84c-9055e44a56ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"
Jul 27 22:27:28.426131 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:27:28.426088    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-serving-cert: secret "maas-api-e2e-mt-d2650623-serving-cert" not found
Jul 27 22:27:28.426206 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:27:28.426152    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2408436f-c9b4-49b5-b84c-9055e44a56ce-maas-api-tls podName:2408436f-c9b4-49b5-b84c-9055e44a56ce nodeName:}" failed. No retries permitted until 2026-07-27 22:27:28.926132457 +0000 UTC m=+1993.667267206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2408436f-c9b4-49b5-b84c-9055e44a56ce-maas-api-tls") pod "maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr" (UID: "2408436f-c9b4-49b5-b84c-9055e44a56ce") : secret "maas-api-e2e-mt-d2650623-serving-cert" not found
Jul 27 22:27:28.426206 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:28.426167    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2408436f-c9b4-49b5-b84c-9055e44a56ce-openshift-service-ca\") pod \"maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr\" (UID: \"2408436f-c9b4-49b5-b84c-9055e44a56ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"
Jul 27 22:27:28.426857 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:28.426838    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2408436f-c9b4-49b5-b84c-9055e44a56ce-openshift-service-ca\") pod \"maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr\" (UID: \"2408436f-c9b4-49b5-b84c-9055e44a56ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"
Jul 27 22:27:28.441770 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:28.441744    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zbqj\" (UniqueName: \"kubernetes.io/projected/2408436f-c9b4-49b5-b84c-9055e44a56ce-kube-api-access-5zbqj\") pod \"maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr\" (UID: \"2408436f-c9b4-49b5-b84c-9055e44a56ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"
Jul 27 22:27:28.931743 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:28.931708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2408436f-c9b4-49b5-b84c-9055e44a56ce-maas-api-tls\") pod \"maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr\" (UID: \"2408436f-c9b4-49b5-b84c-9055e44a56ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"
Jul 27 22:27:28.934149 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:28.934121    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2408436f-c9b4-49b5-b84c-9055e44a56ce-maas-api-tls\") pod \"maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr\" (UID: \"2408436f-c9b4-49b5-b84c-9055e44a56ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"
Jul 27 22:27:29.199399 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:29.199305    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"
Jul 27 22:27:29.338507 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:29.338477    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"]
Jul 27 22:27:29.340280 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:27:29.340254    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2408436f_c9b4_49b5_b84c_9055e44a56ce.slice/crio-8dd76653250d342aacd9c86007a1accb7e43d5590f9bacb83ed557c0cd2ec162 WatchSource:0}: Error finding container 8dd76653250d342aacd9c86007a1accb7e43d5590f9bacb83ed557c0cd2ec162: Status 404 returned error can't find the container with id 8dd76653250d342aacd9c86007a1accb7e43d5590f9bacb83ed557c0cd2ec162
Jul 27 22:27:29.341619 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:29.341600    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 22:27:29.599879 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:29.599842    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr" event={"ID":"2408436f-c9b4-49b5-b84c-9055e44a56ce","Type":"ContainerStarted","Data":"8dd76653250d342aacd9c86007a1accb7e43d5590f9bacb83ed557c0cd2ec162"}
Jul 27 22:27:30.605901 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:30.605865    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr" event={"ID":"2408436f-c9b4-49b5-b84c-9055e44a56ce","Type":"ContainerStarted","Data":"c899a2266fdb345ed97e2d75f003f3b9e865f0035bc1eb33df1682e77b56033f"}
Jul 27 22:27:30.606326 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:30.605975    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"
Jul 27 22:27:30.625707 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:30.625659    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr" podStartSLOduration=2.193560471 podStartE2EDuration="2.625645334s" totalImagesPullingTime="432.084863ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:27:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:27:30.623618002 +0000 UTC m=+1995.364752763" watchObservedRunningTime="2026-07-27 22:27:30.625645334 +0000 UTC m=+1995.366780101"
Jul 27 22:27:36.623632 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:27:36.623599    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"
Jul 27 22:28:22.752833 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:28:22.752789    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"]
Jul 27 22:28:22.753471 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:28:22.753023    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr" podUID="2408436f-c9b4-49b5-b84c-9055e44a56ce" containerName="maas-api" containerID="cri-o://c899a2266fdb345ed97e2d75f003f3b9e865f0035bc1eb33df1682e77b56033f" gracePeriod=30
Jul 27 22:28:22.883976 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:28:22.883944    2565 generic.go:356] "Generic (PLEG): container finished" podID="2408436f-c9b4-49b5-b84c-9055e44a56ce" containerID="c899a2266fdb345ed97e2d75f003f3b9e865f0035bc1eb33df1682e77b56033f" exitCode=0
Jul 27 22:28:22.884129 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:28:22.884012    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr" event={"ID":"2408436f-c9b4-49b5-b84c-9055e44a56ce","Type":"ContainerDied","Data":"c899a2266fdb345ed97e2d75f003f3b9e865f0035bc1eb33df1682e77b56033f"}
Jul 27 22:28:23.016588 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:28:23.016515    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"
Jul 27 22:28:23.157795 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:28:23.157757    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2408436f-c9b4-49b5-b84c-9055e44a56ce-openshift-service-ca\") pod \"2408436f-c9b4-49b5-b84c-9055e44a56ce\" (UID: \"2408436f-c9b4-49b5-b84c-9055e44a56ce\") "
Jul 27 22:28:23.157985 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:28:23.157809    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zbqj\" (UniqueName: \"kubernetes.io/projected/2408436f-c9b4-49b5-b84c-9055e44a56ce-kube-api-access-5zbqj\") pod \"2408436f-c9b4-49b5-b84c-9055e44a56ce\" (UID: \"2408436f-c9b4-49b5-b84c-9055e44a56ce\") "
Jul 27 22:28:23.157985 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:28:23.157891    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2408436f-c9b4-49b5-b84c-9055e44a56ce-maas-api-tls\") pod \"2408436f-c9b4-49b5-b84c-9055e44a56ce\" (UID: \"2408436f-c9b4-49b5-b84c-9055e44a56ce\") "
Jul 27 22:28:23.158226 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:28:23.158198    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2408436f-c9b4-49b5-b84c-9055e44a56ce-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2408436f-c9b4-49b5-b84c-9055e44a56ce" (UID: "2408436f-c9b4-49b5-b84c-9055e44a56ce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:28:23.159953 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:28:23.159932    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2408436f-c9b4-49b5-b84c-9055e44a56ce-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2408436f-c9b4-49b5-b84c-9055e44a56ce" (UID: "2408436f-c9b4-49b5-b84c-9055e44a56ce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:28:23.160083 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:28:23.160062    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2408436f-c9b4-49b5-b84c-9055e44a56ce-kube-api-access-5zbqj" (OuterVolumeSpecName: "kube-api-access-5zbqj") pod "2408436f-c9b4-49b5-b84c-9055e44a56ce" (UID: "2408436f-c9b4-49b5-b84c-9055e44a56ce"). InnerVolumeSpecName "kube-api-access-5zbqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:28:23.259567 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:28:23.259513    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zbqj\" (UniqueName: \"kubernetes.io/projected/2408436f-c9b4-49b5-b84c-9055e44a56ce-kube-api-access-5zbqj\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:28:23.259567 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:28:23.259563    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2408436f-c9b4-49b5-b84c-9055e44a56ce-maas-api-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:28:23.259567 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:28:23.259573    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2408436f-c9b4-49b5-b84c-9055e44a56ce-openshift-service-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:28:23.895889 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:28:23.895848    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr" event={"ID":"2408436f-c9b4-49b5-b84c-9055e44a56ce","Type":"ContainerDied","Data":"8dd76653250d342aacd9c86007a1accb7e43d5590f9bacb83ed557c0cd2ec162"}
Jul 27 22:28:23.896301 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:28:23.895898    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"
Jul 27 22:28:23.896301 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:28:23.895933    2565 scope.go:117] "RemoveContainer" containerID="c899a2266fdb345ed97e2d75f003f3b9e865f0035bc1eb33df1682e77b56033f"
Jul 27 22:28:23.914347 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:28:23.914304    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"]
Jul 27 22:28:23.920365 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:28:23.920326    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d2650623-7cccc4bcbb-8mpxr"]
Jul 27 22:28:25.817699 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:28:25.817661    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2408436f-c9b4-49b5-b84c-9055e44a56ce" path="/var/lib/kubelet/pods/2408436f-c9b4-49b5-b84c-9055e44a56ce/volumes"
Jul 27 22:30:17.259608 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:17.259524    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"]
Jul 27 22:30:17.260169 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:17.260150    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2408436f-c9b4-49b5-b84c-9055e44a56ce" containerName="maas-api"
Jul 27 22:30:17.260233 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:17.260174    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2408436f-c9b4-49b5-b84c-9055e44a56ce" containerName="maas-api"
Jul 27 22:30:17.260361 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:17.260326    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2408436f-c9b4-49b5-b84c-9055e44a56ce" containerName="maas-api"
Jul 27 22:30:17.264152 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:17.264128    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"
Jul 27 22:30:17.266900 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:17.266877    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-d5bbdd-serving-cert\""
Jul 27 22:30:17.276703 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:17.276680    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"]
Jul 27 22:30:17.330920 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:17.330882    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79d6fd04-aa3b-447c-bd84-39be7fd33731-maas-api-tls\") pod \"maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx\" (UID: \"79d6fd04-aa3b-447c-bd84-39be7fd33731\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"
Jul 27 22:30:17.331135 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:17.330933    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79d6fd04-aa3b-447c-bd84-39be7fd33731-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx\" (UID: \"79d6fd04-aa3b-447c-bd84-39be7fd33731\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"
Jul 27 22:30:17.331135 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:17.330960    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl77r\" (UniqueName: \"kubernetes.io/projected/79d6fd04-aa3b-447c-bd84-39be7fd33731-kube-api-access-xl77r\") pod \"maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx\" (UID: \"79d6fd04-aa3b-447c-bd84-39be7fd33731\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"
Jul 27 22:30:17.431582 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:17.431535    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79d6fd04-aa3b-447c-bd84-39be7fd33731-maas-api-tls\") pod \"maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx\" (UID: \"79d6fd04-aa3b-447c-bd84-39be7fd33731\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"
Jul 27 22:30:17.431775 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:17.431685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79d6fd04-aa3b-447c-bd84-39be7fd33731-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx\" (UID: \"79d6fd04-aa3b-447c-bd84-39be7fd33731\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"
Jul 27 22:30:17.431775 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:17.431721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl77r\" (UniqueName: \"kubernetes.io/projected/79d6fd04-aa3b-447c-bd84-39be7fd33731-kube-api-access-xl77r\") pod \"maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx\" (UID: \"79d6fd04-aa3b-447c-bd84-39be7fd33731\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"
Jul 27 22:30:17.432484 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:17.432455    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79d6fd04-aa3b-447c-bd84-39be7fd33731-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx\" (UID: \"79d6fd04-aa3b-447c-bd84-39be7fd33731\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"
Jul 27 22:30:17.434097 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:17.434066    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79d6fd04-aa3b-447c-bd84-39be7fd33731-maas-api-tls\") pod \"maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx\" (UID: \"79d6fd04-aa3b-447c-bd84-39be7fd33731\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"
Jul 27 22:30:17.441026 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:17.441000    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl77r\" (UniqueName: \"kubernetes.io/projected/79d6fd04-aa3b-447c-bd84-39be7fd33731-kube-api-access-xl77r\") pod \"maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx\" (UID: \"79d6fd04-aa3b-447c-bd84-39be7fd33731\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"
Jul 27 22:30:17.577585 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:17.577494    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"
Jul 27 22:30:17.722257 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:17.722227    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"]
Jul 27 22:30:17.724301 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:30:17.724276    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79d6fd04_aa3b_447c_bd84_39be7fd33731.slice/crio-611e3ed4ec1180a44049ea186ff09b4a0bdae47831c5cfc72977ad90e2edb352 WatchSource:0}: Error finding container 611e3ed4ec1180a44049ea186ff09b4a0bdae47831c5cfc72977ad90e2edb352: Status 404 returned error can't find the container with id 611e3ed4ec1180a44049ea186ff09b4a0bdae47831c5cfc72977ad90e2edb352
Jul 27 22:30:18.487698 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:18.487595    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx" event={"ID":"79d6fd04-aa3b-447c-bd84-39be7fd33731","Type":"ContainerStarted","Data":"2e59629ebab664066b5459b7929d027686bf68d6e1447920abaeef82dc0126d1"}
Jul 27 22:30:18.487698 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:18.487663    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"
Jul 27 22:30:18.487698 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:18.487685    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx" event={"ID":"79d6fd04-aa3b-447c-bd84-39be7fd33731","Type":"ContainerStarted","Data":"611e3ed4ec1180a44049ea186ff09b4a0bdae47831c5cfc72977ad90e2edb352"}
Jul 27 22:30:18.504797 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:18.504746    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx" podStartSLOduration=1.011234647 podStartE2EDuration="1.504730161s" totalImagesPullingTime="493.495514ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:30:18.50355942 +0000 UTC m=+2163.244694189" watchObservedRunningTime="2026-07-27 22:30:18.504730161 +0000 UTC m=+2163.245865092"
Jul 27 22:30:24.498268 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:24.498235    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"
Jul 27 22:30:25.147479 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:25.147439    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"]
Jul 27 22:30:25.151840 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:25.151816    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"
Jul 27 22:30:25.154365 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:25.154327    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-b2aa15-serving-cert\""
Jul 27 22:30:25.167734 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:25.167710    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"]
Jul 27 22:30:25.208493 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:25.208460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsjxw\" (UniqueName: \"kubernetes.io/projected/3804f289-1289-4e69-976f-faeb3fbf474e-kube-api-access-vsjxw\") pod \"maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf\" (UID: \"3804f289-1289-4e69-976f-faeb3fbf474e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"
Jul 27 22:30:25.208632 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:25.208504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3804f289-1289-4e69-976f-faeb3fbf474e-maas-api-tls\") pod \"maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf\" (UID: \"3804f289-1289-4e69-976f-faeb3fbf474e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"
Jul 27 22:30:25.208632 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:25.208597    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3804f289-1289-4e69-976f-faeb3fbf474e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf\" (UID: \"3804f289-1289-4e69-976f-faeb3fbf474e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"
Jul 27 22:30:25.309421 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:25.309383    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsjxw\" (UniqueName: \"kubernetes.io/projected/3804f289-1289-4e69-976f-faeb3fbf474e-kube-api-access-vsjxw\") pod \"maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf\" (UID: \"3804f289-1289-4e69-976f-faeb3fbf474e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"
Jul 27 22:30:25.309601 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:25.309426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3804f289-1289-4e69-976f-faeb3fbf474e-maas-api-tls\") pod \"maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf\" (UID: \"3804f289-1289-4e69-976f-faeb3fbf474e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"
Jul 27 22:30:25.309601 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:25.309490    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3804f289-1289-4e69-976f-faeb3fbf474e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf\" (UID: \"3804f289-1289-4e69-976f-faeb3fbf474e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"
Jul 27 22:30:25.310206 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:25.310180    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3804f289-1289-4e69-976f-faeb3fbf474e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf\" (UID: \"3804f289-1289-4e69-976f-faeb3fbf474e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"
Jul 27 22:30:25.311926 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:25.311904    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3804f289-1289-4e69-976f-faeb3fbf474e-maas-api-tls\") pod \"maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf\" (UID: \"3804f289-1289-4e69-976f-faeb3fbf474e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"
Jul 27 22:30:25.320248 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:25.320223    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsjxw\" (UniqueName: \"kubernetes.io/projected/3804f289-1289-4e69-976f-faeb3fbf474e-kube-api-access-vsjxw\") pod \"maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf\" (UID: \"3804f289-1289-4e69-976f-faeb3fbf474e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"
Jul 27 22:30:25.466055 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:25.466026    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"
Jul 27 22:30:25.606589 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:25.606562    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"]
Jul 27 22:30:25.608425 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:30:25.608397    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3804f289_1289_4e69_976f_faeb3fbf474e.slice/crio-af0f0554f1e04d0765d3b9cce6f44fb8d1c24a33d7c9d9f1495470f25d00a3c2 WatchSource:0}: Error finding container af0f0554f1e04d0765d3b9cce6f44fb8d1c24a33d7c9d9f1495470f25d00a3c2: Status 404 returned error can't find the container with id af0f0554f1e04d0765d3b9cce6f44fb8d1c24a33d7c9d9f1495470f25d00a3c2
Jul 27 22:30:26.530143 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:26.530107    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf" event={"ID":"3804f289-1289-4e69-976f-faeb3fbf474e","Type":"ContainerStarted","Data":"6f690660cf05435aa361d056c0b82bb9662ad1c049d4769adee4421386b9e2c1"}
Jul 27 22:30:26.530367 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:26.530171    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf" event={"ID":"3804f289-1289-4e69-976f-faeb3fbf474e","Type":"ContainerStarted","Data":"af0f0554f1e04d0765d3b9cce6f44fb8d1c24a33d7c9d9f1495470f25d00a3c2"}
Jul 27 22:30:26.530367 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:26.530199    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"
Jul 27 22:30:26.548954 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:26.548904    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf" podStartSLOduration=1.28597247 podStartE2EDuration="1.548889342s" totalImagesPullingTime="262.916872ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:30:26.547289946 +0000 UTC m=+2171.288424714" watchObservedRunningTime="2026-07-27 22:30:26.548889342 +0000 UTC m=+2171.290024110"
Jul 27 22:30:32.542092 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:30:32.542065    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"
Jul 27 22:31:55.413064 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:55.413025    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"]
Jul 27 22:31:55.413642 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:55.413280    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx" podUID="79d6fd04-aa3b-447c-bd84-39be7fd33731" containerName="maas-api" containerID="cri-o://2e59629ebab664066b5459b7929d027686bf68d6e1447920abaeef82dc0126d1" gracePeriod=30
Jul 27 22:31:55.671786 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:55.671716    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"
Jul 27 22:31:55.718139 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:55.718111    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79d6fd04-aa3b-447c-bd84-39be7fd33731-openshift-service-ca\") pod \"79d6fd04-aa3b-447c-bd84-39be7fd33731\" (UID: \"79d6fd04-aa3b-447c-bd84-39be7fd33731\") "
Jul 27 22:31:55.718315 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:55.718174    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xl77r\" (UniqueName: \"kubernetes.io/projected/79d6fd04-aa3b-447c-bd84-39be7fd33731-kube-api-access-xl77r\") pod \"79d6fd04-aa3b-447c-bd84-39be7fd33731\" (UID: \"79d6fd04-aa3b-447c-bd84-39be7fd33731\") "
Jul 27 22:31:55.718315 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:55.718275    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79d6fd04-aa3b-447c-bd84-39be7fd33731-maas-api-tls\") pod \"79d6fd04-aa3b-447c-bd84-39be7fd33731\" (UID: \"79d6fd04-aa3b-447c-bd84-39be7fd33731\") "
Jul 27 22:31:55.718493 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:55.718471    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79d6fd04-aa3b-447c-bd84-39be7fd33731-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "79d6fd04-aa3b-447c-bd84-39be7fd33731" (UID: "79d6fd04-aa3b-447c-bd84-39be7fd33731"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:31:55.718630 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:55.718607    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79d6fd04-aa3b-447c-bd84-39be7fd33731-openshift-service-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:31:55.720245 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:55.720220    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79d6fd04-aa3b-447c-bd84-39be7fd33731-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "79d6fd04-aa3b-447c-bd84-39be7fd33731" (UID: "79d6fd04-aa3b-447c-bd84-39be7fd33731"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:31:55.720360 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:55.720263    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79d6fd04-aa3b-447c-bd84-39be7fd33731-kube-api-access-xl77r" (OuterVolumeSpecName: "kube-api-access-xl77r") pod "79d6fd04-aa3b-447c-bd84-39be7fd33731" (UID: "79d6fd04-aa3b-447c-bd84-39be7fd33731"). InnerVolumeSpecName "kube-api-access-xl77r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:31:55.819192 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:55.819155    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xl77r\" (UniqueName: \"kubernetes.io/projected/79d6fd04-aa3b-447c-bd84-39be7fd33731-kube-api-access-xl77r\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:31:55.819192 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:55.819184    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79d6fd04-aa3b-447c-bd84-39be7fd33731-maas-api-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:31:55.993874 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:55.993840    2565 generic.go:356] "Generic (PLEG): container finished" podID="79d6fd04-aa3b-447c-bd84-39be7fd33731" containerID="2e59629ebab664066b5459b7929d027686bf68d6e1447920abaeef82dc0126d1" exitCode=0
Jul 27 22:31:55.994077 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:55.993886    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"
Jul 27 22:31:55.994077 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:55.993923    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx" event={"ID":"79d6fd04-aa3b-447c-bd84-39be7fd33731","Type":"ContainerDied","Data":"2e59629ebab664066b5459b7929d027686bf68d6e1447920abaeef82dc0126d1"}
Jul 27 22:31:55.994077 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:55.993982    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx" event={"ID":"79d6fd04-aa3b-447c-bd84-39be7fd33731","Type":"ContainerDied","Data":"611e3ed4ec1180a44049ea186ff09b4a0bdae47831c5cfc72977ad90e2edb352"}
Jul 27 22:31:55.994077 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:55.994006    2565 scope.go:117] "RemoveContainer" containerID="2e59629ebab664066b5459b7929d027686bf68d6e1447920abaeef82dc0126d1"
Jul 27 22:31:56.002406 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:56.002389    2565 scope.go:117] "RemoveContainer" containerID="2e59629ebab664066b5459b7929d027686bf68d6e1447920abaeef82dc0126d1"
Jul 27 22:31:56.002637 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:31:56.002619    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e59629ebab664066b5459b7929d027686bf68d6e1447920abaeef82dc0126d1\": container with ID starting with 2e59629ebab664066b5459b7929d027686bf68d6e1447920abaeef82dc0126d1 not found: ID does not exist" containerID="2e59629ebab664066b5459b7929d027686bf68d6e1447920abaeef82dc0126d1"
Jul 27 22:31:56.002710 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:56.002648    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e59629ebab664066b5459b7929d027686bf68d6e1447920abaeef82dc0126d1"} err="failed to get container status \"2e59629ebab664066b5459b7929d027686bf68d6e1447920abaeef82dc0126d1\": rpc error: code = NotFound desc = could not find container \"2e59629ebab664066b5459b7929d027686bf68d6e1447920abaeef82dc0126d1\": container with ID starting with 2e59629ebab664066b5459b7929d027686bf68d6e1447920abaeef82dc0126d1 not found: ID does not exist"
Jul 27 22:31:56.009915 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:56.009893    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"]
Jul 27 22:31:56.013871 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:56.013853    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d5bbdd-67fb49cf47-tssgx"]
Jul 27 22:31:57.818118 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:31:57.818084    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79d6fd04-aa3b-447c-bd84-39be7fd33731" path="/var/lib/kubelet/pods/79d6fd04-aa3b-447c-bd84-39be7fd33731/volumes"
Jul 27 22:32:17.607176 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:17.607142    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"]
Jul 27 22:32:17.607798 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:17.607399    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf" podUID="3804f289-1289-4e69-976f-faeb3fbf474e" containerName="maas-api" containerID="cri-o://6f690660cf05435aa361d056c0b82bb9662ad1c049d4769adee4421386b9e2c1" gracePeriod=30
Jul 27 22:32:17.860995 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:17.860930    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"
Jul 27 22:32:17.936493 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:17.936459    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3804f289-1289-4e69-976f-faeb3fbf474e-maas-api-tls\") pod \"3804f289-1289-4e69-976f-faeb3fbf474e\" (UID: \"3804f289-1289-4e69-976f-faeb3fbf474e\") "
Jul 27 22:32:17.936674 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:17.936526    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsjxw\" (UniqueName: \"kubernetes.io/projected/3804f289-1289-4e69-976f-faeb3fbf474e-kube-api-access-vsjxw\") pod \"3804f289-1289-4e69-976f-faeb3fbf474e\" (UID: \"3804f289-1289-4e69-976f-faeb3fbf474e\") "
Jul 27 22:32:17.936674 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:17.936558    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3804f289-1289-4e69-976f-faeb3fbf474e-openshift-service-ca\") pod \"3804f289-1289-4e69-976f-faeb3fbf474e\" (UID: \"3804f289-1289-4e69-976f-faeb3fbf474e\") "
Jul 27 22:32:17.936972 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:17.936947    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3804f289-1289-4e69-976f-faeb3fbf474e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3804f289-1289-4e69-976f-faeb3fbf474e" (UID: "3804f289-1289-4e69-976f-faeb3fbf474e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:32:17.938649 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:17.938617    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3804f289-1289-4e69-976f-faeb3fbf474e-kube-api-access-vsjxw" (OuterVolumeSpecName: "kube-api-access-vsjxw") pod "3804f289-1289-4e69-976f-faeb3fbf474e" (UID: "3804f289-1289-4e69-976f-faeb3fbf474e"). InnerVolumeSpecName "kube-api-access-vsjxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:32:17.938752 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:17.938644    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3804f289-1289-4e69-976f-faeb3fbf474e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3804f289-1289-4e69-976f-faeb3fbf474e" (UID: "3804f289-1289-4e69-976f-faeb3fbf474e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:32:18.037301 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:18.037263    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3804f289-1289-4e69-976f-faeb3fbf474e-maas-api-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:32:18.037301 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:18.037294    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsjxw\" (UniqueName: \"kubernetes.io/projected/3804f289-1289-4e69-976f-faeb3fbf474e-kube-api-access-vsjxw\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:32:18.037301 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:18.037303    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3804f289-1289-4e69-976f-faeb3fbf474e-openshift-service-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:32:18.105486 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:18.105455    2565 generic.go:356] "Generic (PLEG): container finished" podID="3804f289-1289-4e69-976f-faeb3fbf474e" containerID="6f690660cf05435aa361d056c0b82bb9662ad1c049d4769adee4421386b9e2c1" exitCode=0
Jul 27 22:32:18.105649 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:18.105498    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"
Jul 27 22:32:18.105649 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:18.105543    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf" event={"ID":"3804f289-1289-4e69-976f-faeb3fbf474e","Type":"ContainerDied","Data":"6f690660cf05435aa361d056c0b82bb9662ad1c049d4769adee4421386b9e2c1"}
Jul 27 22:32:18.105649 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:18.105595    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf" event={"ID":"3804f289-1289-4e69-976f-faeb3fbf474e","Type":"ContainerDied","Data":"af0f0554f1e04d0765d3b9cce6f44fb8d1c24a33d7c9d9f1495470f25d00a3c2"}
Jul 27 22:32:18.105649 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:18.105622    2565 scope.go:117] "RemoveContainer" containerID="6f690660cf05435aa361d056c0b82bb9662ad1c049d4769adee4421386b9e2c1"
Jul 27 22:32:18.114663 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:18.114635    2565 scope.go:117] "RemoveContainer" containerID="6f690660cf05435aa361d056c0b82bb9662ad1c049d4769adee4421386b9e2c1"
Jul 27 22:32:18.114922 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:32:18.114903    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f690660cf05435aa361d056c0b82bb9662ad1c049d4769adee4421386b9e2c1\": container with ID starting with 6f690660cf05435aa361d056c0b82bb9662ad1c049d4769adee4421386b9e2c1 not found: ID does not exist" containerID="6f690660cf05435aa361d056c0b82bb9662ad1c049d4769adee4421386b9e2c1"
Jul 27 22:32:18.114983 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:18.114932    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f690660cf05435aa361d056c0b82bb9662ad1c049d4769adee4421386b9e2c1"} err="failed to get container status \"6f690660cf05435aa361d056c0b82bb9662ad1c049d4769adee4421386b9e2c1\": rpc error: code = NotFound desc = could not find container \"6f690660cf05435aa361d056c0b82bb9662ad1c049d4769adee4421386b9e2c1\": container with ID starting with 6f690660cf05435aa361d056c0b82bb9662ad1c049d4769adee4421386b9e2c1 not found: ID does not exist"
Jul 27 22:32:18.129250 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:18.129227    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"]
Jul 27 22:32:18.135779 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:18.135758    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b2aa15-d58dbf6c9-89btf"]
Jul 27 22:32:19.818100 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:19.818065    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3804f289-1289-4e69-976f-faeb3fbf474e" path="/var/lib/kubelet/pods/3804f289-1289-4e69-976f-faeb3fbf474e/volumes"
Jul 27 22:32:32.827132 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:32.827096    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"]
Jul 27 22:32:32.827622 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:32.827539    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3804f289-1289-4e69-976f-faeb3fbf474e" containerName="maas-api"
Jul 27 22:32:32.827622 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:32.827553    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3804f289-1289-4e69-976f-faeb3fbf474e" containerName="maas-api"
Jul 27 22:32:32.827622 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:32.827581    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79d6fd04-aa3b-447c-bd84-39be7fd33731" containerName="maas-api"
Jul 27 22:32:32.827622 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:32.827588    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="79d6fd04-aa3b-447c-bd84-39be7fd33731" containerName="maas-api"
Jul 27 22:32:32.827841 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:32.827650    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3804f289-1289-4e69-976f-faeb3fbf474e" containerName="maas-api"
Jul 27 22:32:32.827841 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:32.827662    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="79d6fd04-aa3b-447c-bd84-39be7fd33731" containerName="maas-api"
Jul 27 22:32:32.831016 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:32.830981    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"
Jul 27 22:32:32.833580 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:32.833557    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-35e234-serving-cert\""
Jul 27 22:32:32.841797 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:32.841771    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"]
Jul 27 22:32:32.881765 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:32.881712    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63792d78-510d-4bbe-8b11-561facde4d12-maas-api-tls\") pod \"maas-api-e2e-api-a-35e234-7645bd9769-pk52j\" (UID: \"63792d78-510d-4bbe-8b11-561facde4d12\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"
Jul 27 22:32:32.881765 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:32.881764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63792d78-510d-4bbe-8b11-561facde4d12-openshift-service-ca\") pod \"maas-api-e2e-api-a-35e234-7645bd9769-pk52j\" (UID: \"63792d78-510d-4bbe-8b11-561facde4d12\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"
Jul 27 22:32:32.881980 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:32.881792    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm9jf\" (UniqueName: \"kubernetes.io/projected/63792d78-510d-4bbe-8b11-561facde4d12-kube-api-access-jm9jf\") pod \"maas-api-e2e-api-a-35e234-7645bd9769-pk52j\" (UID: \"63792d78-510d-4bbe-8b11-561facde4d12\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"
Jul 27 22:32:32.982997 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:32.982963    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63792d78-510d-4bbe-8b11-561facde4d12-maas-api-tls\") pod \"maas-api-e2e-api-a-35e234-7645bd9769-pk52j\" (UID: \"63792d78-510d-4bbe-8b11-561facde4d12\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"
Jul 27 22:32:32.983266 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:32.983023    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63792d78-510d-4bbe-8b11-561facde4d12-openshift-service-ca\") pod \"maas-api-e2e-api-a-35e234-7645bd9769-pk52j\" (UID: \"63792d78-510d-4bbe-8b11-561facde4d12\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"
Jul 27 22:32:32.983266 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:32.983057    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm9jf\" (UniqueName: \"kubernetes.io/projected/63792d78-510d-4bbe-8b11-561facde4d12-kube-api-access-jm9jf\") pod \"maas-api-e2e-api-a-35e234-7645bd9769-pk52j\" (UID: \"63792d78-510d-4bbe-8b11-561facde4d12\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"
Jul 27 22:32:32.983827 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:32.983798    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63792d78-510d-4bbe-8b11-561facde4d12-openshift-service-ca\") pod \"maas-api-e2e-api-a-35e234-7645bd9769-pk52j\" (UID: \"63792d78-510d-4bbe-8b11-561facde4d12\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"
Jul 27 22:32:32.983966 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:32:32.983857    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-serving-cert: secret "maas-api-e2e-api-a-35e234-serving-cert" not found
Jul 27 22:32:32.983966 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:32:32.983948    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63792d78-510d-4bbe-8b11-561facde4d12-maas-api-tls podName:63792d78-510d-4bbe-8b11-561facde4d12 nodeName:}" failed. No retries permitted until 2026-07-27 22:32:33.48392406 +0000 UTC m=+2298.225058824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/63792d78-510d-4bbe-8b11-561facde4d12-maas-api-tls") pod "maas-api-e2e-api-a-35e234-7645bd9769-pk52j" (UID: "63792d78-510d-4bbe-8b11-561facde4d12") : secret "maas-api-e2e-api-a-35e234-serving-cert" not found
Jul 27 22:32:32.992698 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:32.992669    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm9jf\" (UniqueName: \"kubernetes.io/projected/63792d78-510d-4bbe-8b11-561facde4d12-kube-api-access-jm9jf\") pod \"maas-api-e2e-api-a-35e234-7645bd9769-pk52j\" (UID: \"63792d78-510d-4bbe-8b11-561facde4d12\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"
Jul 27 22:32:33.489538 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:33.489503    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63792d78-510d-4bbe-8b11-561facde4d12-maas-api-tls\") pod \"maas-api-e2e-api-a-35e234-7645bd9769-pk52j\" (UID: \"63792d78-510d-4bbe-8b11-561facde4d12\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"
Jul 27 22:32:33.491852 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:33.491829    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63792d78-510d-4bbe-8b11-561facde4d12-maas-api-tls\") pod \"maas-api-e2e-api-a-35e234-7645bd9769-pk52j\" (UID: \"63792d78-510d-4bbe-8b11-561facde4d12\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"
Jul 27 22:32:33.745928 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:33.745834    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"
Jul 27 22:32:33.890735 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:33.890710    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"]
Jul 27 22:32:33.893270 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:32:33.893230    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63792d78_510d_4bbe_8b11_561facde4d12.slice/crio-6af4d917efe84357af9cb43d39cd3da93a4144024662b8c2e0e31e2a558badf5 WatchSource:0}: Error finding container 6af4d917efe84357af9cb43d39cd3da93a4144024662b8c2e0e31e2a558badf5: Status 404 returned error can't find the container with id 6af4d917efe84357af9cb43d39cd3da93a4144024662b8c2e0e31e2a558badf5
Jul 27 22:32:33.894539 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:33.894521    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 22:32:34.193017 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:34.192935    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j" event={"ID":"63792d78-510d-4bbe-8b11-561facde4d12","Type":"ContainerStarted","Data":"6af4d917efe84357af9cb43d39cd3da93a4144024662b8c2e0e31e2a558badf5"}
Jul 27 22:32:35.200157 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:35.200119    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j" event={"ID":"63792d78-510d-4bbe-8b11-561facde4d12","Type":"ContainerStarted","Data":"d2890337131e26f0fbb9636edfc65c3f930e7971e961b34f4e5e89f46bbe4e20"}
Jul 27 22:32:35.200759 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:35.200236    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"
Jul 27 22:32:35.218590 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:35.218533    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j" podStartSLOduration=2.668247009 podStartE2EDuration="3.218517806s" totalImagesPullingTime="550.270797ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:32:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:32:35.217266941 +0000 UTC m=+2299.958401729" watchObservedRunningTime="2026-07-27 22:32:35.218517806 +0000 UTC m=+2299.959652574"
Jul 27 22:32:40.910930 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:40.910892    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"]
Jul 27 22:32:40.915404 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:40.915382    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"
Jul 27 22:32:40.918452 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:40.918429    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-04ee43-serving-cert\""
Jul 27 22:32:40.925559 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:40.925095    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"]
Jul 27 22:32:41.063832 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:41.063790    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c70c727-8f35-4116-97c1-d171d671705d-openshift-service-ca\") pod \"maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh\" (UID: \"0c70c727-8f35-4116-97c1-d171d671705d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"
Jul 27 22:32:41.063832 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:41.063834    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c70c727-8f35-4116-97c1-d171d671705d-maas-api-tls\") pod \"maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh\" (UID: \"0c70c727-8f35-4116-97c1-d171d671705d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"
Jul 27 22:32:41.064084 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:41.063854    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kx2d\" (UniqueName: \"kubernetes.io/projected/0c70c727-8f35-4116-97c1-d171d671705d-kube-api-access-7kx2d\") pod \"maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh\" (UID: \"0c70c727-8f35-4116-97c1-d171d671705d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"
Jul 27 22:32:41.165059 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:41.164963    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c70c727-8f35-4116-97c1-d171d671705d-maas-api-tls\") pod \"maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh\" (UID: \"0c70c727-8f35-4116-97c1-d171d671705d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"
Jul 27 22:32:41.165059 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:41.165005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kx2d\" (UniqueName: \"kubernetes.io/projected/0c70c727-8f35-4116-97c1-d171d671705d-kube-api-access-7kx2d\") pod \"maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh\" (UID: \"0c70c727-8f35-4116-97c1-d171d671705d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"
Jul 27 22:32:41.165297 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:41.165170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c70c727-8f35-4116-97c1-d171d671705d-openshift-service-ca\") pod \"maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh\" (UID: \"0c70c727-8f35-4116-97c1-d171d671705d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"
Jul 27 22:32:41.165773 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:41.165747    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c70c727-8f35-4116-97c1-d171d671705d-openshift-service-ca\") pod \"maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh\" (UID: \"0c70c727-8f35-4116-97c1-d171d671705d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"
Jul 27 22:32:41.167330 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:41.167306    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c70c727-8f35-4116-97c1-d171d671705d-maas-api-tls\") pod \"maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh\" (UID: \"0c70c727-8f35-4116-97c1-d171d671705d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"
Jul 27 22:32:41.173298 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:41.173276    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kx2d\" (UniqueName: \"kubernetes.io/projected/0c70c727-8f35-4116-97c1-d171d671705d-kube-api-access-7kx2d\") pod \"maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh\" (UID: \"0c70c727-8f35-4116-97c1-d171d671705d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"
Jul 27 22:32:41.210766 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:41.210738    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"
Jul 27 22:32:41.229562 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:41.229530    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"
Jul 27 22:32:41.377944 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:41.377914    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"]
Jul 27 22:32:41.380420 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:32:41.380388    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c70c727_8f35_4116_97c1_d171d671705d.slice/crio-990578a4672f618604dbfc8847a0a7b963fe1ba6e415a318793008c93f6ceef1 WatchSource:0}: Error finding container 990578a4672f618604dbfc8847a0a7b963fe1ba6e415a318793008c93f6ceef1: Status 404 returned error can't find the container with id 990578a4672f618604dbfc8847a0a7b963fe1ba6e415a318793008c93f6ceef1
Jul 27 22:32:42.244663 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:42.244621    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh" event={"ID":"0c70c727-8f35-4116-97c1-d171d671705d","Type":"ContainerStarted","Data":"602e69730c73688e787047527586919a08b7586cbf042a2dc958d7ef11c89693"}
Jul 27 22:32:42.245073 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:42.244702    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh" event={"ID":"0c70c727-8f35-4116-97c1-d171d671705d","Type":"ContainerStarted","Data":"990578a4672f618604dbfc8847a0a7b963fe1ba6e415a318793008c93f6ceef1"}
Jul 27 22:32:42.245073 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:42.244740    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"
Jul 27 22:32:42.261651 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:42.261602    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh" podStartSLOduration=1.900764726 podStartE2EDuration="2.261585485s" totalImagesPullingTime="360.820759ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:32:42.260108052 +0000 UTC m=+2307.001242862" watchObservedRunningTime="2026-07-27 22:32:42.261585485 +0000 UTC m=+2307.002720253"
Jul 27 22:32:48.259235 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:32:48.259202    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"
Jul 27 22:33:08.857787 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:08.857699    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"]
Jul 27 22:33:08.858320 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:08.857954    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j" podUID="63792d78-510d-4bbe-8b11-561facde4d12" containerName="maas-api" containerID="cri-o://d2890337131e26f0fbb9636edfc65c3f930e7971e961b34f4e5e89f46bbe4e20" gracePeriod=30
Jul 27 22:33:09.133117 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:09.133088    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"
Jul 27 22:33:09.237760 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:09.237729    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm9jf\" (UniqueName: \"kubernetes.io/projected/63792d78-510d-4bbe-8b11-561facde4d12-kube-api-access-jm9jf\") pod \"63792d78-510d-4bbe-8b11-561facde4d12\" (UID: \"63792d78-510d-4bbe-8b11-561facde4d12\") "
Jul 27 22:33:09.237921 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:09.237817    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63792d78-510d-4bbe-8b11-561facde4d12-maas-api-tls\") pod \"63792d78-510d-4bbe-8b11-561facde4d12\" (UID: \"63792d78-510d-4bbe-8b11-561facde4d12\") "
Jul 27 22:33:09.237921 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:09.237860    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63792d78-510d-4bbe-8b11-561facde4d12-openshift-service-ca\") pod \"63792d78-510d-4bbe-8b11-561facde4d12\" (UID: \"63792d78-510d-4bbe-8b11-561facde4d12\") "
Jul 27 22:33:09.238263 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:09.238231    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63792d78-510d-4bbe-8b11-561facde4d12-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "63792d78-510d-4bbe-8b11-561facde4d12" (UID: "63792d78-510d-4bbe-8b11-561facde4d12"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:33:09.239925 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:09.239901    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63792d78-510d-4bbe-8b11-561facde4d12-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "63792d78-510d-4bbe-8b11-561facde4d12" (UID: "63792d78-510d-4bbe-8b11-561facde4d12"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:33:09.240021 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:09.239944    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63792d78-510d-4bbe-8b11-561facde4d12-kube-api-access-jm9jf" (OuterVolumeSpecName: "kube-api-access-jm9jf") pod "63792d78-510d-4bbe-8b11-561facde4d12" (UID: "63792d78-510d-4bbe-8b11-561facde4d12"). InnerVolumeSpecName "kube-api-access-jm9jf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:33:09.339421 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:09.339382    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm9jf\" (UniqueName: \"kubernetes.io/projected/63792d78-510d-4bbe-8b11-561facde4d12-kube-api-access-jm9jf\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:33:09.339421 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:09.339415    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63792d78-510d-4bbe-8b11-561facde4d12-maas-api-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:33:09.339421 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:09.339425    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63792d78-510d-4bbe-8b11-561facde4d12-openshift-service-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:33:09.381322 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:09.381237    2565 generic.go:356] "Generic (PLEG): container finished" podID="63792d78-510d-4bbe-8b11-561facde4d12" containerID="d2890337131e26f0fbb9636edfc65c3f930e7971e961b34f4e5e89f46bbe4e20" exitCode=0
Jul 27 22:33:09.381322 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:09.381281    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"
Jul 27 22:33:09.381322 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:09.381315    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j" event={"ID":"63792d78-510d-4bbe-8b11-561facde4d12","Type":"ContainerDied","Data":"d2890337131e26f0fbb9636edfc65c3f930e7971e961b34f4e5e89f46bbe4e20"}
Jul 27 22:33:09.381600 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:09.381405    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j" event={"ID":"63792d78-510d-4bbe-8b11-561facde4d12","Type":"ContainerDied","Data":"6af4d917efe84357af9cb43d39cd3da93a4144024662b8c2e0e31e2a558badf5"}
Jul 27 22:33:09.381600 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:09.381426    2565 scope.go:117] "RemoveContainer" containerID="d2890337131e26f0fbb9636edfc65c3f930e7971e961b34f4e5e89f46bbe4e20"
Jul 27 22:33:09.390192 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:09.390174    2565 scope.go:117] "RemoveContainer" containerID="d2890337131e26f0fbb9636edfc65c3f930e7971e961b34f4e5e89f46bbe4e20"
Jul 27 22:33:09.390513 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:33:09.390492    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2890337131e26f0fbb9636edfc65c3f930e7971e961b34f4e5e89f46bbe4e20\": container with ID starting with d2890337131e26f0fbb9636edfc65c3f930e7971e961b34f4e5e89f46bbe4e20 not found: ID does not exist" containerID="d2890337131e26f0fbb9636edfc65c3f930e7971e961b34f4e5e89f46bbe4e20"
Jul 27 22:33:09.390594 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:09.390524    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2890337131e26f0fbb9636edfc65c3f930e7971e961b34f4e5e89f46bbe4e20"} err="failed to get container status \"d2890337131e26f0fbb9636edfc65c3f930e7971e961b34f4e5e89f46bbe4e20\": rpc error: code = NotFound desc = could not find container \"d2890337131e26f0fbb9636edfc65c3f930e7971e961b34f4e5e89f46bbe4e20\": container with ID starting with d2890337131e26f0fbb9636edfc65c3f930e7971e961b34f4e5e89f46bbe4e20 not found: ID does not exist"
Jul 27 22:33:09.401792 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:09.401765    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"]
Jul 27 22:33:09.407187 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:09.407164    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-35e234-7645bd9769-pk52j"]
Jul 27 22:33:09.817298 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:09.817263    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63792d78-510d-4bbe-8b11-561facde4d12" path="/var/lib/kubelet/pods/63792d78-510d-4bbe-8b11-561facde4d12/volumes"
Jul 27 22:33:36.056861 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.056823    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"]
Jul 27 22:33:36.057433 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.057083    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh" podUID="0c70c727-8f35-4116-97c1-d171d671705d" containerName="maas-api" containerID="cri-o://602e69730c73688e787047527586919a08b7586cbf042a2dc958d7ef11c89693" gracePeriod=30
Jul 27 22:33:36.307895 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.307830    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"
Jul 27 22:33:36.502550 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.502519    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c70c727-8f35-4116-97c1-d171d671705d-openshift-service-ca\") pod \"0c70c727-8f35-4116-97c1-d171d671705d\" (UID: \"0c70c727-8f35-4116-97c1-d171d671705d\") "
Jul 27 22:33:36.502742 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.502604    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c70c727-8f35-4116-97c1-d171d671705d-maas-api-tls\") pod \"0c70c727-8f35-4116-97c1-d171d671705d\" (UID: \"0c70c727-8f35-4116-97c1-d171d671705d\") "
Jul 27 22:33:36.502742 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.502640    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kx2d\" (UniqueName: \"kubernetes.io/projected/0c70c727-8f35-4116-97c1-d171d671705d-kube-api-access-7kx2d\") pod \"0c70c727-8f35-4116-97c1-d171d671705d\" (UID: \"0c70c727-8f35-4116-97c1-d171d671705d\") "
Jul 27 22:33:36.502940 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.502915    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c70c727-8f35-4116-97c1-d171d671705d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0c70c727-8f35-4116-97c1-d171d671705d" (UID: "0c70c727-8f35-4116-97c1-d171d671705d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:33:36.504747 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.504723    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c70c727-8f35-4116-97c1-d171d671705d-kube-api-access-7kx2d" (OuterVolumeSpecName: "kube-api-access-7kx2d") pod "0c70c727-8f35-4116-97c1-d171d671705d" (UID: "0c70c727-8f35-4116-97c1-d171d671705d"). InnerVolumeSpecName "kube-api-access-7kx2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:33:36.504876 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.504853    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c70c727-8f35-4116-97c1-d171d671705d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0c70c727-8f35-4116-97c1-d171d671705d" (UID: "0c70c727-8f35-4116-97c1-d171d671705d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:33:36.521543 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.521515    2565 generic.go:356] "Generic (PLEG): container finished" podID="0c70c727-8f35-4116-97c1-d171d671705d" containerID="602e69730c73688e787047527586919a08b7586cbf042a2dc958d7ef11c89693" exitCode=0
Jul 27 22:33:36.521630 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.521563    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"
Jul 27 22:33:36.521630 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.521600    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh" event={"ID":"0c70c727-8f35-4116-97c1-d171d671705d","Type":"ContainerDied","Data":"602e69730c73688e787047527586919a08b7586cbf042a2dc958d7ef11c89693"}
Jul 27 22:33:36.521710 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.521680    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh" event={"ID":"0c70c727-8f35-4116-97c1-d171d671705d","Type":"ContainerDied","Data":"990578a4672f618604dbfc8847a0a7b963fe1ba6e415a318793008c93f6ceef1"}
Jul 27 22:33:36.521710 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.521704    2565 scope.go:117] "RemoveContainer" containerID="602e69730c73688e787047527586919a08b7586cbf042a2dc958d7ef11c89693"
Jul 27 22:33:36.530330 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.530311    2565 scope.go:117] "RemoveContainer" containerID="602e69730c73688e787047527586919a08b7586cbf042a2dc958d7ef11c89693"
Jul 27 22:33:36.530576 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:33:36.530559    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"602e69730c73688e787047527586919a08b7586cbf042a2dc958d7ef11c89693\": container with ID starting with 602e69730c73688e787047527586919a08b7586cbf042a2dc958d7ef11c89693 not found: ID does not exist" containerID="602e69730c73688e787047527586919a08b7586cbf042a2dc958d7ef11c89693"
Jul 27 22:33:36.530621 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.530585    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"602e69730c73688e787047527586919a08b7586cbf042a2dc958d7ef11c89693"} err="failed to get container status \"602e69730c73688e787047527586919a08b7586cbf042a2dc958d7ef11c89693\": rpc error: code = NotFound desc = could not find container \"602e69730c73688e787047527586919a08b7586cbf042a2dc958d7ef11c89693\": container with ID starting with 602e69730c73688e787047527586919a08b7586cbf042a2dc958d7ef11c89693 not found: ID does not exist"
Jul 27 22:33:36.542869 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.542848    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"]
Jul 27 22:33:36.546105 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.546082    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-04ee43-74bd5c7489-m97hh"]
Jul 27 22:33:36.603767 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.603702    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c70c727-8f35-4116-97c1-d171d671705d-maas-api-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:33:36.603767 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.603725    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kx2d\" (UniqueName: \"kubernetes.io/projected/0c70c727-8f35-4116-97c1-d171d671705d-kube-api-access-7kx2d\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:33:36.603767 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:36.603737    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c70c727-8f35-4116-97c1-d171d671705d-openshift-service-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:33:37.817493 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:37.817415    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c70c727-8f35-4116-97c1-d171d671705d" path="/var/lib/kubelet/pods/0c70c727-8f35-4116-97c1-d171d671705d/volumes"
Jul 27 22:33:51.209878 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.209845    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"]
Jul 27 22:33:51.210533 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.210517    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63792d78-510d-4bbe-8b11-561facde4d12" containerName="maas-api"
Jul 27 22:33:51.210588 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.210536    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="63792d78-510d-4bbe-8b11-561facde4d12" containerName="maas-api"
Jul 27 22:33:51.210588 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.210554    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c70c727-8f35-4116-97c1-d171d671705d" containerName="maas-api"
Jul 27 22:33:51.210588 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.210563    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c70c727-8f35-4116-97c1-d171d671705d" containerName="maas-api"
Jul 27 22:33:51.210688 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.210677    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c70c727-8f35-4116-97c1-d171d671705d" containerName="maas-api"
Jul 27 22:33:51.210724 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.210694    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="63792d78-510d-4bbe-8b11-561facde4d12" containerName="maas-api"
Jul 27 22:33:51.214072 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.214050    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"
Jul 27 22:33:51.216853 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.216830    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-c5cbe3-serving-cert\""
Jul 27 22:33:51.225050 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.225025    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"]
Jul 27 22:33:51.337224 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.337181    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6209cb99-8d31-4790-a854-ee2dc968575c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk\" (UID: \"6209cb99-8d31-4790-a854-ee2dc968575c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"
Jul 27 22:33:51.337447 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.337258    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lb65\" (UniqueName: \"kubernetes.io/projected/6209cb99-8d31-4790-a854-ee2dc968575c-kube-api-access-2lb65\") pod \"maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk\" (UID: \"6209cb99-8d31-4790-a854-ee2dc968575c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"
Jul 27 22:33:51.337447 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.337398    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6209cb99-8d31-4790-a854-ee2dc968575c-maas-api-tls\") pod \"maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk\" (UID: \"6209cb99-8d31-4790-a854-ee2dc968575c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"
Jul 27 22:33:51.438121 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.438083    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6209cb99-8d31-4790-a854-ee2dc968575c-maas-api-tls\") pod \"maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk\" (UID: \"6209cb99-8d31-4790-a854-ee2dc968575c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"
Jul 27 22:33:51.438282 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.438135    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6209cb99-8d31-4790-a854-ee2dc968575c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk\" (UID: \"6209cb99-8d31-4790-a854-ee2dc968575c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"
Jul 27 22:33:51.438282 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.438194    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lb65\" (UniqueName: \"kubernetes.io/projected/6209cb99-8d31-4790-a854-ee2dc968575c-kube-api-access-2lb65\") pod \"maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk\" (UID: \"6209cb99-8d31-4790-a854-ee2dc968575c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"
Jul 27 22:33:51.438789 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.438768    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6209cb99-8d31-4790-a854-ee2dc968575c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk\" (UID: \"6209cb99-8d31-4790-a854-ee2dc968575c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"
Jul 27 22:33:51.440553 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.440527    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6209cb99-8d31-4790-a854-ee2dc968575c-maas-api-tls\") pod \"maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk\" (UID: \"6209cb99-8d31-4790-a854-ee2dc968575c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"
Jul 27 22:33:51.446384 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.446362    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lb65\" (UniqueName: \"kubernetes.io/projected/6209cb99-8d31-4790-a854-ee2dc968575c-kube-api-access-2lb65\") pod \"maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk\" (UID: \"6209cb99-8d31-4790-a854-ee2dc968575c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"
Jul 27 22:33:51.526474 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.526376    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"
Jul 27 22:33:51.658674 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:51.658646    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"]
Jul 27 22:33:51.661276 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:33:51.661251    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6209cb99_8d31_4790_a854_ee2dc968575c.slice/crio-9dace0c32de34f8c15f912c7e296069cb2ffa5d53e31f708a2bff92e3880ea69 WatchSource:0}: Error finding container 9dace0c32de34f8c15f912c7e296069cb2ffa5d53e31f708a2bff92e3880ea69: Status 404 returned error can't find the container with id 9dace0c32de34f8c15f912c7e296069cb2ffa5d53e31f708a2bff92e3880ea69
Jul 27 22:33:52.607867 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:52.607831    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk" event={"ID":"6209cb99-8d31-4790-a854-ee2dc968575c","Type":"ContainerStarted","Data":"7b6a65df6507b6e1c081803586a025ac12d959711c5f094c0c219488bc414e2c"}
Jul 27 22:33:52.608267 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:52.607883    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk" event={"ID":"6209cb99-8d31-4790-a854-ee2dc968575c","Type":"ContainerStarted","Data":"9dace0c32de34f8c15f912c7e296069cb2ffa5d53e31f708a2bff92e3880ea69"}
Jul 27 22:33:52.608267 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:52.607964    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"
Jul 27 22:33:52.626538 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:52.626474    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk" podStartSLOduration=1.194062022 podStartE2EDuration="1.626455773s" totalImagesPullingTime="432.393751ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:33:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:33:52.623711446 +0000 UTC m=+2377.364846240" watchObservedRunningTime="2026-07-27 22:33:52.626455773 +0000 UTC m=+2377.367590543"
Jul 27 22:33:58.618589 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:58.618556    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"
Jul 27 22:33:59.263662 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:59.263630    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"]
Jul 27 22:33:59.267632 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:59.267610    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"
Jul 27 22:33:59.270321 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:59.270296    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-f36b41-serving-cert\""
Jul 27 22:33:59.278804 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:59.278779    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"]
Jul 27 22:33:59.418551 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:59.418517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2a23cac-3b90-420e-815e-e349535d9f78-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln\" (UID: \"d2a23cac-3b90-420e-815e-e349535d9f78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"
Jul 27 22:33:59.418751 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:59.418576    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj8ww\" (UniqueName: \"kubernetes.io/projected/d2a23cac-3b90-420e-815e-e349535d9f78-kube-api-access-jj8ww\") pod \"maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln\" (UID: \"d2a23cac-3b90-420e-815e-e349535d9f78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"
Jul 27 22:33:59.418751 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:59.418634    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2a23cac-3b90-420e-815e-e349535d9f78-maas-api-tls\") pod \"maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln\" (UID: \"d2a23cac-3b90-420e-815e-e349535d9f78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"
Jul 27 22:33:59.520211 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:59.520117    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2a23cac-3b90-420e-815e-e349535d9f78-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln\" (UID: \"d2a23cac-3b90-420e-815e-e349535d9f78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"
Jul 27 22:33:59.520211 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:59.520175    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj8ww\" (UniqueName: \"kubernetes.io/projected/d2a23cac-3b90-420e-815e-e349535d9f78-kube-api-access-jj8ww\") pod \"maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln\" (UID: \"d2a23cac-3b90-420e-815e-e349535d9f78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"
Jul 27 22:33:59.520497 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:59.520237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2a23cac-3b90-420e-815e-e349535d9f78-maas-api-tls\") pod \"maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln\" (UID: \"d2a23cac-3b90-420e-815e-e349535d9f78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"
Jul 27 22:33:59.520497 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:33:59.520393    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-serving-cert: secret "maas-api-e2e-shared-b-f36b41-serving-cert" not found
Jul 27 22:33:59.520497 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:33:59.520463    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2a23cac-3b90-420e-815e-e349535d9f78-maas-api-tls podName:d2a23cac-3b90-420e-815e-e349535d9f78 nodeName:}" failed. No retries permitted until 2026-07-27 22:34:00.020442626 +0000 UTC m=+2384.761577372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d2a23cac-3b90-420e-815e-e349535d9f78-maas-api-tls") pod "maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln" (UID: "d2a23cac-3b90-420e-815e-e349535d9f78") : secret "maas-api-e2e-shared-b-f36b41-serving-cert" not found
Jul 27 22:33:59.520804 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:59.520783    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2a23cac-3b90-420e-815e-e349535d9f78-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln\" (UID: \"d2a23cac-3b90-420e-815e-e349535d9f78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"
Jul 27 22:33:59.528894 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:33:59.528871    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj8ww\" (UniqueName: \"kubernetes.io/projected/d2a23cac-3b90-420e-815e-e349535d9f78-kube-api-access-jj8ww\") pod \"maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln\" (UID: \"d2a23cac-3b90-420e-815e-e349535d9f78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"
Jul 27 22:34:00.025239 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:34:00.025198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2a23cac-3b90-420e-815e-e349535d9f78-maas-api-tls\") pod \"maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln\" (UID: \"d2a23cac-3b90-420e-815e-e349535d9f78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"
Jul 27 22:34:00.027842 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:34:00.027805    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2a23cac-3b90-420e-815e-e349535d9f78-maas-api-tls\") pod \"maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln\" (UID: \"d2a23cac-3b90-420e-815e-e349535d9f78\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"
Jul 27 22:34:00.181670 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:34:00.181632    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"
Jul 27 22:34:00.319496 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:34:00.319467    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"]
Jul 27 22:34:00.321813 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:34:00.321784    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a23cac_3b90_420e_815e_e349535d9f78.slice/crio-dbf159d448dad5be5e2e782e816c8be1e9142159487298963bc59273ef469b8c WatchSource:0}: Error finding container dbf159d448dad5be5e2e782e816c8be1e9142159487298963bc59273ef469b8c: Status 404 returned error can't find the container with id dbf159d448dad5be5e2e782e816c8be1e9142159487298963bc59273ef469b8c
Jul 27 22:34:00.649591 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:34:00.649503    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln" event={"ID":"d2a23cac-3b90-420e-815e-e349535d9f78","Type":"ContainerStarted","Data":"dbf159d448dad5be5e2e782e816c8be1e9142159487298963bc59273ef469b8c"}
Jul 27 22:34:01.655858 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:34:01.655818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln" event={"ID":"d2a23cac-3b90-420e-815e-e349535d9f78","Type":"ContainerStarted","Data":"828e91ca410f7cb38d4a16692b1db3670ff89636dda92e0654d6a182f65b6884"}
Jul 27 22:34:01.656286 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:34:01.656051    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"
Jul 27 22:34:01.675203 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:34:01.675152    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln" podStartSLOduration=2.28080344 podStartE2EDuration="2.675136331s" totalImagesPullingTime="394.332891ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:33:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:34:01.674154916 +0000 UTC m=+2386.415289685" watchObservedRunningTime="2026-07-27 22:34:01.675136331 +0000 UTC m=+2386.416271099"
Jul 27 22:34:07.666488 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:34:07.666460    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"
Jul 27 22:43:17.234739 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:17.234703    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"]
Jul 27 22:43:17.238536 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:17.238512    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"
Jul 27 22:43:17.241249 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:17.241226    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-48ceef-serving-cert\""
Jul 27 22:43:17.260729 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:17.260696    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"]
Jul 27 22:43:17.384800 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:17.384759    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f164bb2-b646-4ece-9448-469ae9972551-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7\" (UID: \"7f164bb2-b646-4ece-9448-469ae9972551\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"
Jul 27 22:43:17.384994 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:17.384838    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7svxc\" (UniqueName: \"kubernetes.io/projected/7f164bb2-b646-4ece-9448-469ae9972551-kube-api-access-7svxc\") pod \"maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7\" (UID: \"7f164bb2-b646-4ece-9448-469ae9972551\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"
Jul 27 22:43:17.384994 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:17.384864    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f164bb2-b646-4ece-9448-469ae9972551-maas-api-tls\") pod \"maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7\" (UID: \"7f164bb2-b646-4ece-9448-469ae9972551\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"
Jul 27 22:43:17.486453 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:17.486360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f164bb2-b646-4ece-9448-469ae9972551-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7\" (UID: \"7f164bb2-b646-4ece-9448-469ae9972551\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"
Jul 27 22:43:17.486630 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:17.486465    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7svxc\" (UniqueName: \"kubernetes.io/projected/7f164bb2-b646-4ece-9448-469ae9972551-kube-api-access-7svxc\") pod \"maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7\" (UID: \"7f164bb2-b646-4ece-9448-469ae9972551\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"
Jul 27 22:43:17.486630 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:17.486497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f164bb2-b646-4ece-9448-469ae9972551-maas-api-tls\") pod \"maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7\" (UID: \"7f164bb2-b646-4ece-9448-469ae9972551\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"
Jul 27 22:43:17.486988 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:17.486960    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f164bb2-b646-4ece-9448-469ae9972551-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7\" (UID: \"7f164bb2-b646-4ece-9448-469ae9972551\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"
Jul 27 22:43:17.488968 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:17.488950    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f164bb2-b646-4ece-9448-469ae9972551-maas-api-tls\") pod \"maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7\" (UID: \"7f164bb2-b646-4ece-9448-469ae9972551\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"
Jul 27 22:43:17.496108 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:17.496084    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7svxc\" (UniqueName: \"kubernetes.io/projected/7f164bb2-b646-4ece-9448-469ae9972551-kube-api-access-7svxc\") pod \"maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7\" (UID: \"7f164bb2-b646-4ece-9448-469ae9972551\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"
Jul 27 22:43:17.551694 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:17.551657    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"
Jul 27 22:43:17.704148 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:17.704121    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"]
Jul 27 22:43:17.706224 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:43:17.706188    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f164bb2_b646_4ece_9448_469ae9972551.slice/crio-8353c9e56f4e047b1a42c5fa7bf20fdbfbc88a6f73656e7e97d8a22202e4daac WatchSource:0}: Error finding container 8353c9e56f4e047b1a42c5fa7bf20fdbfbc88a6f73656e7e97d8a22202e4daac: Status 404 returned error can't find the container with id 8353c9e56f4e047b1a42c5fa7bf20fdbfbc88a6f73656e7e97d8a22202e4daac
Jul 27 22:43:17.707668 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:17.707648    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 22:43:18.513223 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:18.513183    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7" event={"ID":"7f164bb2-b646-4ece-9448-469ae9972551","Type":"ContainerStarted","Data":"a62df9b9cae5c3af1f58d0c7c40712656736de64ac9f05811264afb522b18621"}
Jul 27 22:43:18.513678 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:18.513248    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7" event={"ID":"7f164bb2-b646-4ece-9448-469ae9972551","Type":"ContainerStarted","Data":"8353c9e56f4e047b1a42c5fa7bf20fdbfbc88a6f73656e7e97d8a22202e4daac"}
Jul 27 22:43:18.513678 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:18.513373    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"
Jul 27 22:43:18.531319 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:18.531263    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7" podStartSLOduration=1.140995238 podStartE2EDuration="1.531246749s" totalImagesPullingTime="390.251511ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:43:18.529495424 +0000 UTC m=+2943.270630217" watchObservedRunningTime="2026-07-27 22:43:18.531246749 +0000 UTC m=+2943.272381516"
Jul 27 22:43:24.523764 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:24.523735    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"
Jul 27 22:43:36.228641 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:36.228605    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"]
Jul 27 22:43:36.232535 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:36.232500    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"
Jul 27 22:43:36.235246 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:36.235222    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-e47da1-serving-cert\""
Jul 27 22:43:36.245636 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:36.245611    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"]
Jul 27 22:43:36.264891 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:36.264856    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjhdd\" (UniqueName: \"kubernetes.io/projected/a416e296-6dca-4cf7-8d83-a7461167434d-kube-api-access-qjhdd\") pod \"maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs\" (UID: \"a416e296-6dca-4cf7-8d83-a7461167434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"
Jul 27 22:43:36.265070 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:36.264973    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a416e296-6dca-4cf7-8d83-a7461167434d-maas-api-tls\") pod \"maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs\" (UID: \"a416e296-6dca-4cf7-8d83-a7461167434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"
Jul 27 22:43:36.265070 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:36.265002    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a416e296-6dca-4cf7-8d83-a7461167434d-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs\" (UID: \"a416e296-6dca-4cf7-8d83-a7461167434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"
Jul 27 22:43:36.366509 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:36.366476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjhdd\" (UniqueName: \"kubernetes.io/projected/a416e296-6dca-4cf7-8d83-a7461167434d-kube-api-access-qjhdd\") pod \"maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs\" (UID: \"a416e296-6dca-4cf7-8d83-a7461167434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"
Jul 27 22:43:36.366688 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:36.366558    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a416e296-6dca-4cf7-8d83-a7461167434d-maas-api-tls\") pod \"maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs\" (UID: \"a416e296-6dca-4cf7-8d83-a7461167434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"
Jul 27 22:43:36.366688 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:36.366579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a416e296-6dca-4cf7-8d83-a7461167434d-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs\" (UID: \"a416e296-6dca-4cf7-8d83-a7461167434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"
Jul 27 22:43:36.366688 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:43:36.366680    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-serving-cert: secret "maas-api-e2e-ipp-b-e47da1-serving-cert" not found
Jul 27 22:43:36.366860 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:43:36.366744    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a416e296-6dca-4cf7-8d83-a7461167434d-maas-api-tls podName:a416e296-6dca-4cf7-8d83-a7461167434d nodeName:}" failed. No retries permitted until 2026-07-27 22:43:36.866727886 +0000 UTC m=+2961.607862649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a416e296-6dca-4cf7-8d83-a7461167434d-maas-api-tls") pod "maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs" (UID: "a416e296-6dca-4cf7-8d83-a7461167434d") : secret "maas-api-e2e-ipp-b-e47da1-serving-cert" not found
Jul 27 22:43:36.367304 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:36.367280    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a416e296-6dca-4cf7-8d83-a7461167434d-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs\" (UID: \"a416e296-6dca-4cf7-8d83-a7461167434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"
Jul 27 22:43:36.378451 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:36.378429    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjhdd\" (UniqueName: \"kubernetes.io/projected/a416e296-6dca-4cf7-8d83-a7461167434d-kube-api-access-qjhdd\") pod \"maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs\" (UID: \"a416e296-6dca-4cf7-8d83-a7461167434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"
Jul 27 22:43:36.871687 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:36.871650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a416e296-6dca-4cf7-8d83-a7461167434d-maas-api-tls\") pod \"maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs\" (UID: \"a416e296-6dca-4cf7-8d83-a7461167434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"
Jul 27 22:43:36.874008 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:36.873979    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a416e296-6dca-4cf7-8d83-a7461167434d-maas-api-tls\") pod \"maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs\" (UID: \"a416e296-6dca-4cf7-8d83-a7461167434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"
Jul 27 22:43:37.147101 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:37.147009    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"
Jul 27 22:43:37.288159 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:37.288131    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"]
Jul 27 22:43:37.289743 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:43:37.289713    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda416e296_6dca_4cf7_8d83_a7461167434d.slice/crio-883624c1fd13fb6af7950d9da7f1452be84ba61180d436b8e46fb5d282cfa4bb WatchSource:0}: Error finding container 883624c1fd13fb6af7950d9da7f1452be84ba61180d436b8e46fb5d282cfa4bb: Status 404 returned error can't find the container with id 883624c1fd13fb6af7950d9da7f1452be84ba61180d436b8e46fb5d282cfa4bb
Jul 27 22:43:37.613021 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:37.612980    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs" event={"ID":"a416e296-6dca-4cf7-8d83-a7461167434d","Type":"ContainerStarted","Data":"883624c1fd13fb6af7950d9da7f1452be84ba61180d436b8e46fb5d282cfa4bb"}
Jul 27 22:43:38.620601 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:38.620558    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs" event={"ID":"a416e296-6dca-4cf7-8d83-a7461167434d","Type":"ContainerStarted","Data":"543509927eec491e660d2d4f4a7b6b5a958d6a3665b4823ee9d399b9a1d1bcef"}
Jul 27 22:43:38.621070 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:38.620625    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"
Jul 27 22:43:38.639160 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:38.639099    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs" podStartSLOduration=2.28452614 podStartE2EDuration="2.639080268s" totalImagesPullingTime="354.554128ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:43:38.638854383 +0000 UTC m=+2963.379989178" watchObservedRunningTime="2026-07-27 22:43:38.639080268 +0000 UTC m=+2963.380215037"
Jul 27 22:43:44.631391 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:44.631360    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"
Jul 27 22:43:57.641310 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:43:57.641278    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-7pxk8_0b3cc73b-6e37-4897-af8c-00f6f8bece07/payload-processing/0.log"
Jul 27 22:45:00.027765 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.027731    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-7pxk8_0b3cc73b-6e37-4897-af8c-00f6f8bece07/payload-processing/0.log"
Jul 27 22:45:00.136635 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.136600    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c5cbe3-29753205-zg298"]
Jul 27 22:45:00.140560 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.140532    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753205-xgxz4"]
Jul 27 22:45:00.140702 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.140653    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c5cbe3-29753205-zg298"
Jul 27 22:45:00.142999 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.142975    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-k9rxw\""
Jul 27 22:45:00.144083 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.144063    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-48ceef-29753205-sd64s"]
Jul 27 22:45:00.144220 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.144169    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753205-xgxz4"
Jul 27 22:45:00.147481 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.147461    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f36b41-29753205-sfrl2"]
Jul 27 22:45:00.147613 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.147587    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-48ceef-29753205-sd64s"
Jul 27 22:45:00.151492 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.151406    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e47da1-29753205-zzclw"]
Jul 27 22:45:00.151667 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.151513    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f36b41-29753205-sfrl2"
Jul 27 22:45:00.155597 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.155577    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c5cbe3-29753205-zg298"
Jul 27 22:45:00.158770 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.158384    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c5cbe3-29753205-zg298"]
Jul 27 22:45:00.158978 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.158947    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-48ceef-29753205-sd64s"]
Jul 27 22:45:00.159070 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.158999    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753205-xgxz4"]
Jul 27 22:45:00.159137 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.159079    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e47da1-29753205-zzclw"
Jul 27 22:45:00.160527 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.160443    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e47da1-29753205-zzclw"]
Jul 27 22:45:00.162877 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.162502    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f36b41-29753205-sfrl2"]
Jul 27 22:45:00.169084 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.169063    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753205-xgxz4"
Jul 27 22:45:00.201293 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.201269    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-48ceef-29753205-sd64s"
Jul 27 22:45:00.211932 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.211908    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f36b41-29753205-sfrl2"
Jul 27 22:45:00.266969 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.266774    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e47da1-29753205-zzclw"
Jul 27 22:45:00.373675 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.372548    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c5cbe3-29753205-zg298"]
Jul 27 22:45:00.482740 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.482716    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e47da1-29753205-zzclw"]
Jul 27 22:45:00.484400 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:45:00.484372    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ea57ea_ddbb_4d23_9dd7_bbe40ce5ce55.slice/crio-cc2db32640136f9177f4f4043410426ff5b375614328b67c3e09450c95df4579 WatchSource:0}: Error finding container cc2db32640136f9177f4f4043410426ff5b375614328b67c3e09450c95df4579: Status 404 returned error can't find the container with id cc2db32640136f9177f4f4043410426ff5b375614328b67c3e09450c95df4579
Jul 27 22:45:00.606553 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.606530    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753205-xgxz4"]
Jul 27 22:45:00.608686 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:45:00.608661    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc16e5297_beef_4995_a1ef_7df1890d7c64.slice/crio-18573e757511e872630f8abef831a1cd0d7cd4c9408f7bbe1740692355964c13 WatchSource:0}: Error finding container 18573e757511e872630f8abef831a1cd0d7cd4c9408f7bbe1740692355964c13: Status 404 returned error can't find the container with id 18573e757511e872630f8abef831a1cd0d7cd4c9408f7bbe1740692355964c13
Jul 27 22:45:00.649428 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.649402    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-48ceef-29753205-sd64s"]
Jul 27 22:45:00.651081 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:45:00.651044    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod422b94bb_a7a6_443d_9357_f7da5e3306ce.slice/crio-35d5ca8aa91b8ba39ec2f3b31d6960166ef31ab6c75841842ee774a15428afaa WatchSource:0}: Error finding container 35d5ca8aa91b8ba39ec2f3b31d6960166ef31ab6c75841842ee774a15428afaa: Status 404 returned error can't find the container with id 35d5ca8aa91b8ba39ec2f3b31d6960166ef31ab6c75841842ee774a15428afaa
Jul 27 22:45:00.656900 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:00.656874    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f36b41-29753205-sfrl2"]
Jul 27 22:45:00.658171 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:45:00.658141    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf149b4cd_2d29_4841_9158_7abff1b186c3.slice/crio-60a5bd220d08eb58eb49a5afea1ff1ddf1b408e5860fa57211912573f83b0a22 WatchSource:0}: Error finding container 60a5bd220d08eb58eb49a5afea1ff1ddf1b408e5860fa57211912573f83b0a22: Status 404 returned error can't find the container with id 60a5bd220d08eb58eb49a5afea1ff1ddf1b408e5860fa57211912573f83b0a22
Jul 27 22:45:01.053248 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:01.053211    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c5cbe3-29753205-zg298" event={"ID":"91ab33e1-836a-4414-b943-4c307749ffe6","Type":"ContainerStarted","Data":"5dc66d3e62a8b8e9b3e242c7c0badf52d79ac9e5e53bdcdf358dcc374a77c7d7"}
Jul 27 22:45:01.054414 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:01.054386    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753205-xgxz4" event={"ID":"c16e5297-beef-4995-a1ef-7df1890d7c64","Type":"ContainerStarted","Data":"18573e757511e872630f8abef831a1cd0d7cd4c9408f7bbe1740692355964c13"}
Jul 27 22:45:01.055511 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:01.055475    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f36b41-29753205-sfrl2" event={"ID":"f149b4cd-2d29-4841-9158-7abff1b186c3","Type":"ContainerStarted","Data":"60a5bd220d08eb58eb49a5afea1ff1ddf1b408e5860fa57211912573f83b0a22"}
Jul 27 22:45:01.056861 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:01.056836    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-48ceef-29753205-sd64s" event={"ID":"422b94bb-a7a6-443d-9357-f7da5e3306ce","Type":"ContainerStarted","Data":"35d5ca8aa91b8ba39ec2f3b31d6960166ef31ab6c75841842ee774a15428afaa"}
Jul 27 22:45:01.058274 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:01.058253    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e47da1-29753205-zzclw" event={"ID":"06ea57ea-ddbb-4d23-9dd7-bbe40ce5ce55","Type":"ContainerStarted","Data":"cc2db32640136f9177f4f4043410426ff5b375614328b67c3e09450c95df4579"}
Jul 27 22:45:03.788461 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:03.788426    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"]
Jul 27 22:45:03.792194 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:03.792174    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"
Jul 27 22:45:03.794704 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:03.794683    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-ea5c1d-serving-cert\""
Jul 27 22:45:03.803606 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:03.803585    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"]
Jul 27 22:45:03.946395 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:03.946363    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0f4475a-3737-459c-81c2-0d603d2d837e-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24\" (UID: \"d0f4475a-3737-459c-81c2-0d603d2d837e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"
Jul 27 22:45:03.946559 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:03.946538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0f4475a-3737-459c-81c2-0d603d2d837e-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24\" (UID: \"d0f4475a-3737-459c-81c2-0d603d2d837e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"
Jul 27 22:45:03.946636 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:03.946605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rchfr\" (UniqueName: \"kubernetes.io/projected/d0f4475a-3737-459c-81c2-0d603d2d837e-kube-api-access-rchfr\") pod \"maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24\" (UID: \"d0f4475a-3737-459c-81c2-0d603d2d837e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"
Jul 27 22:45:04.047654 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:04.047622    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0f4475a-3737-459c-81c2-0d603d2d837e-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24\" (UID: \"d0f4475a-3737-459c-81c2-0d603d2d837e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"
Jul 27 22:45:04.047807 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:04.047665    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rchfr\" (UniqueName: \"kubernetes.io/projected/d0f4475a-3737-459c-81c2-0d603d2d837e-kube-api-access-rchfr\") pod \"maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24\" (UID: \"d0f4475a-3737-459c-81c2-0d603d2d837e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"
Jul 27 22:45:04.047807 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:04.047715    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0f4475a-3737-459c-81c2-0d603d2d837e-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24\" (UID: \"d0f4475a-3737-459c-81c2-0d603d2d837e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"
Jul 27 22:45:04.048305 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:04.048279    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0f4475a-3737-459c-81c2-0d603d2d837e-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24\" (UID: \"d0f4475a-3737-459c-81c2-0d603d2d837e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"
Jul 27 22:45:04.050106 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:04.050084    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0f4475a-3737-459c-81c2-0d603d2d837e-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24\" (UID: \"d0f4475a-3737-459c-81c2-0d603d2d837e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"
Jul 27 22:45:04.055999 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:04.055979    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rchfr\" (UniqueName: \"kubernetes.io/projected/d0f4475a-3737-459c-81c2-0d603d2d837e-kube-api-access-rchfr\") pod \"maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24\" (UID: \"d0f4475a-3737-459c-81c2-0d603d2d837e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"
Jul 27 22:45:04.120642 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:04.120616    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"
Jul 27 22:45:04.271230 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:04.271202    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"]
Jul 27 22:45:04.273030 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:45:04.273004    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0f4475a_3737_459c_81c2_0d603d2d837e.slice/crio-979daf281e740ad13be6c0f67d0db0d5ac8bb3494bce75ac34ebfce2e26bcbd7 WatchSource:0}: Error finding container 979daf281e740ad13be6c0f67d0db0d5ac8bb3494bce75ac34ebfce2e26bcbd7: Status 404 returned error can't find the container with id 979daf281e740ad13be6c0f67d0db0d5ac8bb3494bce75ac34ebfce2e26bcbd7
Jul 27 22:45:05.088733 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:05.088642    2565 generic.go:356] "Generic (PLEG): container finished" podID="91ab33e1-836a-4414-b943-4c307749ffe6" containerID="1f1ee243d17f9c3e59ad68b5dd8db57297820b84be2467224f826931c762800a" exitCode=0
Jul 27 22:45:05.089183 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:05.088732    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c5cbe3-29753205-zg298" event={"ID":"91ab33e1-836a-4414-b943-4c307749ffe6","Type":"ContainerDied","Data":"1f1ee243d17f9c3e59ad68b5dd8db57297820b84be2467224f826931c762800a"}
Jul 27 22:45:05.090350 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:05.090317    2565 generic.go:356] "Generic (PLEG): container finished" podID="c16e5297-beef-4995-a1ef-7df1890d7c64" containerID="16a88470eb01ddc8bb480f1276502337e74a44668f470b3a06bb72f3d18cabb7" exitCode=0
Jul 27 22:45:05.090465 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:05.090377    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753205-xgxz4" event={"ID":"c16e5297-beef-4995-a1ef-7df1890d7c64","Type":"ContainerDied","Data":"16a88470eb01ddc8bb480f1276502337e74a44668f470b3a06bb72f3d18cabb7"}
Jul 27 22:45:05.091808 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:05.091786    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f36b41-29753205-sfrl2" event={"ID":"f149b4cd-2d29-4841-9158-7abff1b186c3","Type":"ContainerStarted","Data":"786cdb3b3e56a2ef15926b939a30a023a03b3919f49c6f264e5bd29a9728cdd6"}
Jul 27 22:45:05.093248 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:05.093225    2565 generic.go:356] "Generic (PLEG): container finished" podID="422b94bb-a7a6-443d-9357-f7da5e3306ce" containerID="1c82ba10694aa290b0f12de6f4ca7e8fe9a0d16b807e5df75c0722eb9a198fb9" exitCode=0
Jul 27 22:45:05.093358 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:05.093262    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-48ceef-29753205-sd64s" event={"ID":"422b94bb-a7a6-443d-9357-f7da5e3306ce","Type":"ContainerDied","Data":"1c82ba10694aa290b0f12de6f4ca7e8fe9a0d16b807e5df75c0722eb9a198fb9"}
Jul 27 22:45:05.094448 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:05.094423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24" event={"ID":"d0f4475a-3737-459c-81c2-0d603d2d837e","Type":"ContainerStarted","Data":"979daf281e740ad13be6c0f67d0db0d5ac8bb3494bce75ac34ebfce2e26bcbd7"}
Jul 27 22:45:05.095791 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:05.095773    2565 generic.go:356] "Generic (PLEG): container finished" podID="06ea57ea-ddbb-4d23-9dd7-bbe40ce5ce55" containerID="b26ce680df4dd0e9080fec449459c5744aac1487fc985258e9ec8febe068d0a5" exitCode=0
Jul 27 22:45:05.095879 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:05.095793    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e47da1-29753205-zzclw" event={"ID":"06ea57ea-ddbb-4d23-9dd7-bbe40ce5ce55","Type":"ContainerDied","Data":"b26ce680df4dd0e9080fec449459c5744aac1487fc985258e9ec8febe068d0a5"}
Jul 27 22:45:05.151451 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:05.151395    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f36b41-29753205-sfrl2" podStartSLOduration=1.9885224959999999 podStartE2EDuration="5.151379283s" totalImagesPullingTime="3.162856787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:45:05.15017995 +0000 UTC m=+3049.891314713" watchObservedRunningTime="2026-07-27 22:45:05.151379283 +0000 UTC m=+3049.892514051"
Jul 27 22:45:06.103992 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:06.103958    2565 generic.go:356] "Generic (PLEG): container finished" podID="f149b4cd-2d29-4841-9158-7abff1b186c3" containerID="786cdb3b3e56a2ef15926b939a30a023a03b3919f49c6f264e5bd29a9728cdd6" exitCode=0
Jul 27 22:45:06.104501 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:06.104053    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f36b41-29753205-sfrl2" event={"ID":"f149b4cd-2d29-4841-9158-7abff1b186c3","Type":"ContainerDied","Data":"786cdb3b3e56a2ef15926b939a30a023a03b3919f49c6f264e5bd29a9728cdd6"}
Jul 27 22:45:06.105730 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:06.105706    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24" event={"ID":"d0f4475a-3737-459c-81c2-0d603d2d837e","Type":"ContainerStarted","Data":"0a1475237722eaab172a68d020fc710eb4a2688d7deb93f06ab31c3b8564b72e"}
Jul 27 22:45:06.288510 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:06.288475    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c5cbe3-29753205-zg298"
Jul 27 22:45:06.311358 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:06.310292    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24" podStartSLOduration=2.309934539 podStartE2EDuration="3.310255434s" totalImagesPullingTime="1.000320895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:45:06.141417639 +0000 UTC m=+3050.882552408" watchObservedRunningTime="2026-07-27 22:45:06.310255434 +0000 UTC m=+3051.051390202"
Jul 27 22:45:06.356833 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:06.356770    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e47da1-29753205-zzclw"
Jul 27 22:45:06.360099 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:06.360077    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753205-xgxz4"
Jul 27 22:45:06.364242 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:06.364223    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-48ceef-29753205-sd64s"
Jul 27 22:45:07.113247 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:07.113216    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-48ceef-29753205-sd64s"
Jul 27 22:45:07.113247 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:07.113232    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-48ceef-29753205-sd64s" event={"ID":"422b94bb-a7a6-443d-9357-f7da5e3306ce","Type":"ContainerDied","Data":"35d5ca8aa91b8ba39ec2f3b31d6960166ef31ab6c75841842ee774a15428afaa"}
Jul 27 22:45:07.113717 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:07.113281    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35d5ca8aa91b8ba39ec2f3b31d6960166ef31ab6c75841842ee774a15428afaa"
Jul 27 22:45:07.114569 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:07.114553    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e47da1-29753205-zzclw"
Jul 27 22:45:07.114683 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:07.114611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e47da1-29753205-zzclw" event={"ID":"06ea57ea-ddbb-4d23-9dd7-bbe40ce5ce55","Type":"ContainerDied","Data":"cc2db32640136f9177f4f4043410426ff5b375614328b67c3e09450c95df4579"}
Jul 27 22:45:07.114683 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:07.114656    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc2db32640136f9177f4f4043410426ff5b375614328b67c3e09450c95df4579"
Jul 27 22:45:07.116071 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:07.116052    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c5cbe3-29753205-zg298"
Jul 27 22:45:07.116167 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:07.116071    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c5cbe3-29753205-zg298" event={"ID":"91ab33e1-836a-4414-b943-4c307749ffe6","Type":"ContainerDied","Data":"5dc66d3e62a8b8e9b3e242c7c0badf52d79ac9e5e53bdcdf358dcc374a77c7d7"}
Jul 27 22:45:07.116167 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:07.116104    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5dc66d3e62a8b8e9b3e242c7c0badf52d79ac9e5e53bdcdf358dcc374a77c7d7"
Jul 27 22:45:07.117499 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:07.117482    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753205-xgxz4"
Jul 27 22:45:07.117607 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:07.117514    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753205-xgxz4" event={"ID":"c16e5297-beef-4995-a1ef-7df1890d7c64","Type":"ContainerDied","Data":"18573e757511e872630f8abef831a1cd0d7cd4c9408f7bbe1740692355964c13"}
Jul 27 22:45:07.117607 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:07.117547    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18573e757511e872630f8abef831a1cd0d7cd4c9408f7bbe1740692355964c13"
Jul 27 22:45:07.117979 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:07.117940    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"
Jul 27 22:45:07.262001 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:07.261973    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f36b41-29753205-sfrl2"
Jul 27 22:45:08.125690 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:08.125580    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f36b41-29753205-sfrl2" event={"ID":"f149b4cd-2d29-4841-9158-7abff1b186c3","Type":"ContainerDied","Data":"60a5bd220d08eb58eb49a5afea1ff1ddf1b408e5860fa57211912573f83b0a22"}
Jul 27 22:45:08.125690 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:08.125652    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60a5bd220d08eb58eb49a5afea1ff1ddf1b408e5860fa57211912573f83b0a22"
Jul 27 22:45:08.126219 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:08.125817    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f36b41-29753205-sfrl2"
Jul 27 22:45:13.131184 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:13.131144    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"
Jul 27 22:45:18.944184 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:18.944144    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ea5c1d-qwvgh"]
Jul 27 22:45:18.944639 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:18.944624    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="422b94bb-a7a6-443d-9357-f7da5e3306ce" containerName="cleanup"
Jul 27 22:45:18.944686 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:18.944641    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="422b94bb-a7a6-443d-9357-f7da5e3306ce" containerName="cleanup"
Jul 27 22:45:18.944686 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:18.944655    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06ea57ea-ddbb-4d23-9dd7-bbe40ce5ce55" containerName="cleanup"
Jul 27 22:45:18.944686 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:18.944664    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="06ea57ea-ddbb-4d23-9dd7-bbe40ce5ce55" containerName="cleanup"
Jul 27 22:45:18.944686 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:18.944678    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91ab33e1-836a-4414-b943-4c307749ffe6" containerName="cleanup"
Jul 27 22:45:18.944686 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:18.944684    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="91ab33e1-836a-4414-b943-4c307749ffe6" containerName="cleanup"
Jul 27 22:45:18.944841 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:18.944701    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c16e5297-beef-4995-a1ef-7df1890d7c64" containerName="cleanup"
Jul 27 22:45:18.944841 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:18.944706    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c16e5297-beef-4995-a1ef-7df1890d7c64" containerName="cleanup"
Jul 27 22:45:18.944841 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:18.944714    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f149b4cd-2d29-4841-9158-7abff1b186c3" containerName="cleanup"
Jul 27 22:45:18.944841 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:18.944719    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f149b4cd-2d29-4841-9158-7abff1b186c3" containerName="cleanup"
Jul 27 22:45:18.944841 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:18.944785    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f149b4cd-2d29-4841-9158-7abff1b186c3" containerName="cleanup"
Jul 27 22:45:18.944841 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:18.944796    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="422b94bb-a7a6-443d-9357-f7da5e3306ce" containerName="cleanup"
Jul 27 22:45:18.944841 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:18.944805    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="91ab33e1-836a-4414-b943-4c307749ffe6" containerName="cleanup"
Jul 27 22:45:18.944841 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:18.944813    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c16e5297-beef-4995-a1ef-7df1890d7c64" containerName="cleanup"
Jul 27 22:45:18.944841 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:18.944823    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="06ea57ea-ddbb-4d23-9dd7-bbe40ce5ce55" containerName="cleanup"
Jul 27 22:45:18.950125 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:18.950087    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ea5c1d-qwvgh"
Jul 27 22:45:18.953064 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:18.953035    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-k9rxw\""
Jul 27 22:45:18.956547 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:18.956516    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ea5c1d-qwvgh"]
Jul 27 22:45:19.001671 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:19.001632    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0896eb9-1f47-4f22-9295-a538952a52fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-ea5c1d-qwvgh\" (UID: \"a0896eb9-1f47-4f22-9295-a538952a52fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ea5c1d-qwvgh"
Jul 27 22:45:19.103115 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:19.103081    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0896eb9-1f47-4f22-9295-a538952a52fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-ea5c1d-qwvgh\" (UID: \"a0896eb9-1f47-4f22-9295-a538952a52fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ea5c1d-qwvgh"
Jul 27 22:45:19.103733 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:19.103715    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0896eb9-1f47-4f22-9295-a538952a52fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-ea5c1d-qwvgh\" (UID: \"a0896eb9-1f47-4f22-9295-a538952a52fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ea5c1d-qwvgh"
Jul 27 22:45:19.265602 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:19.265562    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ea5c1d-qwvgh"
Jul 27 22:45:19.403944 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:19.403919    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ea5c1d-qwvgh"]
Jul 27 22:45:19.405439 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:45:19.405403    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0896eb9_1f47_4f22_9295_a538952a52fc.slice/crio-f78c306ac3f0bdf4696ddae198fe6d27055c768cf2b7b9adb8532839ba6d9975 WatchSource:0}: Error finding container f78c306ac3f0bdf4696ddae198fe6d27055c768cf2b7b9adb8532839ba6d9975: Status 404 returned error can't find the container with id f78c306ac3f0bdf4696ddae198fe6d27055c768cf2b7b9adb8532839ba6d9975
Jul 27 22:45:20.191792 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:20.191761    2565 generic.go:356] "Generic (PLEG): container finished" podID="a0896eb9-1f47-4f22-9295-a538952a52fc" containerID="792d042ae1332dd0975459e0c5db7c161d576e7f287f12260a3616e7ff72de3f" exitCode=0
Jul 27 22:45:20.192202 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:20.191827    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ea5c1d-qwvgh" event={"ID":"a0896eb9-1f47-4f22-9295-a538952a52fc","Type":"ContainerDied","Data":"792d042ae1332dd0975459e0c5db7c161d576e7f287f12260a3616e7ff72de3f"}
Jul 27 22:45:20.192202 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:20.191881    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ea5c1d-qwvgh" event={"ID":"a0896eb9-1f47-4f22-9295-a538952a52fc","Type":"ContainerStarted","Data":"f78c306ac3f0bdf4696ddae198fe6d27055c768cf2b7b9adb8532839ba6d9975"}
Jul 27 22:45:21.340751 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:21.340721    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ea5c1d-qwvgh"
Jul 27 22:45:21.423426 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:21.423394    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0896eb9-1f47-4f22-9295-a538952a52fc-maas-api-service-ca\") pod \"a0896eb9-1f47-4f22-9295-a538952a52fc\" (UID: \"a0896eb9-1f47-4f22-9295-a538952a52fc\") "
Jul 27 22:45:21.423757 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:21.423736    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0896eb9-1f47-4f22-9295-a538952a52fc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a0896eb9-1f47-4f22-9295-a538952a52fc" (UID: "a0896eb9-1f47-4f22-9295-a538952a52fc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:45:21.524757 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:21.524723    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0896eb9-1f47-4f22-9295-a538952a52fc-maas-api-service-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:45:22.208232 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:22.208148    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ea5c1d-qwvgh"
Jul 27 22:45:22.208232 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:22.208170    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ea5c1d-qwvgh" event={"ID":"a0896eb9-1f47-4f22-9295-a538952a52fc","Type":"ContainerDied","Data":"f78c306ac3f0bdf4696ddae198fe6d27055c768cf2b7b9adb8532839ba6d9975"}
Jul 27 22:45:22.208232 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:22.208225    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f78c306ac3f0bdf4696ddae198fe6d27055c768cf2b7b9adb8532839ba6d9975"
Jul 27 22:45:29.532588 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:29.532554    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"]
Jul 27 22:45:29.533071 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:29.532812    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24" podUID="d0f4475a-3737-459c-81c2-0d603d2d837e" containerName="maas-api" containerID="cri-o://0a1475237722eaab172a68d020fc710eb4a2688d7deb93f06ab31c3b8564b72e" gracePeriod=30
Jul 27 22:45:29.791388 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:29.791314    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"
Jul 27 22:45:29.911185 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:29.911153    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0f4475a-3737-459c-81c2-0d603d2d837e-maas-api-tls\") pod \"d0f4475a-3737-459c-81c2-0d603d2d837e\" (UID: \"d0f4475a-3737-459c-81c2-0d603d2d837e\") "
Jul 27 22:45:29.911392 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:29.911206    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rchfr\" (UniqueName: \"kubernetes.io/projected/d0f4475a-3737-459c-81c2-0d603d2d837e-kube-api-access-rchfr\") pod \"d0f4475a-3737-459c-81c2-0d603d2d837e\" (UID: \"d0f4475a-3737-459c-81c2-0d603d2d837e\") "
Jul 27 22:45:29.911392 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:29.911270    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0f4475a-3737-459c-81c2-0d603d2d837e-openshift-service-ca\") pod \"d0f4475a-3737-459c-81c2-0d603d2d837e\" (UID: \"d0f4475a-3737-459c-81c2-0d603d2d837e\") "
Jul 27 22:45:29.912152 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:29.911645    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0f4475a-3737-459c-81c2-0d603d2d837e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d0f4475a-3737-459c-81c2-0d603d2d837e" (UID: "d0f4475a-3737-459c-81c2-0d603d2d837e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:45:29.913765 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:29.913739    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0f4475a-3737-459c-81c2-0d603d2d837e-kube-api-access-rchfr" (OuterVolumeSpecName: "kube-api-access-rchfr") pod "d0f4475a-3737-459c-81c2-0d603d2d837e" (UID: "d0f4475a-3737-459c-81c2-0d603d2d837e"). InnerVolumeSpecName "kube-api-access-rchfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:45:29.914010 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:29.913983    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0f4475a-3737-459c-81c2-0d603d2d837e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d0f4475a-3737-459c-81c2-0d603d2d837e" (UID: "d0f4475a-3737-459c-81c2-0d603d2d837e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:45:30.019224 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:30.013679    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0f4475a-3737-459c-81c2-0d603d2d837e-openshift-service-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:45:30.019224 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:30.013726    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0f4475a-3737-459c-81c2-0d603d2d837e-maas-api-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:45:30.019224 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:30.013750    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rchfr\" (UniqueName: \"kubernetes.io/projected/d0f4475a-3737-459c-81c2-0d603d2d837e-kube-api-access-rchfr\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:45:30.253548 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:30.253510    2565 generic.go:356] "Generic (PLEG): container finished" podID="d0f4475a-3737-459c-81c2-0d603d2d837e" containerID="0a1475237722eaab172a68d020fc710eb4a2688d7deb93f06ab31c3b8564b72e" exitCode=0
Jul 27 22:45:30.253769 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:30.253553    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24" event={"ID":"d0f4475a-3737-459c-81c2-0d603d2d837e","Type":"ContainerDied","Data":"0a1475237722eaab172a68d020fc710eb4a2688d7deb93f06ab31c3b8564b72e"}
Jul 27 22:45:30.253769 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:30.253580    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"
Jul 27 22:45:30.253769 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:30.253653    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24" event={"ID":"d0f4475a-3737-459c-81c2-0d603d2d837e","Type":"ContainerDied","Data":"979daf281e740ad13be6c0f67d0db0d5ac8bb3494bce75ac34ebfce2e26bcbd7"}
Jul 27 22:45:30.253769 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:30.253684    2565 scope.go:117] "RemoveContainer" containerID="0a1475237722eaab172a68d020fc710eb4a2688d7deb93f06ab31c3b8564b72e"
Jul 27 22:45:30.263518 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:30.263500    2565 scope.go:117] "RemoveContainer" containerID="0a1475237722eaab172a68d020fc710eb4a2688d7deb93f06ab31c3b8564b72e"
Jul 27 22:45:30.263793 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:45:30.263772    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a1475237722eaab172a68d020fc710eb4a2688d7deb93f06ab31c3b8564b72e\": container with ID starting with 0a1475237722eaab172a68d020fc710eb4a2688d7deb93f06ab31c3b8564b72e not found: ID does not exist" containerID="0a1475237722eaab172a68d020fc710eb4a2688d7deb93f06ab31c3b8564b72e"
Jul 27 22:45:30.263888 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:30.263805    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a1475237722eaab172a68d020fc710eb4a2688d7deb93f06ab31c3b8564b72e"} err="failed to get container status \"0a1475237722eaab172a68d020fc710eb4a2688d7deb93f06ab31c3b8564b72e\": rpc error: code = NotFound desc = could not find container \"0a1475237722eaab172a68d020fc710eb4a2688d7deb93f06ab31c3b8564b72e\": container with ID starting with 0a1475237722eaab172a68d020fc710eb4a2688d7deb93f06ab31c3b8564b72e not found: ID does not exist"
Jul 27 22:45:30.277734 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:30.277702    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"]
Jul 27 22:45:30.281230 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:30.281202    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ea5c1d-6bf5bd7fd6-2nh24"]
Jul 27 22:45:31.817455 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:31.817423    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0f4475a-3737-459c-81c2-0d603d2d837e" path="/var/lib/kubelet/pods/d0f4475a-3737-459c-81c2-0d603d2d837e/volumes"
Jul 27 22:45:34.030650 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:34.030607    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ea5c1d-qwvgh"]
Jul 27 22:45:34.032941 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:34.032915    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ea5c1d-qwvgh"]
Jul 27 22:45:35.819820 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:35.819781    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0896eb9-1f47-4f22-9295-a538952a52fc" path="/var/lib/kubelet/pods/a0896eb9-1f47-4f22-9295-a538952a52fc/volumes"
Jul 27 22:45:44.038213 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:44.038165    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-48ceef-qr7qc"]
Jul 27 22:45:44.038840 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:44.038818    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0f4475a-3737-459c-81c2-0d603d2d837e" containerName="maas-api"
Jul 27 22:45:44.038932 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:44.038843    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0f4475a-3737-459c-81c2-0d603d2d837e" containerName="maas-api"
Jul 27 22:45:44.038932 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:44.038855    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0896eb9-1f47-4f22-9295-a538952a52fc" containerName="revoke-keys"
Jul 27 22:45:44.038932 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:44.038863    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0896eb9-1f47-4f22-9295-a538952a52fc" containerName="revoke-keys"
Jul 27 22:45:44.039105 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:44.039023    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0896eb9-1f47-4f22-9295-a538952a52fc" containerName="revoke-keys"
Jul 27 22:45:44.039105 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:44.039039    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0f4475a-3737-459c-81c2-0d603d2d837e" containerName="maas-api"
Jul 27 22:45:44.047133 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:44.047101    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-48ceef-qr7qc"
Jul 27 22:45:44.049239 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:44.049208    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-48ceef-qr7qc"]
Jul 27 22:45:44.049771 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:44.049745    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-k9rxw\""
Jul 27 22:45:44.161196 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:44.161160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d76eb715-4328-4ea1-96d4-565df35b411c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-48ceef-qr7qc\" (UID: \"d76eb715-4328-4ea1-96d4-565df35b411c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-48ceef-qr7qc"
Jul 27 22:45:44.262363 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:44.262300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d76eb715-4328-4ea1-96d4-565df35b411c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-48ceef-qr7qc\" (UID: \"d76eb715-4328-4ea1-96d4-565df35b411c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-48ceef-qr7qc"
Jul 27 22:45:44.262941 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:44.262918    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d76eb715-4328-4ea1-96d4-565df35b411c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-48ceef-qr7qc\" (UID: \"d76eb715-4328-4ea1-96d4-565df35b411c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-48ceef-qr7qc"
Jul 27 22:45:44.360362 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:44.360254    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-48ceef-qr7qc"
Jul 27 22:45:44.546579 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:44.546552    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-48ceef-qr7qc"]
Jul 27 22:45:44.548784 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:45:44.548755    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd76eb715_4328_4ea1_96d4_565df35b411c.slice/crio-82368f84a06f4d8084289b06b045e50094ee7d1f9ae0c3055a13c6fcd86203d8 WatchSource:0}: Error finding container 82368f84a06f4d8084289b06b045e50094ee7d1f9ae0c3055a13c6fcd86203d8: Status 404 returned error can't find the container with id 82368f84a06f4d8084289b06b045e50094ee7d1f9ae0c3055a13c6fcd86203d8
Jul 27 22:45:45.340063 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:45.340027    2565 generic.go:356] "Generic (PLEG): container finished" podID="d76eb715-4328-4ea1-96d4-565df35b411c" containerID="6a27d4438bbdf7c877ea394f3f9fab75655f9aaa6e9a4b35de2f3f4c62f9fe66" exitCode=0
Jul 27 22:45:45.340467 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:45.340073    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-48ceef-qr7qc" event={"ID":"d76eb715-4328-4ea1-96d4-565df35b411c","Type":"ContainerDied","Data":"6a27d4438bbdf7c877ea394f3f9fab75655f9aaa6e9a4b35de2f3f4c62f9fe66"}
Jul 27 22:45:45.340467 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:45.340117    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-48ceef-qr7qc" event={"ID":"d76eb715-4328-4ea1-96d4-565df35b411c","Type":"ContainerStarted","Data":"82368f84a06f4d8084289b06b045e50094ee7d1f9ae0c3055a13c6fcd86203d8"}
Jul 27 22:45:46.483154 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:46.483131    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-48ceef-qr7qc"
Jul 27 22:45:46.485183 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:46.485165    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d76eb715-4328-4ea1-96d4-565df35b411c-maas-api-service-ca\") pod \"d76eb715-4328-4ea1-96d4-565df35b411c\" (UID: \"d76eb715-4328-4ea1-96d4-565df35b411c\") "
Jul 27 22:45:46.485476 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:46.485456    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d76eb715-4328-4ea1-96d4-565df35b411c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d76eb715-4328-4ea1-96d4-565df35b411c" (UID: "d76eb715-4328-4ea1-96d4-565df35b411c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:45:46.585897 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:46.585857    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d76eb715-4328-4ea1-96d4-565df35b411c-maas-api-service-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:45:47.351993 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:47.351960    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-48ceef-qr7qc"
Jul 27 22:45:47.351993 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:47.351968    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-48ceef-qr7qc" event={"ID":"d76eb715-4328-4ea1-96d4-565df35b411c","Type":"ContainerDied","Data":"82368f84a06f4d8084289b06b045e50094ee7d1f9ae0c3055a13c6fcd86203d8"}
Jul 27 22:45:47.352212 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:47.352020    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82368f84a06f4d8084289b06b045e50094ee7d1f9ae0c3055a13c6fcd86203d8"
Jul 27 22:45:59.512499 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:59.512466    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"]
Jul 27 22:45:59.512992 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:59.512684    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7" podUID="7f164bb2-b646-4ece-9448-469ae9972551" containerName="maas-api" containerID="cri-o://a62df9b9cae5c3af1f58d0c7c40712656736de64ac9f05811264afb522b18621" gracePeriod=30
Jul 27 22:45:59.518999 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:59.518961    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7" podUID="7f164bb2-b646-4ece-9448-469ae9972551" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.55:8443/health\": dial tcp 10.132.0.55:8443: connect: connection refused"
Jul 27 22:45:59.547321 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:59.547283    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-48ceef-29753205-sd64s"]
Jul 27 22:45:59.551559 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:59.551533    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-48ceef-29753205-sd64s"]
Jul 27 22:45:59.766715 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:59.766583    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"
Jul 27 22:45:59.807508 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:59.807472    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7svxc\" (UniqueName: \"kubernetes.io/projected/7f164bb2-b646-4ece-9448-469ae9972551-kube-api-access-7svxc\") pod \"7f164bb2-b646-4ece-9448-469ae9972551\" (UID: \"7f164bb2-b646-4ece-9448-469ae9972551\") "
Jul 27 22:45:59.807707 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:59.807539    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f164bb2-b646-4ece-9448-469ae9972551-maas-api-tls\") pod \"7f164bb2-b646-4ece-9448-469ae9972551\" (UID: \"7f164bb2-b646-4ece-9448-469ae9972551\") "
Jul 27 22:45:59.807707 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:59.807592    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f164bb2-b646-4ece-9448-469ae9972551-openshift-service-ca\") pod \"7f164bb2-b646-4ece-9448-469ae9972551\" (UID: \"7f164bb2-b646-4ece-9448-469ae9972551\") "
Jul 27 22:45:59.807969 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:59.807944    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f164bb2-b646-4ece-9448-469ae9972551-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7f164bb2-b646-4ece-9448-469ae9972551" (UID: "7f164bb2-b646-4ece-9448-469ae9972551"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:45:59.809716 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:59.809689    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f164bb2-b646-4ece-9448-469ae9972551-kube-api-access-7svxc" (OuterVolumeSpecName: "kube-api-access-7svxc") pod "7f164bb2-b646-4ece-9448-469ae9972551" (UID: "7f164bb2-b646-4ece-9448-469ae9972551"). InnerVolumeSpecName "kube-api-access-7svxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:45:59.809922 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:59.809905    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f164bb2-b646-4ece-9448-469ae9972551-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7f164bb2-b646-4ece-9448-469ae9972551" (UID: "7f164bb2-b646-4ece-9448-469ae9972551"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:45:59.818375 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:59.818346    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="422b94bb-a7a6-443d-9357-f7da5e3306ce" path="/var/lib/kubelet/pods/422b94bb-a7a6-443d-9357-f7da5e3306ce/volumes"
Jul 27 22:45:59.909378 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:59.909348    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7svxc\" (UniqueName: \"kubernetes.io/projected/7f164bb2-b646-4ece-9448-469ae9972551-kube-api-access-7svxc\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:45:59.909378 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:59.909379    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f164bb2-b646-4ece-9448-469ae9972551-maas-api-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:45:59.909566 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:45:59.909395    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f164bb2-b646-4ece-9448-469ae9972551-openshift-service-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:46:00.425386 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:00.425330    2565 generic.go:356] "Generic (PLEG): container finished" podID="7f164bb2-b646-4ece-9448-469ae9972551" containerID="a62df9b9cae5c3af1f58d0c7c40712656736de64ac9f05811264afb522b18621" exitCode=0
Jul 27 22:46:00.425634 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:00.425410    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"
Jul 27 22:46:00.425634 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:00.425409    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7" event={"ID":"7f164bb2-b646-4ece-9448-469ae9972551","Type":"ContainerDied","Data":"a62df9b9cae5c3af1f58d0c7c40712656736de64ac9f05811264afb522b18621"}
Jul 27 22:46:00.425634 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:00.425549    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7" event={"ID":"7f164bb2-b646-4ece-9448-469ae9972551","Type":"ContainerDied","Data":"8353c9e56f4e047b1a42c5fa7bf20fdbfbc88a6f73656e7e97d8a22202e4daac"}
Jul 27 22:46:00.425634 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:00.425577    2565 scope.go:117] "RemoveContainer" containerID="a62df9b9cae5c3af1f58d0c7c40712656736de64ac9f05811264afb522b18621"
Jul 27 22:46:00.437117 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:00.437062    2565 scope.go:117] "RemoveContainer" containerID="a62df9b9cae5c3af1f58d0c7c40712656736de64ac9f05811264afb522b18621"
Jul 27 22:46:00.437708 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:46:00.437688    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a62df9b9cae5c3af1f58d0c7c40712656736de64ac9f05811264afb522b18621\": container with ID starting with a62df9b9cae5c3af1f58d0c7c40712656736de64ac9f05811264afb522b18621 not found: ID does not exist" containerID="a62df9b9cae5c3af1f58d0c7c40712656736de64ac9f05811264afb522b18621"
Jul 27 22:46:00.437796 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:00.437714    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a62df9b9cae5c3af1f58d0c7c40712656736de64ac9f05811264afb522b18621"} err="failed to get container status \"a62df9b9cae5c3af1f58d0c7c40712656736de64ac9f05811264afb522b18621\": rpc error: code = NotFound desc = could not find container \"a62df9b9cae5c3af1f58d0c7c40712656736de64ac9f05811264afb522b18621\": container with ID starting with a62df9b9cae5c3af1f58d0c7c40712656736de64ac9f05811264afb522b18621 not found: ID does not exist"
Jul 27 22:46:00.442765 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:00.442742    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"]
Jul 27 22:46:00.447153 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:00.447133    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-48ceef-795d66bd8c-wbqq7"]
Jul 27 22:46:01.817756 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:01.817724    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f164bb2-b646-4ece-9448-469ae9972551" path="/var/lib/kubelet/pods/7f164bb2-b646-4ece-9448-469ae9972551/volumes"
Jul 27 22:46:04.121444 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:04.121410    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-48ceef-qr7qc"]
Jul 27 22:46:04.123383 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:04.123358    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-48ceef-qr7qc"]
Jul 27 22:46:05.817612 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:05.817581    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d76eb715-4328-4ea1-96d4-565df35b411c" path="/var/lib/kubelet/pods/d76eb715-4328-4ea1-96d4-565df35b411c/volumes"
Jul 27 22:46:15.052319 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:15.052281    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46kbc"]
Jul 27 22:46:15.052743 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:15.052729    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f164bb2-b646-4ece-9448-469ae9972551" containerName="maas-api"
Jul 27 22:46:15.052743 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:15.052744    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f164bb2-b646-4ece-9448-469ae9972551" containerName="maas-api"
Jul 27 22:46:15.052828 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:15.052753    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d76eb715-4328-4ea1-96d4-565df35b411c" containerName="revoke-keys"
Jul 27 22:46:15.052828 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:15.052758    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d76eb715-4328-4ea1-96d4-565df35b411c" containerName="revoke-keys"
Jul 27 22:46:15.052899 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:15.052837    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f164bb2-b646-4ece-9448-469ae9972551" containerName="maas-api"
Jul 27 22:46:15.052899 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:15.052847    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d76eb715-4328-4ea1-96d4-565df35b411c" containerName="revoke-keys"
Jul 27 22:46:15.057384 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:15.057366    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-46kbc"
Jul 27 22:46:15.060199 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:15.060174    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 22:46:15.060293 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:15.060176    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 22:46:15.061269 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:15.061254    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-r6xl9\""
Jul 27 22:46:15.067692 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:15.067672    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46kbc"]
Jul 27 22:46:15.165027 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:15.164994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29s8b\" (UniqueName: \"kubernetes.io/projected/19bd7208-3e41-464c-a166-4afa3b2e892f-kube-api-access-29s8b\") pod \"kuadrant-operator-catalog-46kbc\" (UID: \"19bd7208-3e41-464c-a166-4afa3b2e892f\") " pod="kuadrant-system/kuadrant-operator-catalog-46kbc"
Jul 27 22:46:15.266257 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:15.266223    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29s8b\" (UniqueName: \"kubernetes.io/projected/19bd7208-3e41-464c-a166-4afa3b2e892f-kube-api-access-29s8b\") pod \"kuadrant-operator-catalog-46kbc\" (UID: \"19bd7208-3e41-464c-a166-4afa3b2e892f\") " pod="kuadrant-system/kuadrant-operator-catalog-46kbc"
Jul 27 22:46:15.275744 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:15.275719    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29s8b\" (UniqueName: \"kubernetes.io/projected/19bd7208-3e41-464c-a166-4afa3b2e892f-kube-api-access-29s8b\") pod \"kuadrant-operator-catalog-46kbc\" (UID: \"19bd7208-3e41-464c-a166-4afa3b2e892f\") " pod="kuadrant-system/kuadrant-operator-catalog-46kbc"
Jul 27 22:46:15.367877 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:15.367782    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-46kbc"
Jul 27 22:46:15.499794 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:15.499767    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46kbc"]
Jul 27 22:46:15.501308 ip-10-0-140-114 kubenswrapper[2565]: W0727 22:46:15.501280    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19bd7208_3e41_464c_a166_4afa3b2e892f.slice/crio-3c9834548da9f5548d8fd82ab58889dc1681598d51c7a12511a2d05e0519b3cf WatchSource:0}: Error finding container 3c9834548da9f5548d8fd82ab58889dc1681598d51c7a12511a2d05e0519b3cf: Status 404 returned error can't find the container with id 3c9834548da9f5548d8fd82ab58889dc1681598d51c7a12511a2d05e0519b3cf
Jul 27 22:46:15.508188 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:15.508158    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-46kbc" event={"ID":"19bd7208-3e41-464c-a166-4afa3b2e892f","Type":"ContainerStarted","Data":"3c9834548da9f5548d8fd82ab58889dc1681598d51c7a12511a2d05e0519b3cf"}
Jul 27 22:46:17.531020 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:17.530981    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-46kbc" event={"ID":"19bd7208-3e41-464c-a166-4afa3b2e892f","Type":"ContainerStarted","Data":"56b2ded366e74f0df87891457576e27170d1c88daaff8dfc79e522a5151b4d3e"}
Jul 27 22:46:17.547494 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:17.547443    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-46kbc" podStartSLOduration=0.980071018 podStartE2EDuration="2.54742721s" totalImagesPullingTime="1.567356192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:46:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:46:17.545911056 +0000 UTC m=+3122.287045826" watchObservedRunningTime="2026-07-27 22:46:17.54742721 +0000 UTC m=+3122.288561977"
Jul 27 22:46:25.368531 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:25.368492    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-46kbc"
Jul 27 22:46:25.369059 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:25.368591    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-46kbc"
Jul 27 22:46:25.390437 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:25.390405    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-46kbc"
Jul 27 22:46:25.598179 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:25.598146    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-46kbc"
Jul 27 22:46:25.635419 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:25.635329    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46kbc"]
Jul 27 22:46:27.587395 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:27.587358    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-46kbc" podUID="19bd7208-3e41-464c-a166-4afa3b2e892f" containerName="registry-server" containerID="cri-o://56b2ded366e74f0df87891457576e27170d1c88daaff8dfc79e522a5151b4d3e" gracePeriod=2
Jul 27 22:46:27.833521 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:27.833492    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-46kbc"
Jul 27 22:46:27.888224 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:27.888142    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29s8b\" (UniqueName: \"kubernetes.io/projected/19bd7208-3e41-464c-a166-4afa3b2e892f-kube-api-access-29s8b\") pod \"19bd7208-3e41-464c-a166-4afa3b2e892f\" (UID: \"19bd7208-3e41-464c-a166-4afa3b2e892f\") "
Jul 27 22:46:27.890541 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:27.890515    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19bd7208-3e41-464c-a166-4afa3b2e892f-kube-api-access-29s8b" (OuterVolumeSpecName: "kube-api-access-29s8b") pod "19bd7208-3e41-464c-a166-4afa3b2e892f" (UID: "19bd7208-3e41-464c-a166-4afa3b2e892f"). InnerVolumeSpecName "kube-api-access-29s8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:46:27.989558 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:27.989531    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29s8b\" (UniqueName: \"kubernetes.io/projected/19bd7208-3e41-464c-a166-4afa3b2e892f-kube-api-access-29s8b\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:46:28.593598 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:28.593567    2565 generic.go:356] "Generic (PLEG): container finished" podID="19bd7208-3e41-464c-a166-4afa3b2e892f" containerID="56b2ded366e74f0df87891457576e27170d1c88daaff8dfc79e522a5151b4d3e" exitCode=0
Jul 27 22:46:28.594069 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:28.593603    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-46kbc"
Jul 27 22:46:28.594069 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:28.593650    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-46kbc" event={"ID":"19bd7208-3e41-464c-a166-4afa3b2e892f","Type":"ContainerDied","Data":"56b2ded366e74f0df87891457576e27170d1c88daaff8dfc79e522a5151b4d3e"}
Jul 27 22:46:28.594069 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:28.593695    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-46kbc" event={"ID":"19bd7208-3e41-464c-a166-4afa3b2e892f","Type":"ContainerDied","Data":"3c9834548da9f5548d8fd82ab58889dc1681598d51c7a12511a2d05e0519b3cf"}
Jul 27 22:46:28.594069 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:28.593722    2565 scope.go:117] "RemoveContainer" containerID="56b2ded366e74f0df87891457576e27170d1c88daaff8dfc79e522a5151b4d3e"
Jul 27 22:46:28.603229 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:28.603213    2565 scope.go:117] "RemoveContainer" containerID="56b2ded366e74f0df87891457576e27170d1c88daaff8dfc79e522a5151b4d3e"
Jul 27 22:46:28.603470 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:46:28.603455    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56b2ded366e74f0df87891457576e27170d1c88daaff8dfc79e522a5151b4d3e\": container with ID starting with 56b2ded366e74f0df87891457576e27170d1c88daaff8dfc79e522a5151b4d3e not found: ID does not exist" containerID="56b2ded366e74f0df87891457576e27170d1c88daaff8dfc79e522a5151b4d3e"
Jul 27 22:46:28.603540 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:28.603479    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b2ded366e74f0df87891457576e27170d1c88daaff8dfc79e522a5151b4d3e"} err="failed to get container status \"56b2ded366e74f0df87891457576e27170d1c88daaff8dfc79e522a5151b4d3e\": rpc error: code = NotFound desc = could not find container \"56b2ded366e74f0df87891457576e27170d1c88daaff8dfc79e522a5151b4d3e\": container with ID starting with 56b2ded366e74f0df87891457576e27170d1c88daaff8dfc79e522a5151b4d3e not found: ID does not exist"
Jul 27 22:46:28.617123 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:28.617100    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46kbc"]
Jul 27 22:46:28.621617 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:28.621590    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46kbc"]
Jul 27 22:46:29.824053 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:46:29.824017    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19bd7208-3e41-464c-a166-4afa3b2e892f" path="/var/lib/kubelet/pods/19bd7208-3e41-464c-a166-4afa3b2e892f/volumes"
Jul 27 22:47:03.228666 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:03.228559    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"]
Jul 27 22:47:03.251510 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:03.251477    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e47da1-29753205-zzclw"]
Jul 27 22:47:03.254285 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:03.254260    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-e47da1-29753205-zzclw"]
Jul 27 22:47:03.782084 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:03.782039    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs" podUID="a416e296-6dca-4cf7-8d83-a7461167434d" containerName="maas-api" containerID="cri-o://543509927eec491e660d2d4f4a7b6b5a958d6a3665b4823ee9d399b9a1d1bcef" gracePeriod=30
Jul 27 22:47:03.817098 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:03.817068    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06ea57ea-ddbb-4d23-9dd7-bbe40ce5ce55" path="/var/lib/kubelet/pods/06ea57ea-ddbb-4d23-9dd7-bbe40ce5ce55/volumes"
Jul 27 22:47:04.033031 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:04.032964    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"
Jul 27 22:47:04.052027 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:04.051992    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a416e296-6dca-4cf7-8d83-a7461167434d-maas-api-tls\") pod \"a416e296-6dca-4cf7-8d83-a7461167434d\" (UID: \"a416e296-6dca-4cf7-8d83-a7461167434d\") "
Jul 27 22:47:04.052201 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:04.052154    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a416e296-6dca-4cf7-8d83-a7461167434d-openshift-service-ca\") pod \"a416e296-6dca-4cf7-8d83-a7461167434d\" (UID: \"a416e296-6dca-4cf7-8d83-a7461167434d\") "
Jul 27 22:47:04.052271 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:04.052244    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjhdd\" (UniqueName: \"kubernetes.io/projected/a416e296-6dca-4cf7-8d83-a7461167434d-kube-api-access-qjhdd\") pod \"a416e296-6dca-4cf7-8d83-a7461167434d\" (UID: \"a416e296-6dca-4cf7-8d83-a7461167434d\") "
Jul 27 22:47:04.052711 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:04.052678    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a416e296-6dca-4cf7-8d83-a7461167434d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a416e296-6dca-4cf7-8d83-a7461167434d" (UID: "a416e296-6dca-4cf7-8d83-a7461167434d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:47:04.054616 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:04.054585    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a416e296-6dca-4cf7-8d83-a7461167434d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a416e296-6dca-4cf7-8d83-a7461167434d" (UID: "a416e296-6dca-4cf7-8d83-a7461167434d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:47:04.054857 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:04.054824    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a416e296-6dca-4cf7-8d83-a7461167434d-kube-api-access-qjhdd" (OuterVolumeSpecName: "kube-api-access-qjhdd") pod "a416e296-6dca-4cf7-8d83-a7461167434d" (UID: "a416e296-6dca-4cf7-8d83-a7461167434d"). InnerVolumeSpecName "kube-api-access-qjhdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:47:04.153312 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:04.153281    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a416e296-6dca-4cf7-8d83-a7461167434d-maas-api-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:47:04.153312 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:04.153308    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a416e296-6dca-4cf7-8d83-a7461167434d-openshift-service-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:47:04.153312 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:04.153319    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjhdd\" (UniqueName: \"kubernetes.io/projected/a416e296-6dca-4cf7-8d83-a7461167434d-kube-api-access-qjhdd\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:47:04.788420 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:04.788380    2565 generic.go:356] "Generic (PLEG): container finished" podID="a416e296-6dca-4cf7-8d83-a7461167434d" containerID="543509927eec491e660d2d4f4a7b6b5a958d6a3665b4823ee9d399b9a1d1bcef" exitCode=0
Jul 27 22:47:04.788835 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:04.788432    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"
Jul 27 22:47:04.788835 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:04.788469    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs" event={"ID":"a416e296-6dca-4cf7-8d83-a7461167434d","Type":"ContainerDied","Data":"543509927eec491e660d2d4f4a7b6b5a958d6a3665b4823ee9d399b9a1d1bcef"}
Jul 27 22:47:04.788835 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:04.788532    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs" event={"ID":"a416e296-6dca-4cf7-8d83-a7461167434d","Type":"ContainerDied","Data":"883624c1fd13fb6af7950d9da7f1452be84ba61180d436b8e46fb5d282cfa4bb"}
Jul 27 22:47:04.788835 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:04.788555    2565 scope.go:117] "RemoveContainer" containerID="543509927eec491e660d2d4f4a7b6b5a958d6a3665b4823ee9d399b9a1d1bcef"
Jul 27 22:47:04.797918 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:04.797901    2565 scope.go:117] "RemoveContainer" containerID="543509927eec491e660d2d4f4a7b6b5a958d6a3665b4823ee9d399b9a1d1bcef"
Jul 27 22:47:04.798172 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:47:04.798154    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"543509927eec491e660d2d4f4a7b6b5a958d6a3665b4823ee9d399b9a1d1bcef\": container with ID starting with 543509927eec491e660d2d4f4a7b6b5a958d6a3665b4823ee9d399b9a1d1bcef not found: ID does not exist" containerID="543509927eec491e660d2d4f4a7b6b5a958d6a3665b4823ee9d399b9a1d1bcef"
Jul 27 22:47:04.798230 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:04.798180    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"543509927eec491e660d2d4f4a7b6b5a958d6a3665b4823ee9d399b9a1d1bcef"} err="failed to get container status \"543509927eec491e660d2d4f4a7b6b5a958d6a3665b4823ee9d399b9a1d1bcef\": rpc error: code = NotFound desc = could not find container \"543509927eec491e660d2d4f4a7b6b5a958d6a3665b4823ee9d399b9a1d1bcef\": container with ID starting with 543509927eec491e660d2d4f4a7b6b5a958d6a3665b4823ee9d399b9a1d1bcef not found: ID does not exist"
Jul 27 22:47:04.811528 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:04.811497    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"]
Jul 27 22:47:04.815157 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:04.815134    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e47da1-598955d8dc-k5fgs"]
Jul 27 22:47:05.818630 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:05.818595    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a416e296-6dca-4cf7-8d83-a7461167434d" path="/var/lib/kubelet/pods/a416e296-6dca-4cf7-8d83-a7461167434d/volumes"
Jul 27 22:47:25.204006 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.203963    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"]
Jul 27 22:47:25.204501 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.204258    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk" podUID="6209cb99-8d31-4790-a854-ee2dc968575c" containerName="maas-api" containerID="cri-o://7b6a65df6507b6e1c081803586a025ac12d959711c5f094c0c219488bc414e2c" gracePeriod=30
Jul 27 22:47:25.232064 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.232034    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c5cbe3-29753205-zg298"]
Jul 27 22:47:25.235300 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.235277    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-c5cbe3-29753205-zg298"]
Jul 27 22:47:25.461125 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.461105    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"
Jul 27 22:47:25.566309 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.566273    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lb65\" (UniqueName: \"kubernetes.io/projected/6209cb99-8d31-4790-a854-ee2dc968575c-kube-api-access-2lb65\") pod \"6209cb99-8d31-4790-a854-ee2dc968575c\" (UID: \"6209cb99-8d31-4790-a854-ee2dc968575c\") "
Jul 27 22:47:25.566309 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.566313    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6209cb99-8d31-4790-a854-ee2dc968575c-maas-api-tls\") pod \"6209cb99-8d31-4790-a854-ee2dc968575c\" (UID: \"6209cb99-8d31-4790-a854-ee2dc968575c\") "
Jul 27 22:47:25.566606 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.566416    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6209cb99-8d31-4790-a854-ee2dc968575c-openshift-service-ca\") pod \"6209cb99-8d31-4790-a854-ee2dc968575c\" (UID: \"6209cb99-8d31-4790-a854-ee2dc968575c\") "
Jul 27 22:47:25.566770 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.566746    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6209cb99-8d31-4790-a854-ee2dc968575c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6209cb99-8d31-4790-a854-ee2dc968575c" (UID: "6209cb99-8d31-4790-a854-ee2dc968575c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:47:25.568784 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.568758    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6209cb99-8d31-4790-a854-ee2dc968575c-kube-api-access-2lb65" (OuterVolumeSpecName: "kube-api-access-2lb65") pod "6209cb99-8d31-4790-a854-ee2dc968575c" (UID: "6209cb99-8d31-4790-a854-ee2dc968575c"). InnerVolumeSpecName "kube-api-access-2lb65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:47:25.568884 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.568828    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6209cb99-8d31-4790-a854-ee2dc968575c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6209cb99-8d31-4790-a854-ee2dc968575c" (UID: "6209cb99-8d31-4790-a854-ee2dc968575c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:47:25.667664 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.667629    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lb65\" (UniqueName: \"kubernetes.io/projected/6209cb99-8d31-4790-a854-ee2dc968575c-kube-api-access-2lb65\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:47:25.667664 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.667659    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6209cb99-8d31-4790-a854-ee2dc968575c-maas-api-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:47:25.667838 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.667672    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6209cb99-8d31-4790-a854-ee2dc968575c-openshift-service-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:47:25.817578 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.817500    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91ab33e1-836a-4414-b943-4c307749ffe6" path="/var/lib/kubelet/pods/91ab33e1-836a-4414-b943-4c307749ffe6/volumes"
Jul 27 22:47:25.903317 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.903284    2565 generic.go:356] "Generic (PLEG): container finished" podID="6209cb99-8d31-4790-a854-ee2dc968575c" containerID="7b6a65df6507b6e1c081803586a025ac12d959711c5f094c0c219488bc414e2c" exitCode=0
Jul 27 22:47:25.903506 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.903349    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk" event={"ID":"6209cb99-8d31-4790-a854-ee2dc968575c","Type":"ContainerDied","Data":"7b6a65df6507b6e1c081803586a025ac12d959711c5f094c0c219488bc414e2c"}
Jul 27 22:47:25.903506 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.903355    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"
Jul 27 22:47:25.903506 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.903391    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk" event={"ID":"6209cb99-8d31-4790-a854-ee2dc968575c","Type":"ContainerDied","Data":"9dace0c32de34f8c15f912c7e296069cb2ffa5d53e31f708a2bff92e3880ea69"}
Jul 27 22:47:25.903506 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.903414    2565 scope.go:117] "RemoveContainer" containerID="7b6a65df6507b6e1c081803586a025ac12d959711c5f094c0c219488bc414e2c"
Jul 27 22:47:25.912998 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.912977    2565 scope.go:117] "RemoveContainer" containerID="7b6a65df6507b6e1c081803586a025ac12d959711c5f094c0c219488bc414e2c"
Jul 27 22:47:25.913293 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:47:25.913270    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b6a65df6507b6e1c081803586a025ac12d959711c5f094c0c219488bc414e2c\": container with ID starting with 7b6a65df6507b6e1c081803586a025ac12d959711c5f094c0c219488bc414e2c not found: ID does not exist" containerID="7b6a65df6507b6e1c081803586a025ac12d959711c5f094c0c219488bc414e2c"
Jul 27 22:47:25.913375 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.913302    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b6a65df6507b6e1c081803586a025ac12d959711c5f094c0c219488bc414e2c"} err="failed to get container status \"7b6a65df6507b6e1c081803586a025ac12d959711c5f094c0c219488bc414e2c\": rpc error: code = NotFound desc = could not find container \"7b6a65df6507b6e1c081803586a025ac12d959711c5f094c0c219488bc414e2c\": container with ID starting with 7b6a65df6507b6e1c081803586a025ac12d959711c5f094c0c219488bc414e2c not found: ID does not exist"
Jul 27 22:47:25.920539 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.920516    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"]
Jul 27 22:47:25.925834 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:25.925813    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c5cbe3-776789d79f-cnckk"]
Jul 27 22:47:27.817432 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:27.817400    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6209cb99-8d31-4790-a854-ee2dc968575c" path="/var/lib/kubelet/pods/6209cb99-8d31-4790-a854-ee2dc968575c/volumes"
Jul 27 22:47:47.361878 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:47.361842    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"]
Jul 27 22:47:47.362529 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:47.362056    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln" podUID="d2a23cac-3b90-420e-815e-e349535d9f78" containerName="maas-api" containerID="cri-o://828e91ca410f7cb38d4a16692b1db3670ff89636dda92e0654d6a182f65b6884" gracePeriod=30
Jul 27 22:47:47.391372 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:47.391323    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f36b41-29753205-sfrl2"]
Jul 27 22:47:47.395693 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:47.395665    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f36b41-29753205-sfrl2"]
Jul 27 22:47:47.618064 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:47.617986    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"
Jul 27 22:47:47.682241 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:47.682213    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jj8ww\" (UniqueName: \"kubernetes.io/projected/d2a23cac-3b90-420e-815e-e349535d9f78-kube-api-access-jj8ww\") pod \"d2a23cac-3b90-420e-815e-e349535d9f78\" (UID: \"d2a23cac-3b90-420e-815e-e349535d9f78\") "
Jul 27 22:47:47.682241 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:47.682245    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2a23cac-3b90-420e-815e-e349535d9f78-maas-api-tls\") pod \"d2a23cac-3b90-420e-815e-e349535d9f78\" (UID: \"d2a23cac-3b90-420e-815e-e349535d9f78\") "
Jul 27 22:47:47.682525 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:47.682274    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2a23cac-3b90-420e-815e-e349535d9f78-openshift-service-ca\") pod \"d2a23cac-3b90-420e-815e-e349535d9f78\" (UID: \"d2a23cac-3b90-420e-815e-e349535d9f78\") "
Jul 27 22:47:47.682665 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:47.682636    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2a23cac-3b90-420e-815e-e349535d9f78-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d2a23cac-3b90-420e-815e-e349535d9f78" (UID: "d2a23cac-3b90-420e-815e-e349535d9f78"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:47:47.684514 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:47.684486    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2a23cac-3b90-420e-815e-e349535d9f78-kube-api-access-jj8ww" (OuterVolumeSpecName: "kube-api-access-jj8ww") pod "d2a23cac-3b90-420e-815e-e349535d9f78" (UID: "d2a23cac-3b90-420e-815e-e349535d9f78"). InnerVolumeSpecName "kube-api-access-jj8ww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:47:47.684514 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:47.684503    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2a23cac-3b90-420e-815e-e349535d9f78-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d2a23cac-3b90-420e-815e-e349535d9f78" (UID: "d2a23cac-3b90-420e-815e-e349535d9f78"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:47:47.783939 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:47.783905    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jj8ww\" (UniqueName: \"kubernetes.io/projected/d2a23cac-3b90-420e-815e-e349535d9f78-kube-api-access-jj8ww\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:47:47.783939 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:47.783935    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2a23cac-3b90-420e-815e-e349535d9f78-maas-api-tls\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:47:47.783939 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:47.783947    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2a23cac-3b90-420e-815e-e349535d9f78-openshift-service-ca\") on node \"ip-10-0-140-114.ec2.internal\" DevicePath \"\""
Jul 27 22:47:47.816912 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:47.816876    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f149b4cd-2d29-4841-9158-7abff1b186c3" path="/var/lib/kubelet/pods/f149b4cd-2d29-4841-9158-7abff1b186c3/volumes"
Jul 27 22:47:48.022799 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:48.022766    2565 generic.go:356] "Generic (PLEG): container finished" podID="d2a23cac-3b90-420e-815e-e349535d9f78" containerID="828e91ca410f7cb38d4a16692b1db3670ff89636dda92e0654d6a182f65b6884" exitCode=0
Jul 27 22:47:48.022991 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:48.022823    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"
Jul 27 22:47:48.022991 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:48.022850    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln" event={"ID":"d2a23cac-3b90-420e-815e-e349535d9f78","Type":"ContainerDied","Data":"828e91ca410f7cb38d4a16692b1db3670ff89636dda92e0654d6a182f65b6884"}
Jul 27 22:47:48.022991 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:48.022931    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln" event={"ID":"d2a23cac-3b90-420e-815e-e349535d9f78","Type":"ContainerDied","Data":"dbf159d448dad5be5e2e782e816c8be1e9142159487298963bc59273ef469b8c"}
Jul 27 22:47:48.022991 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:48.022955    2565 scope.go:117] "RemoveContainer" containerID="828e91ca410f7cb38d4a16692b1db3670ff89636dda92e0654d6a182f65b6884"
Jul 27 22:47:48.034127 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:48.034093    2565 scope.go:117] "RemoveContainer" containerID="828e91ca410f7cb38d4a16692b1db3670ff89636dda92e0654d6a182f65b6884"
Jul 27 22:47:48.034650 ip-10-0-140-114 kubenswrapper[2565]: E0727 22:47:48.034625    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"828e91ca410f7cb38d4a16692b1db3670ff89636dda92e0654d6a182f65b6884\": container with ID starting with 828e91ca410f7cb38d4a16692b1db3670ff89636dda92e0654d6a182f65b6884 not found: ID does not exist" containerID="828e91ca410f7cb38d4a16692b1db3670ff89636dda92e0654d6a182f65b6884"
Jul 27 22:47:48.034760 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:48.034657    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"828e91ca410f7cb38d4a16692b1db3670ff89636dda92e0654d6a182f65b6884"} err="failed to get container status \"828e91ca410f7cb38d4a16692b1db3670ff89636dda92e0654d6a182f65b6884\": rpc error: code = NotFound desc = could not find container \"828e91ca410f7cb38d4a16692b1db3670ff89636dda92e0654d6a182f65b6884\": container with ID starting with 828e91ca410f7cb38d4a16692b1db3670ff89636dda92e0654d6a182f65b6884 not found: ID does not exist"
Jul 27 22:47:48.043379 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:48.043355    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"]
Jul 27 22:47:48.048263 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:48.048241    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f36b41-568d7ff4d9-kbxln"]
Jul 27 22:47:49.817163 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:47:49.817122    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2a23cac-3b90-420e-815e-e349535d9f78" path="/var/lib/kubelet/pods/d2a23cac-3b90-420e-815e-e349535d9f78/volumes"
Jul 27 22:48:04.831535 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:04.831501    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68bdf46b89-zxmsb_2e2d9203-9763-4d0b-b59c-298d1058ee35/manager/0.log"
Jul 27 22:48:05.154447 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:05.154369    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f8fb7b654-bb268_9a466e60-b6c1-4d8f-ad29-5c723788c772/copy-manifests/0.log"
Jul 27 22:48:05.160957 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:05.160926    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f8fb7b654-bb268_9a466e60-b6c1-4d8f-ad29-5c723788c772/manager/0.log"
Jul 27 22:48:05.766117 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:05.766076    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5c6b8f6b54-c8r9c_52e0e968-50d1-4be8-bd61-d3d9036b1fe5/maas-api/0.log"
Jul 27 22:48:06.082646 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:06.082562    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29753205-xgxz4_c16e5297-beef-4995-a1ef-7df1890d7c64/cleanup/0.log"
Jul 27 22:48:06.188330 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:06.188291    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-ssqmd_c3a8aab2-8b41-4aa2-a996-a8bcd21ddfb3/postgres/0.log"
Jul 27 22:48:08.666420 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:08.666329    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-n9gg8_449f2f7f-1f03-494c-b28c-fbbb472bea86/discovery/0.log"
Jul 27 22:48:09.112164 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:09.112133    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-gp7lh_7f7aa7fc-a680-4f6c-ac91-b8eaf74b1b99/payload-pre-processing/0.log"
Jul 27 22:48:09.226372 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:09.226321    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-7pxk8_0b3cc73b-6e37-4897-af8c-00f6f8bece07/payload-processing/0.log"
Jul 27 22:48:09.667275 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:09.667242    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-8b82c_d0a8eae4-940c-46d2-8bb4-791c7d531800/main/0.log"
Jul 27 22:48:09.894612 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:09.894577    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-kmp66_1474d49c-d080-461e-ac4d-55697bf83430/main/0.log"
Jul 27 22:48:10.002153 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:10.002126    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f46trq_cf0d4bce-1d57-4af9-a49b-3f693741301f/main/0.log"
Jul 27 22:48:18.536204 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:18.536172    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kg8x5_0aa7d8a4-ee6b-46f4-950b-92335e3aa5f0/global-pull-secret-syncer/0.log"
Jul 27 22:48:18.754192 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:18.754158    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dttzh_e5b27b10-c331-4eb3-afa0-f8af1ff913b2/konnectivity-agent/0.log"
Jul 27 22:48:18.832829 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:18.832741    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-114.ec2.internal_7963463b045c47d8fc8e02283f628750/haproxy/0.log"
Jul 27 22:48:26.091696 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.091608    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f585aac-f45d-4a5d-a290-44ca24274c56/alertmanager/0.log"
Jul 27 22:48:26.121494 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.121468    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f585aac-f45d-4a5d-a290-44ca24274c56/config-reloader/0.log"
Jul 27 22:48:26.148504 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.148473    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f585aac-f45d-4a5d-a290-44ca24274c56/kube-rbac-proxy-web/0.log"
Jul 27 22:48:26.172740 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.172714    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f585aac-f45d-4a5d-a290-44ca24274c56/kube-rbac-proxy/0.log"
Jul 27 22:48:26.198916 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.198885    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f585aac-f45d-4a5d-a290-44ca24274c56/kube-rbac-proxy-metric/0.log"
Jul 27 22:48:26.221573 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.221542    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f585aac-f45d-4a5d-a290-44ca24274c56/prom-label-proxy/0.log"
Jul 27 22:48:26.249112 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.249078    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f585aac-f45d-4a5d-a290-44ca24274c56/init-config-reloader/0.log"
Jul 27 22:48:26.443176 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.443088    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-5m5gq_777715f6-7f65-45ed-b262-85464cdd02f5/kube-state-metrics/0.log"
Jul 27 22:48:26.461641 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.461616    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-5m5gq_777715f6-7f65-45ed-b262-85464cdd02f5/kube-rbac-proxy-main/0.log"
Jul 27 22:48:26.488601 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.488567    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-5m5gq_777715f6-7f65-45ed-b262-85464cdd02f5/kube-rbac-proxy-self/0.log"
Jul 27 22:48:26.515201 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.515167    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-685b65cf7f-dwtrs_8d3c6c62-f90a-4192-b8a8-f88f5f7d4c5f/metrics-server/0.log"
Jul 27 22:48:26.732860 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.732832    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w62f7_c39868ff-0054-4900-867f-7338e6bd13af/node-exporter/0.log"
Jul 27 22:48:26.752839 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.752817    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w62f7_c39868ff-0054-4900-867f-7338e6bd13af/kube-rbac-proxy/0.log"
Jul 27 22:48:26.778421 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.778401    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w62f7_c39868ff-0054-4900-867f-7338e6bd13af/init-textfile/0.log"
Jul 27 22:48:26.798069 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.798044    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-gksqp_db759bf4-2c95-43e8-b419-25167337b05c/kube-rbac-proxy-main/0.log"
Jul 27 22:48:26.827287 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.827263    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-gksqp_db759bf4-2c95-43e8-b419-25167337b05c/kube-rbac-proxy-self/0.log"
Jul 27 22:48:26.851023 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.851003    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-gksqp_db759bf4-2c95-43e8-b419-25167337b05c/openshift-state-metrics/0.log"
Jul 27 22:48:26.889361 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.889319    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d01d12b4-f388-474f-bb04-af21307608dc/prometheus/0.log"
Jul 27 22:48:26.909421 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.909395    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d01d12b4-f388-474f-bb04-af21307608dc/config-reloader/0.log"
Jul 27 22:48:26.930230 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.930192    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d01d12b4-f388-474f-bb04-af21307608dc/thanos-sidecar/0.log"
Jul 27 22:48:26.950857 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.950831    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d01d12b4-f388-474f-bb04-af21307608dc/kube-rbac-proxy-web/0.log"
Jul 27 22:48:26.973094 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.973065    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d01d12b4-f388-474f-bb04-af21307608dc/kube-rbac-proxy/0.log"
Jul 27 22:48:26.995147 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:26.995073    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d01d12b4-f388-474f-bb04-af21307608dc/kube-rbac-proxy-thanos/0.log"
Jul 27 22:48:27.016226 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:27.016198    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d01d12b4-f388-474f-bb04-af21307608dc/init-config-reloader/0.log"
Jul 27 22:48:27.093493 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:27.093459    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-sw5bh_d95af059-949b-4242-ae1b-ff8d1bf6a27c/prometheus-operator-admission-webhook/0.log"
Jul 27 22:48:27.201314 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:27.201284    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d56677975-kmk9m_9969c480-8555-4907-8cee-2cb98c865ddd/thanos-query/0.log"
Jul 27 22:48:27.241456 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:27.241429    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d56677975-kmk9m_9969c480-8555-4907-8cee-2cb98c865ddd/kube-rbac-proxy-web/0.log"
Jul 27 22:48:27.272079 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:27.271981    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d56677975-kmk9m_9969c480-8555-4907-8cee-2cb98c865ddd/kube-rbac-proxy/0.log"
Jul 27 22:48:27.295438 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:27.295417    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d56677975-kmk9m_9969c480-8555-4907-8cee-2cb98c865ddd/prom-label-proxy/0.log"
Jul 27 22:48:27.317531 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:27.317503    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d56677975-kmk9m_9969c480-8555-4907-8cee-2cb98c865ddd/kube-rbac-proxy-rules/0.log"
Jul 27 22:48:27.339671 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:27.339644    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d56677975-kmk9m_9969c480-8555-4907-8cee-2cb98c865ddd/kube-rbac-proxy-metrics/0.log"
Jul 27 22:48:28.493718 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.493689    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-cbv9s_96b3223c-2d5a-4b94-9a18-7c0e1043b3f8/networking-console-plugin/0.log"
Jul 27 22:48:28.579405 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.579373    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"]
Jul 27 22:48:28.579865 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.579847    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2a23cac-3b90-420e-815e-e349535d9f78" containerName="maas-api"
Jul 27 22:48:28.579960 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.579868    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2a23cac-3b90-420e-815e-e349535d9f78" containerName="maas-api"
Jul 27 22:48:28.579960 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.579881    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a416e296-6dca-4cf7-8d83-a7461167434d" containerName="maas-api"
Jul 27 22:48:28.579960 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.579888    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a416e296-6dca-4cf7-8d83-a7461167434d" containerName="maas-api"
Jul 27 22:48:28.579960 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.579903    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6209cb99-8d31-4790-a854-ee2dc968575c" containerName="maas-api"
Jul 27 22:48:28.579960 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.579912    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6209cb99-8d31-4790-a854-ee2dc968575c" containerName="maas-api"
Jul 27 22:48:28.579960 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.579936    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19bd7208-3e41-464c-a166-4afa3b2e892f" containerName="registry-server"
Jul 27 22:48:28.579960 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.579947    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="19bd7208-3e41-464c-a166-4afa3b2e892f" containerName="registry-server"
Jul 27 22:48:28.580308 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.580032    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a416e296-6dca-4cf7-8d83-a7461167434d" containerName="maas-api"
Jul 27 22:48:28.580308 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.580050    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6209cb99-8d31-4790-a854-ee2dc968575c" containerName="maas-api"
Jul 27 22:48:28.580308 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.580059    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2a23cac-3b90-420e-815e-e349535d9f78" containerName="maas-api"
Jul 27 22:48:28.580308 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.580070    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="19bd7208-3e41-464c-a166-4afa3b2e892f" containerName="registry-server"
Jul 27 22:48:28.583276 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.583254    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"
Jul 27 22:48:28.585619 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.585575    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j945x\"/\"kube-root-ca.crt\""
Jul 27 22:48:28.585807 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.585791    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j945x\"/\"openshift-service-ca.crt\""
Jul 27 22:48:28.586597 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.586583    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j945x\"/\"default-dockercfg-94sd4\""
Jul 27 22:48:28.593270 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.593246    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"]
Jul 27 22:48:28.666729 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.666699    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13-lib-modules\") pod \"perf-node-gather-daemonset-l6b82\" (UID: \"3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13\") " pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"
Jul 27 22:48:28.666923 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.666754    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13-proc\") pod \"perf-node-gather-daemonset-l6b82\" (UID: \"3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13\") " pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"
Jul 27 22:48:28.666923 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.666800    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13-podres\") pod \"perf-node-gather-daemonset-l6b82\" (UID: \"3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13\") " pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"
Jul 27 22:48:28.666923 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.666884    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvhnh\" (UniqueName: \"kubernetes.io/projected/3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13-kube-api-access-lvhnh\") pod \"perf-node-gather-daemonset-l6b82\" (UID: \"3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13\") " pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"
Jul 27 22:48:28.667059 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.666942    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13-sys\") pod \"perf-node-gather-daemonset-l6b82\" (UID: \"3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13\") " pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"
Jul 27 22:48:28.767587 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.767501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13-podres\") pod \"perf-node-gather-daemonset-l6b82\" (UID: \"3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13\") " pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"
Jul 27 22:48:28.767587 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.767556    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvhnh\" (UniqueName: \"kubernetes.io/projected/3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13-kube-api-access-lvhnh\") pod \"perf-node-gather-daemonset-l6b82\" (UID: \"3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13\") " pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"
Jul 27 22:48:28.767587 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.767584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13-sys\") pod \"perf-node-gather-daemonset-l6b82\" (UID: \"3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13\") " pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"
Jul 27 22:48:28.767832 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.767644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13-lib-modules\") pod \"perf-node-gather-daemonset-l6b82\" (UID: \"3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13\") " pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"
Jul 27 22:48:28.767832 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.767698    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13-podres\") pod \"perf-node-gather-daemonset-l6b82\" (UID: \"3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13\") " pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"
Jul 27 22:48:28.767832 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.767712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13-proc\") pod \"perf-node-gather-daemonset-l6b82\" (UID: \"3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13\") " pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"
Jul 27 22:48:28.767832 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.767708    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13-sys\") pod \"perf-node-gather-daemonset-l6b82\" (UID: \"3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13\") " pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"
Jul 27 22:48:28.767832 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.767780    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13-lib-modules\") pod \"perf-node-gather-daemonset-l6b82\" (UID: \"3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13\") " pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"
Jul 27 22:48:28.767832 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.767807    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13-proc\") pod \"perf-node-gather-daemonset-l6b82\" (UID: \"3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13\") " pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"
Jul 27 22:48:28.776073 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.776045    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvhnh\" (UniqueName: \"kubernetes.io/projected/3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13-kube-api-access-lvhnh\") pod \"perf-node-gather-daemonset-l6b82\" (UID: \"3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13\") " pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"
Jul 27 22:48:28.894394 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:28.894357    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"
Jul 27 22:48:29.043379 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:29.043352    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"]
Jul 27 22:48:29.244884 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:29.244852    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82" event={"ID":"3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13","Type":"ContainerStarted","Data":"ae8e618776cd5a057ea47fdafe4669460e92c3e6bc59e8bf9659c2b3546998f3"}
Jul 27 22:48:29.245071 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:29.244905    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82" event={"ID":"3a9d3d3a-cebc-4363-a6b1-9b7cccd5be13","Type":"ContainerStarted","Data":"81ed1cfbfc7efbc56618af1972fffe0120dfa7eaaf53867d94d121411095f5e8"}
Jul 27 22:48:29.245071 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:29.244936    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"
Jul 27 22:48:29.261985 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:29.261937    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82" podStartSLOduration=1.261919233 podStartE2EDuration="1.261919233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 22:48:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:48:29.260816875 +0000 UTC m=+3254.001951668" watchObservedRunningTime="2026-07-27 22:48:29.261919233 +0000 UTC m=+3254.003054000"
Jul 27 22:48:30.260054 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:30.260023    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-vwg5z_308497ef-816b-4a18-b4a3-b35176e67bc6/volume-data-source-validator/0.log"
Jul 27 22:48:31.269221 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:31.269191    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-blwlz_f7de6e29-5e18-452b-9853-82530fc6bd38/dns/0.log"
Jul 27 22:48:31.291859 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:31.291832    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-blwlz_f7de6e29-5e18-452b-9853-82530fc6bd38/kube-rbac-proxy/0.log"
Jul 27 22:48:31.446834 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:31.446807    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pxjs5_eb157c02-c15b-478b-995d-c42405aff70e/dns-node-resolver/0.log"
Jul 27 22:48:32.065793 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:32.065764    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f82sq_881ffdfa-9a29-42e3-828d-23523dd11af5/node-ca/0.log"
Jul 27 22:48:33.284890 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:33.284861    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-n9gg8_449f2f7f-1f03-494c-b28c-fbbb472bea86/discovery/0.log"
Jul 27 22:48:33.440981 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:33.440947    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-gp7lh_7f7aa7fc-a680-4f6c-ac91-b8eaf74b1b99/payload-pre-processing/0.log"
Jul 27 22:48:33.481711 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:33.481678    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-7pxk8_0b3cc73b-6e37-4897-af8c-00f6f8bece07/payload-processing/0.log"
Jul 27 22:48:34.354142 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:34.354106    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kbx2h_fb94c2b1-988f-4a6c-8871-4462d73cfb15/serve-healthcheck-canary/0.log"
Jul 27 22:48:34.953381 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:34.953347    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6rvzs_d188f777-521a-4a1a-8cb9-6caf9c6acf8f/kube-rbac-proxy/0.log"
Jul 27 22:48:34.975549 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:34.975525    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6rvzs_d188f777-521a-4a1a-8cb9-6caf9c6acf8f/exporter/0.log"
Jul 27 22:48:35.000485 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:35.000424    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6rvzs_d188f777-521a-4a1a-8cb9-6caf9c6acf8f/extractor/0.log"
Jul 27 22:48:35.259481 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:35.259455    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-j945x/perf-node-gather-daemonset-l6b82"
Jul 27 22:48:37.767915 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:37.767877    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68bdf46b89-zxmsb_2e2d9203-9763-4d0b-b59c-298d1058ee35/manager/0.log"
Jul 27 22:48:37.916210 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:37.916182    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f8fb7b654-bb268_9a466e60-b6c1-4d8f-ad29-5c723788c772/manager/0.log"
Jul 27 22:48:37.941453 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:37.941423    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f8fb7b654-bb268_9a466e60-b6c1-4d8f-ad29-5c723788c772/copy-manifests/0.log"
Jul 27 22:48:38.796496 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:38.796467    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-n9gg8_449f2f7f-1f03-494c-b28c-fbbb472bea86/discovery/0.log"
Jul 27 22:48:38.929037 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:38.928996    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-gp7lh_7f7aa7fc-a680-4f6c-ac91-b8eaf74b1b99/payload-pre-processing/0.log"
Jul 27 22:48:38.960229 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:38.960197    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-7pxk8_0b3cc73b-6e37-4897-af8c-00f6f8bece07/payload-processing/0.log"
Jul 27 22:48:39.629499 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:39.629466    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8444c4f6f9-nktbk_63baaaab-ef85-45b3-b50b-737436ae758a/manager/1.log"
Jul 27 22:48:39.630084 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:39.630063    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8444c4f6f9-nktbk_63baaaab-ef85-45b3-b50b-737436ae758a/manager/0.log"
Jul 27 22:48:39.656745 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:39.656723    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-cmxj5_f0467fde-84d9-4801-b106-da03164f2aac/openshift-lws-operator/0.log"
Jul 27 22:48:40.741470 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:40.741441    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-n9gg8_449f2f7f-1f03-494c-b28c-fbbb472bea86/discovery/0.log"
Jul 27 22:48:40.861550 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:40.861519    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-gp7lh_7f7aa7fc-a680-4f6c-ac91-b8eaf74b1b99/payload-pre-processing/0.log"
Jul 27 22:48:40.901261 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:40.901224    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-7pxk8_0b3cc73b-6e37-4897-af8c-00f6f8bece07/payload-processing/0.log"
Jul 27 22:48:44.540095 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:44.540052    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-kb48r_9f479a96-d058-410c-ad48-e6180b486689/migrator/0.log"
Jul 27 22:48:44.561185 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:44.561157    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-kb48r_9f479a96-d058-410c-ad48-e6180b486689/graceful-termination/0.log"
Jul 27 22:48:45.992847 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:45.992817    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2l4n7_3611ede8-5415-4ada-8800-39d88377ec13/kube-multus/0.log"
Jul 27 22:48:46.024204 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:46.024178    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-792l4_f82f51e4-ec5e-405e-97f1-8b12129dff3c/kube-multus-additional-cni-plugins/0.log"
Jul 27 22:48:46.050926 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:46.050901    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-792l4_f82f51e4-ec5e-405e-97f1-8b12129dff3c/egress-router-binary-copy/0.log"
Jul 27 22:48:46.079567 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:46.079539    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-792l4_f82f51e4-ec5e-405e-97f1-8b12129dff3c/cni-plugins/0.log"
Jul 27 22:48:46.103662 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:46.103638    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-792l4_f82f51e4-ec5e-405e-97f1-8b12129dff3c/bond-cni-plugin/0.log"
Jul 27 22:48:46.125869 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:46.125703    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-792l4_f82f51e4-ec5e-405e-97f1-8b12129dff3c/routeoverride-cni/0.log"
Jul 27 22:48:46.148277 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:46.148254    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-792l4_f82f51e4-ec5e-405e-97f1-8b12129dff3c/whereabouts-cni-bincopy/0.log"
Jul 27 22:48:46.171965 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:46.171942    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-792l4_f82f51e4-ec5e-405e-97f1-8b12129dff3c/whereabouts-cni/0.log"
Jul 27 22:48:46.678032 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:46.677999    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lgt8f_807200be-220e-4e07-8641-8b0bd2788381/network-metrics-daemon/0.log"
Jul 27 22:48:46.696762 ip-10-0-140-114 kubenswrapper[2565]: I0727 22:48:46.696733    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lgt8f_807200be-220e-4e07-8641-8b0bd2788381/kube-rbac-proxy/0.log"