Jul 09 16:48:50.694829 ip-10-0-140-229 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 09 16:48:50.694842 ip-10-0-140-229 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 09 16:48:50.694853 ip-10-0-140-229 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 09 16:48:50.695191 ip-10-0-140-229 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 09 16:49:00.741207 ip-10-0-140-229 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 09 16:49:00.741228 ip-10-0-140-229 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 215d5fcea5864dd58e93e9346e84cb4f --
Jul 09 16:51:01.134881 ip-10-0-140-229 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 16:51:01.608703 ip-10-0-140-229 systemd[1]: Started Kubernetes Kubelet.
Jul 09 16:51:01.609832 ip-10-0-140-229 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 16:51:01.609832 ip-10-0-140-229 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 16:51:01.609832 ip-10-0-140-229 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 16:51:01.609832 ip-10-0-140-229 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 16:51:01.609832 ip-10-0-140-229 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 16:51:01.609832 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.537066    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 16:51:01.609832 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541778    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 16:51:01.609832 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541793    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 16:51:01.609832 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541797    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 16:51:01.609832 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541802    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 16:51:01.609832 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541807    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 16:51:01.609832 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541810    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 16:51:01.609832 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541820    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 16:51:01.609832 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541823    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 16:51:01.612346 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541827    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 16:51:01.612346 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541830    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 16:51:01.612346 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541833    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 16:51:01.612346 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541836    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 16:51:01.612346 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541839    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 16:51:01.612346 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541842    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 16:51:01.612346 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541845    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 16:51:01.612346 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541848    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 16:51:01.612346 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541851    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 16:51:01.612346 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541854    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 16:51:01.612346 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541857    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 16:51:01.612346 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541860    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 16:51:01.612346 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541863    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 16:51:01.612346 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541865    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 16:51:01.612346 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541868    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 16:51:01.612346 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541870    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 16:51:01.612346 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541874    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 16:51:01.612346 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541878    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 16:51:01.612346 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541881    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 16:51:01.613602 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541884    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 16:51:01.613602 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541886    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 16:51:01.613602 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541890    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 16:51:01.613602 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541892    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 16:51:01.613602 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541895    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 16:51:01.613602 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541897    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 16:51:01.613602 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541900    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 16:51:01.613602 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541902    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 16:51:01.613602 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541905    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 16:51:01.613602 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541907    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 16:51:01.613602 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541911    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 16:51:01.613602 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541914    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 16:51:01.613602 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541916    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 16:51:01.613602 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541919    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 16:51:01.613602 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541922    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 16:51:01.613602 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541925    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 16:51:01.613602 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541927    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 16:51:01.613602 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541930    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 16:51:01.613602 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541932    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 16:51:01.615612 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541935    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 16:51:01.615612 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541937    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 16:51:01.615612 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541941    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 16:51:01.615612 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541943    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 16:51:01.615612 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541946    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 16:51:01.615612 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541948    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 16:51:01.615612 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541951    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 16:51:01.615612 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541953    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 16:51:01.615612 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541956    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 16:51:01.615612 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541959    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 16:51:01.615612 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541961    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 16:51:01.615612 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541963    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 16:51:01.615612 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541967    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 16:51:01.615612 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541969    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 16:51:01.615612 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541972    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 16:51:01.615612 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541974    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 16:51:01.615612 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541977    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 16:51:01.615612 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541980    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 16:51:01.615612 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541982    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 16:51:01.615612 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541985    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 16:51:01.616376 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541988    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 16:51:01.616376 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541990    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 16:51:01.616376 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541993    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 16:51:01.616376 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.541998    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 16:51:01.616376 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542001    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 16:51:01.616376 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542003    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 16:51:01.616376 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542006    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 16:51:01.616376 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542009    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 16:51:01.616376 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542011    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 16:51:01.616376 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542014    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 16:51:01.616376 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542016    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 16:51:01.616376 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542018    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 16:51:01.616376 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542022    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 16:51:01.616376 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542025    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 16:51:01.616376 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542028    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 16:51:01.616376 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542031    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 16:51:01.616376 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542035    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 16:51:01.616376 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542038    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 16:51:01.616376 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542041    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 16:51:01.616376 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542044    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 16:51:01.624264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542047    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 16:51:01.624264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542049    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 16:51:01.624264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542052    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 16:51:01.624264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542055    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 16:51:01.624264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542057    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 16:51:01.624264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542060    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 16:51:01.624264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542062    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 16:51:01.624264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542065    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 16:51:01.624264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542067    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 16:51:01.624264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542070    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 16:51:01.624264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542073    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 16:51:01.624264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542075    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 16:51:01.624264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542077    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 16:51:01.624264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542861    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 16:51:01.624264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542869    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 16:51:01.624264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542874    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 16:51:01.624264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542877    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 16:51:01.624264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542881    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 16:51:01.624264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542884    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 16:51:01.624264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542886    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 16:51:01.625308 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542889    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 16:51:01.625308 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542892    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 16:51:01.625308 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542895    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 16:51:01.625308 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542897    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 16:51:01.625308 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542900    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 16:51:01.625308 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542904    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 16:51:01.625308 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542908    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 16:51:01.625308 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542911    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 16:51:01.625308 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542914    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 16:51:01.625308 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542916    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 16:51:01.625308 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542919    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 16:51:01.625308 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542922    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 16:51:01.625308 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542924    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 16:51:01.625308 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542927    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 16:51:01.625308 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542929    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 16:51:01.625308 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542932    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 16:51:01.625308 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542935    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 16:51:01.625308 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542938    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 16:51:01.625308 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542941    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 16:51:01.627845 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542943    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 16:51:01.627845 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542946    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 16:51:01.627845 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542948    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 16:51:01.627845 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542951    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 16:51:01.627845 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542953    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 16:51:01.627845 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542956    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 16:51:01.627845 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542959    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 16:51:01.627845 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542962    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 16:51:01.627845 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542964    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 16:51:01.627845 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542967    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 16:51:01.627845 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542970    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 16:51:01.627845 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542973    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 16:51:01.627845 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542976    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 16:51:01.627845 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542979    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 16:51:01.627845 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542983    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 16:51:01.627845 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542985    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 16:51:01.627845 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542988    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 16:51:01.627845 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542991    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 16:51:01.627845 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542993    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 16:51:01.627845 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542996    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 16:51:01.629306 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.542999    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 16:51:01.629306 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543001    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 16:51:01.629306 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543004    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 16:51:01.629306 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543006    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 16:51:01.629306 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543009    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 16:51:01.629306 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543012    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 16:51:01.629306 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543014    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 16:51:01.629306 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543017    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 16:51:01.629306 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543019    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 16:51:01.629306 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543022    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 16:51:01.629306 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543025    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 16:51:01.629306 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543027    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 16:51:01.629306 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543030    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 16:51:01.629306 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543032    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 16:51:01.629306 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543035    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 16:51:01.629306 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543038    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 16:51:01.629306 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543040    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 16:51:01.629306 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543043    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 16:51:01.629306 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543046    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 16:51:01.629306 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543050    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 16:51:01.631227 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543053    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 16:51:01.631227 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543056    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 16:51:01.631227 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543058    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 16:51:01.631227 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543061    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 16:51:01.631227 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543064    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 16:51:01.631227 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543067    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 16:51:01.631227 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543069    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 16:51:01.631227 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543093    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 16:51:01.631227 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543097    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 16:51:01.631227 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543100    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 16:51:01.631227 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543103    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 16:51:01.631227 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543106    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 16:51:01.631227 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543109    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 16:51:01.631227 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543112    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 16:51:01.631227 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543114    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 16:51:01.631227 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543117    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 16:51:01.631227 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543120    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 16:51:01.631227 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543123    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 16:51:01.631227 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543125    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 16:51:01.631227 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543128    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 16:51:02.810644 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543130    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 16:51:02.810644 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543133    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 16:51:02.810644 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543137    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 16:51:02.810644 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543140    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 16:51:02.810644 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543143    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 16:51:02.810644 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543145    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 16:51:02.810644 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543148    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 16:51:02.810644 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543151    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 16:51:02.810644 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543153    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 16:51:02.810644 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543156    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 16:51:02.810644 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543159    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 16:51:02.810644 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543161    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 16:51:02.810644 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543164    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 16:51:02.810644 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543562    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 16:51:02.810644 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543567    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 16:51:02.810644 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543570    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 16:51:02.810644 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543573    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 16:51:02.810644 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543576    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 16:51:02.810644 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543578    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 16:51:02.812109 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543581    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 16:51:02.812109 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543598    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 16:51:02.812109 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543603    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 16:51:02.812109 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543606    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 16:51:02.812109 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543609    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 16:51:02.812109 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543611    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 16:51:02.812109 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543614    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 16:51:02.812109 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543616    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 16:51:02.812109 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543619    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 16:51:02.812109 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543622    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 16:51:02.812109 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543624    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 16:51:02.812109 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543627    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 16:51:02.812109 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543631    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 16:51:02.812109 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543633    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 16:51:02.812109 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543636    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 16:51:02.812109 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543638    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 16:51:02.812109 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543641    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 16:51:02.812109 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543644    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 16:51:02.812109 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543646    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 16:51:02.812109 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543649    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 16:51:02.813007 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543653    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 16:51:02.813007 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543657    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 16:51:02.813007 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543660    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 16:51:02.813007 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543663    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 16:51:02.813007 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543665    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 16:51:02.813007 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543668    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 16:51:02.813007 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543673    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 16:51:02.813007 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543676    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 16:51:02.813007 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543679    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 16:51:02.813007 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543682    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 16:51:02.813007 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543685    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 16:51:02.813007 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543688    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 16:51:02.813007 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543690    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 16:51:02.813007 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543693    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 16:51:02.813007 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543695    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 16:51:02.813007 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543698    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 16:51:02.813007 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543700    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 16:51:02.813007 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543703    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 16:51:02.813007 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543708    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 16:51:02.814962 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543710    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 16:51:02.814962 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543714    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 16:51:02.814962 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543717    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 16:51:02.814962 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543719    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 16:51:02.814962 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543722    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 16:51:02.814962 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543725    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 16:51:02.814962 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543727    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 16:51:02.814962 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543730    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 16:51:02.814962 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543732    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 16:51:02.814962 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543735    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 16:51:02.814962 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543738    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 16:51:02.814962 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543740    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 16:51:02.814962 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543743    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 16:51:02.814962 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543745    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 16:51:02.814962 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543748    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 16:51:02.814962 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543750    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 16:51:02.814962 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543753    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 16:51:02.814962 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543756    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 16:51:02.814962 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543760    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 16:51:02.814962 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543764    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 16:51:02.815710 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543767    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 16:51:02.815710 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543770    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 16:51:02.815710 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543772    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 16:51:02.815710 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543775    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 16:51:02.815710 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543777    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 16:51:02.815710 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543780    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 16:51:02.815710 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543783    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 16:51:02.815710 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543785    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 16:51:02.815710 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543788    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 16:51:02.815710 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543790    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 16:51:02.815710 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543793    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 16:51:02.815710 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543800    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 16:51:02.815710 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543802    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 16:51:02.815710 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543805    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 16:51:02.815710 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543807    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 16:51:02.815710 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543810    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 16:51:02.815710 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543813    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 16:51:02.815710 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543815    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 16:51:02.815710 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543818    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 16:51:02.815710 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543820    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 16:51:02.816484 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543823    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 16:51:02.816484 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543825    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 16:51:02.816484 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543828    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 16:51:02.816484 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543830    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 16:51:02.816484 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543833    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 16:51:02.816484 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543835    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 16:51:02.816484 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543838    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 16:51:02.816484 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543841    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 16:51:02.816484 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543843    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 16:51:02.816484 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543845    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 16:51:02.816484 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543848    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 16:51:02.816484 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543852    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 16:51:02.816484 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543856    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 16:51:02.816484 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.543859    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 16:51:02.816484 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.543947    2568 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 16:51:02.816484 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.543958    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 16:51:02.816484 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.543966    2568 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 16:51:02.816484 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.543972    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 16:51:02.816484 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.543977    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 16:51:02.816484 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.543980    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.543984    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.543988    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.543992    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.543996    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544000    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544003    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544006    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544009    2568 flags.go:64] FLAG: --cgroup-root=""
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544012    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544015    2568 flags.go:64] FLAG: --client-ca-file=""
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544018    2568 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544021    2568 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544026    2568 flags.go:64] FLAG: --cluster-domain=""
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544029    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544032    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544035    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544039    2568 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544042    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544045    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544048    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544052    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544055    2568 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544058    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 16:51:02.819259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544063    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544066    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544069    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544073    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544076    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544079    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544082    2568 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544086    2568 flags.go:64] FLAG: --enable-server="true"
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544089    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544093    2568 flags.go:64] FLAG: --event-burst="100"
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544097    2568 flags.go:64] FLAG: --event-qps="50"
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544100    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544104    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544107    2568 flags.go:64] FLAG: --eviction-hard=""
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544111    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544114    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544117    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544120    2568 flags.go:64] FLAG: --eviction-soft=""
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544123    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544125    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544128    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544131    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544134    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544137    2568 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544140    2568 flags.go:64] FLAG: --feature-gates=""
Jul 09 16:51:02.820427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544143    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544146    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544149    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544152    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544155    2568 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544158    2568 flags.go:64] FLAG: --help="false"
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544161    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-140-229.ec2.internal"
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544165    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544168    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544171    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544174    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544178    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544181    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544183    2568 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544186    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544190    2568 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544193    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544196    2568 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544198    2568 flags.go:64] FLAG: --kube-reserved=""
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544203    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544205    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544208    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544211    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544214    2568 flags.go:64] FLAG: --lock-file=""
Jul 09 16:51:02.822747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544217    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544220    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544222    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544228    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544230    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544233    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544236    2568 flags.go:64] FLAG: --logging-format="text"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544239    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544257    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544261    2568 flags.go:64] FLAG: --manifest-url=""
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544265    2568 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544270    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544273    2568 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544278    2568 flags.go:64] FLAG: --max-pods="110"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544281    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544285    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544288    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544291    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544294    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544297    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544300    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544307    2568 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544310    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544313    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 16:51:02.823884 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544317    2568 flags.go:64] FLAG: --pod-cidr=""
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544320    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544326    2568 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544330    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544333    2568 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544336    2568 flags.go:64] FLAG: --port="10250"
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544339    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544342    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-058ba4bda5baa8e69"
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544345    2568 flags.go:64] FLAG: --qos-reserved=""
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544348    2568 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544351    2568 flags.go:64] FLAG: --register-node="true"
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544354    2568 flags.go:64] FLAG: --register-with-taints=""
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544357    2568 flags.go:64] FLAG: --registry-burst="10"
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544360    2568 flags.go:64] FLAG: --registry-qps="5"
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544363    2568 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544366    2568 flags.go:64] FLAG: --reserved-memory=""
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544370    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544373    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544376    2568 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544379    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544382    2568 flags.go:64] FLAG: --runonce="false"
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544384    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544388    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544390    2568 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544396    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 16:51:02.826222 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544399    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544402    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544405    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544408    2568 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544411    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544414    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544416    2568 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544419    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544423    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544426    2568 flags.go:64] FLAG: --system-cgroups=""
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544429    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544435    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544437    2568 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544440    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544445    2568 flags.go:64] FLAG: --tls-min-version=""
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544447    2568 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544450    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544453    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544456    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544459    2568 flags.go:64] FLAG: --v="2"
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544462    2568 flags.go:64] FLAG: --version="false"
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544467    2568 flags.go:64] FLAG: --vmodule=""
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544470    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544473    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544607    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 16:51:02.827790 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544612    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 16:51:02.828952 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544615    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 16:51:02.828952 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544618    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 16:51:02.828952 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544621    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 16:51:02.828952 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544624    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 16:51:02.828952 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544626    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 16:51:02.828952 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544630    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 16:51:02.828952 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544633    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 16:51:02.828952 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544636    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 16:51:02.828952 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544638    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 16:51:02.828952 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544641    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 16:51:02.828952 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544644    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 16:51:02.828952 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544647    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 16:51:02.828952 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544649    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 16:51:02.828952 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544651    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 16:51:02.828952 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544654    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 16:51:02.828952 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544657    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 16:51:02.828952 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544661    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 16:51:02.828952 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544664    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 16:51:02.828952 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544666    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 16:51:02.829779 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544668    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 16:51:02.829779 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544671    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 16:51:02.829779 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544674    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 16:51:02.829779 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544678    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 16:51:02.829779 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544682    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 16:51:02.829779 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544686    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 16:51:02.829779 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544689    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 16:51:02.829779 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544692    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 16:51:02.829779 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544695    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 16:51:02.829779 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544698    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 16:51:02.829779 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544700    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 16:51:02.829779 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544703    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 16:51:02.829779 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544706    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 16:51:02.829779 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544709    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 16:51:02.829779 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544711    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 16:51:02.829779 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544714    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 16:51:02.829779 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544717    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 16:51:02.829779 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544719    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 16:51:02.829779 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544723    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 16:51:02.830514 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544726    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 16:51:02.830514 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544728    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 16:51:02.830514 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544731    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 16:51:02.830514 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544733    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 16:51:02.830514 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544736    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 16:51:02.830514 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544739    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 16:51:02.830514 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544741    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 16:51:02.830514 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544744    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 16:51:02.830514 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544746    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 16:51:02.830514 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544749    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 16:51:02.830514 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544753    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 16:51:02.830514 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544756    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 16:51:02.830514 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544758    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 16:51:02.830514 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544761    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 16:51:02.830514 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544763    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 16:51:02.830514 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544766    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 16:51:02.830514 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544770    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 16:51:02.830514 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544773    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 16:51:02.830514 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544776    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 16:51:02.831290 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544778    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 16:51:02.831290 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544781    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 16:51:02.831290 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544784    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 16:51:02.831290 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544787    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 16:51:02.831290 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544789    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 16:51:02.831290 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544791    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 16:51:02.831290 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544794    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 16:51:02.831290 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544797    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 16:51:02.831290 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544800    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 16:51:02.831290 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544802    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 16:51:02.831290 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544804    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 16:51:02.831290 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544807    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 16:51:02.831290 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544811    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 16:51:02.831290 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544813    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 16:51:02.831290 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544816    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 16:51:02.831290 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544819    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 16:51:02.831290 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544821    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 16:51:02.831290 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544824    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 16:51:02.831290 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544826    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 16:51:02.831290 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544829    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 16:51:02.832081 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544831    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 16:51:02.832081 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544834    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 16:51:02.832081 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544837    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 16:51:02.832081 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544841    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 16:51:02.832081 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544845    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 16:51:02.832081 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544847    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 16:51:02.832081 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544850    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 16:51:02.832081 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544852    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 16:51:02.832081 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544855    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 16:51:02.832081 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544857    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 16:51:02.832081 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544860    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 16:51:02.832081 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544863    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 16:51:02.832081 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544866    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 16:51:02.832081 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544868    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 16:51:02.832081 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544871    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 16:51:02.832081 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544873    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 16:51:02.832081 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544875    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 16:51:02.832081 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544878    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 16:51:02.832081 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544880    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 16:51:02.832081 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.544883    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 16:51:02.832866 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.544888    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 16:51:02.832866 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.553184    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 09 16:51:02.832866 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.553200    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 16:51:02.832866 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.553932    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 16:51:02.832866 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.553941    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 16:51:02.832866 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.553999    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 16:51:02.832866 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554005    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 16:51:02.832866 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554009    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 16:51:02.832866 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554012    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 16:51:02.832866 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554015    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 16:51:02.832866 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554017    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 16:51:02.832866 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554020    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 16:51:02.832866 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554023    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 16:51:02.832866 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554026    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 16:51:02.832866 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554029    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 16:51:02.833655 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554031    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 16:51:02.833655 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554034    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 16:51:02.833655 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554036    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 16:51:02.833655 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554039    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 16:51:02.833655 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554042    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 16:51:02.833655 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554044    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 16:51:02.833655 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554047    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 16:51:02.833655 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554050    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 16:51:02.833655 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554052    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 16:51:02.833655 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554054    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 16:51:02.833655 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554057    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 16:51:02.833655 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554060    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 16:51:02.833655 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554063    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 16:51:02.833655 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554066    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 16:51:02.833655 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554068    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 16:51:02.833655 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554070    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 16:51:02.833655 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554073    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 16:51:02.833655 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554076    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 16:51:02.833655 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554080    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 16:51:02.833655 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554083    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 16:51:02.834420 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554085    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 16:51:02.834420 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554088    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 16:51:02.834420 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554092    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 16:51:02.834420 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554096    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 16:51:02.834420 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554099    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 16:51:02.834420 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554102    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 16:51:02.834420 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554105    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 16:51:02.834420 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554109    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 16:51:02.834420 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554112    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 16:51:02.834420 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554115    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 16:51:02.834420 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554118    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 16:51:02.834420 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554121    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 16:51:02.834420 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554124    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 16:51:02.834420 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554127    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 16:51:02.834420 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554132    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 16:51:02.834420 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554135    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 16:51:02.834420 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554139    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 16:51:02.834420 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554141    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 16:51:02.834420 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554145    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 16:51:02.835208 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554147    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 16:51:02.835208 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554151    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 16:51:02.835208 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554155    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 16:51:02.835208 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554158    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 16:51:02.835208 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554161    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 16:51:02.835208 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554164    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 16:51:02.835208 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554166    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 16:51:02.835208 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554169    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 16:51:02.835208 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554172    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 16:51:02.835208 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554175    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 16:51:02.835208 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554178    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 16:51:02.835208 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554182    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 16:51:02.835208 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554185    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 16:51:02.835208 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554188    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 16:51:02.835208 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554190    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 16:51:02.835208 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554193    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 16:51:02.835208 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554195    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 16:51:02.835208 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554198    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 16:51:02.835208 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554201    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 16:51:02.835994 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554203    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 16:51:02.835994 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554206    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 16:51:02.835994 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554209    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 16:51:02.835994 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554211    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 16:51:02.835994 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554214    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 16:51:02.835994 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554216    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 16:51:02.835994 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554219    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 16:51:02.835994 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554221    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 16:51:02.835994 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554225    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 16:51:02.835994 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554228    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 16:51:02.835994 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554230    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 16:51:02.835994 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554233    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 16:51:02.835994 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554237    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 16:51:02.835994 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554240    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 16:51:02.835994 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554243    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 16:51:02.835994 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554246    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 16:51:02.835994 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554249    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 16:51:02.835994 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554251    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 16:51:02.835994 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554254    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 16:51:02.835994 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554256    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 16:51:02.838001 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554259    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 16:51:02.838001 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554262    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 16:51:02.838001 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554264    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 16:51:02.838001 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554267    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 16:51:02.838001 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554272    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 16:51:02.838001 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554274    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 16:51:02.838001 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554277    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 16:51:02.838001 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554279    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 16:51:02.838001 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554282    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 16:51:02.838001 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554285    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 16:51:02.838001 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554287    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 16:51:02.838001 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.554293    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 16:51:02.838001 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554404    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 16:51:02.838001 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554410    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 16:51:02.838001 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554412    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 16:51:02.838797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554415    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 16:51:02.838797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554417    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 16:51:02.838797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554420    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 16:51:02.838797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554423    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 16:51:02.838797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554425    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 16:51:02.838797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554429    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 16:51:02.838797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554433    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 16:51:02.838797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554436    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 16:51:02.838797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554438    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 16:51:02.838797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554441    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 16:51:02.838797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554444    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 16:51:02.838797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554446    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 16:51:02.838797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554449    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 16:51:02.838797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554451    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 16:51:02.838797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554454    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 16:51:02.838797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554456    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 16:51:02.838797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554459    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 16:51:02.838797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554462    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 16:51:02.838797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554465    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 16:51:02.838797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554467    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 16:51:02.841170 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554469    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 16:51:02.841170 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554473    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 16:51:02.841170 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554475    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 16:51:02.841170 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554478    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 16:51:02.841170 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554480    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 16:51:02.841170 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554483    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 16:51:02.841170 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554485    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 16:51:02.841170 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554488    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 16:51:02.841170 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554491    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 16:51:02.841170 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554493    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 16:51:02.841170 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554496    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 16:51:02.841170 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554498    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 16:51:02.841170 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554501    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 16:51:02.841170 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554504    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 16:51:02.841170 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554508    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 16:51:02.841170 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554511    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 16:51:02.841170 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554513    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 16:51:02.841170 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554516    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 16:51:02.841170 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554519    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 16:51:02.841968 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554522    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 16:51:02.841968 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554524    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 16:51:02.841968 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554527    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 16:51:02.841968 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554530    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 16:51:02.841968 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554532    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 16:51:02.841968 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554535    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 16:51:02.841968 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554538    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 16:51:02.841968 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554540    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 16:51:02.841968 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554543    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 16:51:02.841968 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554547    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 16:51:02.841968 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554551    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 16:51:02.841968 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554554    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 16:51:02.841968 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554557    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 16:51:02.841968 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554560    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 16:51:02.841968 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554564    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 16:51:02.841968 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554567    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 16:51:02.841968 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554570    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 16:51:02.841968 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554572    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 16:51:02.841968 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554575    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 16:51:02.937260 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554577    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 16:51:02.937260 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554580    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 16:51:02.937260 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554583    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 16:51:02.937260 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554599    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 16:51:02.937260 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554603    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 16:51:02.937260 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554605    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 16:51:02.937260 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554608    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 16:51:02.937260 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554610    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 16:51:02.937260 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554613    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 16:51:02.937260 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554615    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 16:51:02.937260 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554618    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 16:51:02.937260 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554621    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 16:51:02.937260 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554626    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 16:51:02.937260 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554628    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 16:51:02.937260 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554631    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 16:51:02.937260 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554633    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 16:51:02.937260 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554636    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 16:51:02.937260 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554639    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 16:51:02.937260 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554642    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 16:51:02.937260 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554645    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 16:51:02.938061 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554648    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 16:51:02.938061 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554650    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 16:51:02.938061 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554653    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 16:51:02.938061 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554655    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 16:51:02.938061 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554658    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 16:51:02.938061 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554661    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 16:51:02.938061 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554663    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 16:51:02.938061 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554667    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 16:51:02.938061 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554670    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 16:51:02.938061 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554672    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 16:51:02.938061 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554675    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 16:51:02.938061 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554677    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 16:51:02.938061 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554680    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 16:51:02.938061 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554682    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 16:51:02.938061 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554685    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 16:51:02.938061 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554687    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 16:51:02.938061 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554690    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 16:51:02.938061 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:01.554692    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 16:51:02.938826 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.554698    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 16:51:02.938826 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.554812    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 16:51:02.938826 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.558494    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 16:51:02.938826 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.559802    2568 server.go:1019] "Starting client certificate rotation"
Jul 09 16:51:02.938826 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.559895    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 16:51:02.938826 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.559932    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 16:51:02.938826 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.562163    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 16:51:02.938826 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.564812    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 16:51:02.938826 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.572812    2568 log.go:25] "Validated CRI v1 runtime API"
Jul 09 16:51:02.938826 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.575726    2568 log.go:25] "Validated CRI v1 image API"
Jul 09 16:51:02.938826 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.576572    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 16:51:02.938826 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.579207    2568 fs.go:135] Filesystem UUIDs: map[18dd3a28-02b2-4ab6-ac46-6b35721a5b91:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cba25a06-2f36-445e-b4e6-51ac03f0ee3d:/dev/nvme0n1p4]
Jul 09 16:51:02.939623 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.579222    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 16:51:02.939985 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.585775    2568 manager.go:216] Machine: {Timestamp:2026-07-09 16:51:01.58357515 +0000 UTC m=+0.336759623 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102201 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec212a56e32c91006c1e4f5c048ea89b SystemUUID:ec212a56-e32c-9100-6c1e-4f5c048ea89b BootID:215d5fce-a586-4dd5-8e93-e9346e84cb4f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5c:fe:fa:41:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5c:fe:fa:41:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:0c:9f:a0:c6:66 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 16:51:02.939985 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.585898    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 16:51:02.939985 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.585911    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 16:51:02.939985 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.586030    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 16:51:02.939985 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.588905    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 16:51:02.939985 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.588933    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-229.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 16:51:02.939985 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.589560    2568 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.589569    2568 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.589577    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.590596    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.592478    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.595092    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.595197    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.595233    2568 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.595246    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.595281    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.595300    2568 kubelet.go:398] "Adding apiserver pod source"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.595309    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.595879    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.595899    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.600416    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.602391    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.602429    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.602620    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.602638    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.602647    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.602655    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.602666    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.602673    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.603148    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.603157    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.603167    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.603174    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.603186    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.603198    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.604022    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.604033    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.606061    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-229.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:01.606154    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-229.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:01.606301    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.607819    2568 server.go:1268] "Started kubelet"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.607885    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.607958    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.608018    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.609204    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m2m2n"
Jul 09 16:51:02.941541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.609744    2568 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:01.614268    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.618298    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.618480    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m2m2n"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:01.621104    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-229.ec2.internal.18c0ad2d16e26f46  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-229.ec2.internal,UID:ip-10-0-140-229.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-229.ec2.internal,},FirstTimestamp:2026-07-09 16:51:01.607788358 +0000 UTC m=+0.360972830,LastTimestamp:2026-07-09 16:51:01.607788358 +0000 UTC m=+0.360972830,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-229.ec2.internal,}"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.622642    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.622680    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:01.622741    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-229.ec2.internal\" not found"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.623302    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.623573    2568 factory.go:55] Registering systemd factory
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.623632    2568 factory.go:223] Registration of the systemd container factory successfully
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.623751    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.623764    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.623896    2568 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.623905    2568 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.623942    2568 factory.go:153] Registering CRI-O factory
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.623955    2568 factory.go:223] Registration of the crio container factory successfully
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.624000    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.624023    2568 factory.go:103] Registering Raw factory
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.624037    2568 manager.go:1196] Started watching for new ooms in manager
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.624452    2568 manager.go:349] Starting recovery of all containers
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.631038    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.635162    2568 manager.go:354] Recovery completed
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:01.636381    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:02.712250    2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-229.ec2.internal\" not found" node="ip-10-0-140-229.ec2.internal"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:02.715007    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:02.716843    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:02.716870    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:02.716884    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-229.ec2.internal" event="NodeHasSufficientPID"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:02.717322    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:02.717333    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:02.717350    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:02.717379    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:02.718036    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:02.718058    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 16:51:02.943081 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:02.718069    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-229.ec2.internal" event="NodeHasSufficientPID"
Jul 09 16:51:02.944282 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:02.718514    2568 policy_none.go:49] "None policy: Start"
Jul 09 16:51:02.944282 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:02.718527    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 16:51:02.944282 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:02.718536    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 16:51:02.944282 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:02.719556    2568 policy_none.go:47] "Start"
Jul 09 16:51:02.944282 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:02.795627    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-229.ec2.internal\" not found"
Jul 09 16:51:02.944282 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:02.895906    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-229.ec2.internal\" not found"
Jul 09 16:51:03.052662 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:02.996210    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-229.ec2.internal\" not found"
Jul 09 16:51:03.169155 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:03.096450    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-229.ec2.internal\" not found"
Jul 09 16:51:03.286509 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:03.197193    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-229.ec2.internal\" not found"
Jul 09 16:51:03.299016 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:03.297520    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-229.ec2.internal\" not found"
Jul 09 16:51:03.407807 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:03.397880    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-229.ec2.internal\" not found"
Jul 09 16:51:03.526111 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:03.498259    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-229.ec2.internal\" not found"
Jul 09 16:51:03.634627 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:03.598603    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-229.ec2.internal\" not found"
Jul 09 16:51:03.634627 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.631801    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 16:51:03.634627 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.631990    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 16:51:03.738239 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.695134    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 16:46:02 +0000 UTC" deadline="2028-03-31 16:02:08.834297954 +0000 UTC"
Jul 09 16:51:03.738239 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.695167    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15143h11m5.139134179s"
Jul 09 16:51:03.738239 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:03.699339    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-229.ec2.internal\" not found"
Jul 09 16:51:03.790840 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.790823    2568 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-140-229.ec2.internal" not found
Jul 09 16:51:03.799948 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:03.799927    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-229.ec2.internal\" not found"
Jul 09 16:51:03.800048 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.800030    2568 manager.go:337] "Starting Device Plugin manager"
Jul 09 16:51:03.800107 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:03.800060    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 16:51:03.800107 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.800070    2568 server.go:87] "Starting device plugin registration server"
Jul 09 16:51:03.800346 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.800325    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 16:51:03.800459 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.800340    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 16:51:03.800459 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.800438    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 16:51:03.800542 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.800498    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 16:51:03.800542 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.800504    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 16:51:03.801150 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:03.801121    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 16:51:03.801234 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:03.801175    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-229.ec2.internal\" not found"
Jul 09 16:51:03.807447 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.807424    2568 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-140-229.ec2.internal" not found
Jul 09 16:51:03.865008 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.864982    2568 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-140-229.ec2.internal" not found
Jul 09 16:51:03.901423 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.901399    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 16:51:03.903662 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.903641    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 16:51:03.903760 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.903672    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 16:51:03.903760 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.903684    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-229.ec2.internal" event="NodeHasSufficientPID"
Jul 09 16:51:03.903760 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.903709    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-229.ec2.internal"
Jul 09 16:51:03.912535 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.912512    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-229.ec2.internal"
Jul 09 16:51:03.912597 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:03.912535    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-229.ec2.internal\": node \"ip-10-0-140-229.ec2.internal\" not found"
Jul 09 16:51:03.927167 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:03.927145    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-229.ec2.internal\" not found"
Jul 09 16:51:03.932224 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.932207    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 16:51:03.932303 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.932244    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 16:51:03.932303 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.932263    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 16:51:03.932303 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:03.932292    2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 16:51:03.934682 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.934662    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 16:51:03.967949 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.967914    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 16:51:03.985714 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:03.985695    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 16:51:04.032950 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.032924    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-229.ec2.internal"]
Jul 09 16:51:04.035326 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.035310    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal"
Jul 09 16:51:04.037338 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.037287    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-229.ec2.internal"
Jul 09 16:51:04.058005 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.057987    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal"
Jul 09 16:51:04.062241 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.062225    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-229.ec2.internal"
Jul 09 16:51:04.078244 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.078225    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 16:51:04.078425 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.078411    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 16:51:04.102756 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.102720    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/244d0f9322256235dc0c3747942f9000-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal\" (UID: \"244d0f9322256235dc0c3747942f9000\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal"
Jul 09 16:51:04.102863 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.102761    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/244d0f9322256235dc0c3747942f9000-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal\" (UID: \"244d0f9322256235dc0c3747942f9000\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal"
Jul 09 16:51:04.102863 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.102793    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/641e9bded5c7fc9e1b94316361d7f097-config\") pod \"kube-apiserver-proxy-ip-10-0-140-229.ec2.internal\" (UID: \"641e9bded5c7fc9e1b94316361d7f097\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-229.ec2.internal"
Jul 09 16:51:04.203305 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.203266    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/244d0f9322256235dc0c3747942f9000-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal\" (UID: \"244d0f9322256235dc0c3747942f9000\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal"
Jul 09 16:51:04.203305 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.203295    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/244d0f9322256235dc0c3747942f9000-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal\" (UID: \"244d0f9322256235dc0c3747942f9000\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal"
Jul 09 16:51:04.203532 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.203337    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/641e9bded5c7fc9e1b94316361d7f097-config\") pod \"kube-apiserver-proxy-ip-10-0-140-229.ec2.internal\" (UID: \"641e9bded5c7fc9e1b94316361d7f097\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-229.ec2.internal"
Jul 09 16:51:04.203532 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.203369    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/244d0f9322256235dc0c3747942f9000-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal\" (UID: \"244d0f9322256235dc0c3747942f9000\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal"
Jul 09 16:51:04.203532 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.203395    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/244d0f9322256235dc0c3747942f9000-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal\" (UID: \"244d0f9322256235dc0c3747942f9000\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal"
Jul 09 16:51:04.203532 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.203413    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/641e9bded5c7fc9e1b94316361d7f097-config\") pod \"kube-apiserver-proxy-ip-10-0-140-229.ec2.internal\" (UID: \"641e9bded5c7fc9e1b94316361d7f097\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-229.ec2.internal"
Jul 09 16:51:04.381709 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.381677    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal"
Jul 09 16:51:04.382780 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.382762    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-229.ec2.internal"
Jul 09 16:51:04.669887 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.669795    2568 apiserver.go:52] "Watching apiserver"
Jul 09 16:51:04.677324 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.677299    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 16:51:04.677802 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.677774    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-2ng88","kube-system/global-pull-secret-syncer-glkgj","kube-system/konnectivity-agent-mwcv8","openshift-cluster-node-tuning-operator/tuned-dztdq","openshift-dns/node-resolver-dx97p","openshift-image-registry/node-ca-kcrrm","openshift-multus/multus-additional-cni-plugins-vmfkk","openshift-multus/network-metrics-daemon-9bf8d","openshift-network-diagnostics/network-check-target-vwcc7","kube-system/kube-apiserver-proxy-ip-10-0-140-229.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal","openshift-multus/multus-qn8mx","openshift-network-operator/iptables-alerter-xpczp"]
Jul 09 16:51:04.680271 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.680248    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.682484 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.682463    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.683406 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.683384    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 16:51:04.683406 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.683399    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 16:51:04.683586 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.683563    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ctw2t\""
Jul 09 16:51:04.683662 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.683643    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 16:51:04.683868 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.683848    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 16:51:04.683943 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.683902    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 16:51:04.685282 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.684565    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 16:51:04.685282 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.684784    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m52f8\""
Jul 09 16:51:04.685282 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.685018    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 16:51:04.685282 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.685029    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 16:51:04.685571 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.685547    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mwcv8"
Jul 09 16:51:04.687954 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.687938    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 16:51:04.688034 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.688019    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p9d9q\""
Jul 09 16:51:04.688140 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.688123    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 16:51:04.688201 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.688177    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.690133 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.690114    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-std9r\""
Jul 09 16:51:04.690228 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.690167    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 16:51:04.690292 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.690247    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 16:51:04.690292 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.690258    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dx97p"
Jul 09 16:51:04.692341 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.692325    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kcrrm"
Jul 09 16:51:04.692530 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.692511    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 16:51:04.692713 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.692698    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v4lql\""
Jul 09 16:51:04.692783 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.692770    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 16:51:04.694431 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.694414    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zgc9k\""
Jul 09 16:51:04.694584 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.694535    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:04.694653 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:04.694616    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:04.694912 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.694895    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 16:51:04.694976 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.694941    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 16:51:04.694976 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.694948    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 16:51:04.696290 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.696275    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 16:51:04.696703 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.696688    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xpczp"
Jul 09 16:51:04.698847 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.698832    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:04.698905 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.698850    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 16:51:04.698905 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.698863    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bhc62\""
Jul 09 16:51:04.698977 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.698837    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 16:51:04.698977 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.698840    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 16:51:04.698977 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:04.698931    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:04.701249 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.701235    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.703420 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.703404    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:04.703510 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:04.703465    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:04.703917 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.703852    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 16:51:04.704070 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.703855    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 16:51:04.704070 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.703944    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 16:51:04.704278 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.704216    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 16:51:04.704371 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.704287    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 16:51:04.704431 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.704381    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 16:51:04.704431 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.704416    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mj768\""
Jul 09 16:51:04.704653 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.704639    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.704714 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.704662    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9257dfa-9fdc-40ec-a101-0ee095b14be8-registration-dir\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.704714 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.704678    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9257dfa-9fdc-40ec-a101-0ee095b14be8-sys-fs\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.704714 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.704693    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bed3615c-b651-41bd-9229-90462d4dddea-hosts-file\") pod \"node-resolver-dx97p\" (UID: \"bed3615c-b651-41bd-9229-90462d4dddea\") " pod="openshift-dns/node-resolver-dx97p"
Jul 09 16:51:04.704714 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.704708    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bed3615c-b651-41bd-9229-90462d4dddea-tmp-dir\") pod \"node-resolver-dx97p\" (UID: \"bed3615c-b651-41bd-9229-90462d4dddea\") " pod="openshift-dns/node-resolver-dx97p"
Jul 09 16:51:04.704924 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.704723    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8l5n\" (UniqueName: \"kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n\") pod \"network-check-target-vwcc7\" (UID: \"f4928566-2544-41f6-805a-f6ecd54be679\") " pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:04.704924 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.704762    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/787d7f86-db4b-4eac-90bf-c79c0fc629ca-host\") pod \"node-ca-kcrrm\" (UID: \"787d7f86-db4b-4eac-90bf-c79c0fc629ca\") " pod="openshift-image-registry/node-ca-kcrrm"
Jul 09 16:51:04.704924 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.704794    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.704924 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.704820    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-modprobe-d\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.704924 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.704844    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-host\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.704924 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.704865    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/787d7f86-db4b-4eac-90bf-c79c0fc629ca-serviceca\") pod \"node-ca-kcrrm\" (UID: \"787d7f86-db4b-4eac-90bf-c79c0fc629ca\") " pod="openshift-image-registry/node-ca-kcrrm"
Jul 09 16:51:04.704924 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.704890    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdkzn\" (UniqueName: \"kubernetes.io/projected/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-kube-api-access-bdkzn\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.704924 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.704914    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9257dfa-9fdc-40ec-a101-0ee095b14be8-device-dir\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.705273 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.704939    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xgh5\" (UniqueName: \"kubernetes.io/projected/d177bcce-d658-44eb-8737-4c122a657f7f-kube-api-access-5xgh5\") pod \"iptables-alerter-xpczp\" (UID: \"d177bcce-d658-44eb-8737-4c122a657f7f\") " pod="openshift-network-operator/iptables-alerter-xpczp"
Jul 09 16:51:04.705273 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.704967    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-kubernetes\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.705273 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.704989    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-sysctl-conf\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.705273 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705011    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-systemd\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.705273 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705049    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-cnibin\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.705273 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705073    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-var-lib-kubelet\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.705273 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705095    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvkvk\" (UniqueName: \"kubernetes.io/projected/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-kube-api-access-rvkvk\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.705273 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705126    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-system-cni-dir\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.705273 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705146    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9257dfa-9fdc-40ec-a101-0ee095b14be8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.705273 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705162    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5tkj\" (UniqueName: \"kubernetes.io/projected/bed3615c-b651-41bd-9229-90462d4dddea-kube-api-access-k5tkj\") pod \"node-resolver-dx97p\" (UID: \"bed3615c-b651-41bd-9229-90462d4dddea\") " pod="openshift-dns/node-resolver-dx97p"
Jul 09 16:51:04.705273 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705181    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d177bcce-d658-44eb-8737-4c122a657f7f-iptables-alerter-script\") pod \"iptables-alerter-xpczp\" (UID: \"d177bcce-d658-44eb-8737-4c122a657f7f\") " pod="openshift-network-operator/iptables-alerter-xpczp"
Jul 09 16:51:04.705273 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705203    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3d5cd96-7128-42db-963b-e62e14fc1dac-konnectivity-ca\") pod \"konnectivity-agent-mwcv8\" (UID: \"a3d5cd96-7128-42db-963b-e62e14fc1dac\") " pod="kube-system/konnectivity-agent-mwcv8"
Jul 09 16:51:04.705273 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705222    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-sys\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.705811 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705242    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb2s8\" (UniqueName: \"kubernetes.io/projected/787d7f86-db4b-4eac-90bf-c79c0fc629ca-kube-api-access-cb2s8\") pod \"node-ca-kcrrm\" (UID: \"787d7f86-db4b-4eac-90bf-c79c0fc629ca\") " pod="openshift-image-registry/node-ca-kcrrm"
Jul 09 16:51:04.705811 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705258    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-os-release\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.705811 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705273    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.705811 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705294    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9257dfa-9fdc-40ec-a101-0ee095b14be8-etc-selinux\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.705811 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705309    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3d5cd96-7128-42db-963b-e62e14fc1dac-agent-certs\") pod \"konnectivity-agent-mwcv8\" (UID: \"a3d5cd96-7128-42db-963b-e62e14fc1dac\") " pod="kube-system/konnectivity-agent-mwcv8"
Jul 09 16:51:04.705811 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705327    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-sysconfig\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.705811 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705350    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-run\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.705811 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705383    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-lib-modules\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.705811 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705421    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-tuned\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.705811 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705447    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.705811 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705469    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9257dfa-9fdc-40ec-a101-0ee095b14be8-socket-dir\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.705811 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705484    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgmgf\" (UniqueName: \"kubernetes.io/projected/a9257dfa-9fdc-40ec-a101-0ee095b14be8-kube-api-access-cgmgf\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.705811 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705500    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d177bcce-d658-44eb-8737-4c122a657f7f-host-slash\") pod \"iptables-alerter-xpczp\" (UID: \"d177bcce-d658-44eb-8737-4c122a657f7f\") " pod="openshift-network-operator/iptables-alerter-xpczp"
Jul 09 16:51:04.706198 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705521    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-sysctl-d\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.706198 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705534    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-tmp\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.706198 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.705541    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.707468 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.707453    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 16:51:04.707524 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.707457    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4wjld\""
Jul 09 16:51:04.710713 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.710697    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 16:51:04.730775 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.730756    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-t7wws"
Jul 09 16:51:04.738812 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.738790    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-t7wws"
Jul 09 16:51:04.797655 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.797637    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 16:51:04.806325 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806305    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.806436 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806336    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9257dfa-9fdc-40ec-a101-0ee095b14be8-sys-fs\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.806436 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806375    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bed3615c-b651-41bd-9229-90462d4dddea-hosts-file\") pod \"node-resolver-dx97p\" (UID: \"bed3615c-b651-41bd-9229-90462d4dddea\") " pod="openshift-dns/node-resolver-dx97p"
Jul 09 16:51:04.806436 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806398    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bed3615c-b651-41bd-9229-90462d4dddea-tmp-dir\") pod \"node-resolver-dx97p\" (UID: \"bed3615c-b651-41bd-9229-90462d4dddea\") " pod="openshift-dns/node-resolver-dx97p"
Jul 09 16:51:04.806436 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806423    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-multus-socket-dir-parent\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.806614 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806448    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54ed8699-4487-4246-9e22-3d15bd9908ca-ovnkube-config\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.806614 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806488    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw6wv\" (UniqueName: \"kubernetes.io/projected/ab2233de-a681-4b2a-a1f2-5e1481714409-kube-api-access-zw6wv\") pod \"network-metrics-daemon-9bf8d\" (UID: \"ab2233de-a681-4b2a-a1f2-5e1481714409\") " pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:04.806614 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806508    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9257dfa-9fdc-40ec-a101-0ee095b14be8-sys-fs\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.806614 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806532    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-systemd-units\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.806614 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806505    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bed3615c-b651-41bd-9229-90462d4dddea-hosts-file\") pod \"node-resolver-dx97p\" (UID: \"bed3615c-b651-41bd-9229-90462d4dddea\") " pod="openshift-dns/node-resolver-dx97p"
Jul 09 16:51:04.806614 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806576    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-var-lib-openvswitch\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.806614 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806608    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9257dfa-9fdc-40ec-a101-0ee095b14be8-device-dir\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.806895 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806642    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xgh5\" (UniqueName: \"kubernetes.io/projected/d177bcce-d658-44eb-8737-4c122a657f7f-kube-api-access-5xgh5\") pod \"iptables-alerter-xpczp\" (UID: \"d177bcce-d658-44eb-8737-4c122a657f7f\") " pod="openshift-network-operator/iptables-alerter-xpczp"
Jul 09 16:51:04.806895 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806669    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-kubernetes\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.806895 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806671    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9257dfa-9fdc-40ec-a101-0ee095b14be8-device-dir\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.806895 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806693    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-systemd\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.806895 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806717    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-run-ovn-kubernetes\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.806895 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806729    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-kubernetes\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.806895 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806742    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54ed8699-4487-4246-9e22-3d15bd9908ca-ovnkube-script-lib\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.806895 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806767    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs\") pod \"network-metrics-daemon-9bf8d\" (UID: \"ab2233de-a681-4b2a-a1f2-5e1481714409\") " pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:04.806895 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806766    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-systemd\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.806895 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806791    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-host-var-lib-kubelet\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.806895 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806795    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bed3615c-b651-41bd-9229-90462d4dddea-tmp-dir\") pod \"node-resolver-dx97p\" (UID: \"bed3615c-b651-41bd-9229-90462d4dddea\") " pod="openshift-dns/node-resolver-dx97p"
Jul 09 16:51:04.806895 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806815    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0d611954-0ce8-4bcb-8173-237304fdd570-multus-daemon-config\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.806895 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806836    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-kubelet\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.806895 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806858    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-run-netns\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.807297 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806873    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-log-socket\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.807297 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806909    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-cni-netd\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.807297 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806915    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.807297 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806964    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-system-cni-dir\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.807297 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.806984    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9257dfa-9fdc-40ec-a101-0ee095b14be8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.807297 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807000    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-host-var-lib-cni-multus\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.807297 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807028    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9257dfa-9fdc-40ec-a101-0ee095b14be8-etc-selinux\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.807297 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807058    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-sysconfig\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.807297 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807060    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9257dfa-9fdc-40ec-a101-0ee095b14be8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.807297 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807092    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-sysconfig\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.807297 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807104    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-run\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.807297 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807110    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9257dfa-9fdc-40ec-a101-0ee095b14be8-etc-selinux\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.807297 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807131    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-tuned\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.807297 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807137    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-system-cni-dir\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.807883 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807159    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret\") pod \"global-pull-secret-syncer-glkgj\" (UID: \"6a171ab4-4ad7-4670-8baf-99e5ba09c225\") " pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:04.807883 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807186    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-host-run-netns\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.807883 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807212    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.807883 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807228    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-run\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.807883 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807237    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d177bcce-d658-44eb-8737-4c122a657f7f-host-slash\") pod \"iptables-alerter-xpczp\" (UID: \"d177bcce-d658-44eb-8737-4c122a657f7f\") " pod="openshift-network-operator/iptables-alerter-xpczp"
Jul 09 16:51:04.807883 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807265    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-sysctl-d\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.807883 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807335    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-sysctl-d\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.807883 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807336    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfxxs\" (UniqueName: \"kubernetes.io/projected/54ed8699-4487-4246-9e22-3d15bd9908ca-kube-api-access-xfxxs\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.807883 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807368    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d177bcce-d658-44eb-8737-4c122a657f7f-host-slash\") pod \"iptables-alerter-xpczp\" (UID: \"d177bcce-d658-44eb-8737-4c122a657f7f\") " pod="openshift-network-operator/iptables-alerter-xpczp"
Jul 09 16:51:04.807883 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807379    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a171ab4-4ad7-4670-8baf-99e5ba09c225-kubelet-config\") pod \"global-pull-secret-syncer-glkgj\" (UID: \"6a171ab4-4ad7-4670-8baf-99e5ba09c225\") " pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:04.807883 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807403    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9257dfa-9fdc-40ec-a101-0ee095b14be8-registration-dir\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.807883 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807409    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 16:51:04.807883 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807427    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8l5n\" (UniqueName: \"kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n\") pod \"network-check-target-vwcc7\" (UID: \"f4928566-2544-41f6-805a-f6ecd54be679\") " pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:04.807883 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807443    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/787d7f86-db4b-4eac-90bf-c79c0fc629ca-host\") pod \"node-ca-kcrrm\" (UID: \"787d7f86-db4b-4eac-90bf-c79c0fc629ca\") " pod="openshift-image-registry/node-ca-kcrrm"
Jul 09 16:51:04.808523 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807459    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-etc-kubernetes\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.808523 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807460    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.808523 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807488    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9257dfa-9fdc-40ec-a101-0ee095b14be8-registration-dir\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.808523 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807509    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/787d7f86-db4b-4eac-90bf-c79c0fc629ca-host\") pod \"node-ca-kcrrm\" (UID: \"787d7f86-db4b-4eac-90bf-c79c0fc629ca\") " pod="openshift-image-registry/node-ca-kcrrm"
Jul 09 16:51:04.808523 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807572    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-run-systemd\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.808523 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807604    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54ed8699-4487-4246-9e22-3d15bd9908ca-env-overrides\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.808523 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807628    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.808523 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807659    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-modprobe-d\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.808523 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807682    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-host\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.808523 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807704    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/787d7f86-db4b-4eac-90bf-c79c0fc629ca-serviceca\") pod \"node-ca-kcrrm\" (UID: \"787d7f86-db4b-4eac-90bf-c79c0fc629ca\") " pod="openshift-image-registry/node-ca-kcrrm"
Jul 09 16:51:04.808523 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807728    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-host-var-lib-cni-bin\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.808523 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807754    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdkzn\" (UniqueName: \"kubernetes.io/projected/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-kube-api-access-bdkzn\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.808523 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807770    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-modprobe-d\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.808523 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807780    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-sysctl-conf\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.809208 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807760    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-host\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.809208 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807807    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-host-run-multus-certs\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.809208 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807853    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-slash\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.809208 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807879    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-cni-bin\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.809208 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807902    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54ed8699-4487-4246-9e22-3d15bd9908ca-ovn-node-metrics-cert\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.809208 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807928    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-cnibin\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.809208 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807938    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-sysctl-conf\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.809208 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807951    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-var-lib-kubelet\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.809208 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.807975    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvkvk\" (UniqueName: \"kubernetes.io/projected/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-kube-api-access-rvkvk\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.809208 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808003    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-run-ovn\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.809208 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808030    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.809208 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808058    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5tkj\" (UniqueName: \"kubernetes.io/projected/bed3615c-b651-41bd-9229-90462d4dddea-kube-api-access-k5tkj\") pod \"node-resolver-dx97p\" (UID: \"bed3615c-b651-41bd-9229-90462d4dddea\") " pod="openshift-dns/node-resolver-dx97p"
Jul 09 16:51:04.809208 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808060    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-var-lib-kubelet\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.809208 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808096    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.809914 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808105    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d177bcce-d658-44eb-8737-4c122a657f7f-iptables-alerter-script\") pod \"iptables-alerter-xpczp\" (UID: \"d177bcce-d658-44eb-8737-4c122a657f7f\") " pod="openshift-network-operator/iptables-alerter-xpczp"
Jul 09 16:51:04.809914 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808161    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3d5cd96-7128-42db-963b-e62e14fc1dac-konnectivity-ca\") pod \"konnectivity-agent-mwcv8\" (UID: \"a3d5cd96-7128-42db-963b-e62e14fc1dac\") " pod="kube-system/konnectivity-agent-mwcv8"
Jul 09 16:51:04.809914 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808096    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-cnibin\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.809914 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808194    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/787d7f86-db4b-4eac-90bf-c79c0fc629ca-serviceca\") pod \"node-ca-kcrrm\" (UID: \"787d7f86-db4b-4eac-90bf-c79c0fc629ca\") " pod="openshift-image-registry/node-ca-kcrrm"
Jul 09 16:51:04.809914 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808185    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-sys\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.809914 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808223    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-sys\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.809914 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808229    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb2s8\" (UniqueName: \"kubernetes.io/projected/787d7f86-db4b-4eac-90bf-c79c0fc629ca-kube-api-access-cb2s8\") pod \"node-ca-kcrrm\" (UID: \"787d7f86-db4b-4eac-90bf-c79c0fc629ca\") " pod="openshift-image-registry/node-ca-kcrrm"
Jul 09 16:51:04.809914 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808321    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-cnibin\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.809914 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808376    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-multus-conf-dir\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.809914 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808414    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-os-release\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.809914 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808443    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d611954-0ce8-4bcb-8173-237304fdd570-cni-binary-copy\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.809914 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808463    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-os-release\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.809914 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808484    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.809914 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808508    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3d5cd96-7128-42db-963b-e62e14fc1dac-agent-certs\") pod \"konnectivity-agent-mwcv8\" (UID: \"a3d5cd96-7128-42db-963b-e62e14fc1dac\") " pod="kube-system/konnectivity-agent-mwcv8"
Jul 09 16:51:04.809914 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808533    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-lib-modules\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.810678 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808538    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-os-release\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.810678 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808559    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-hostroot\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.810678 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808582    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h9fg\" (UniqueName: \"kubernetes.io/projected/0d611954-0ce8-4bcb-8173-237304fdd570-kube-api-access-2h9fg\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.810678 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808606    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9257dfa-9fdc-40ec-a101-0ee095b14be8-socket-dir\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.810678 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808630    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgmgf\" (UniqueName: \"kubernetes.io/projected/a9257dfa-9fdc-40ec-a101-0ee095b14be8-kube-api-access-cgmgf\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.810678 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808654    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-multus-cni-dir\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.810678 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808679    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-etc-openvswitch\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.810678 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808702    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-node-log\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.810678 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808722    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d177bcce-d658-44eb-8737-4c122a657f7f-iptables-alerter-script\") pod \"iptables-alerter-xpczp\" (UID: \"d177bcce-d658-44eb-8737-4c122a657f7f\") " pod="openshift-network-operator/iptables-alerter-xpczp"
Jul 09 16:51:04.810678 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808730    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-tmp\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.810678 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808753    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a171ab4-4ad7-4670-8baf-99e5ba09c225-dbus\") pod \"global-pull-secret-syncer-glkgj\" (UID: \"6a171ab4-4ad7-4670-8baf-99e5ba09c225\") " pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:04.810678 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808768    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3d5cd96-7128-42db-963b-e62e14fc1dac-konnectivity-ca\") pod \"konnectivity-agent-mwcv8\" (UID: \"a3d5cd96-7128-42db-963b-e62e14fc1dac\") " pod="kube-system/konnectivity-agent-mwcv8"
Jul 09 16:51:04.810678 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808776    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-system-cni-dir\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.810678 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808801    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-host-run-k8s-cni-cncf-io\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.811177 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808827    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-run-openvswitch\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.811177 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.808952    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.811177 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.809025    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9257dfa-9fdc-40ec-a101-0ee095b14be8-socket-dir\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.811177 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.809030    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-lib-modules\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.811177 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.811044    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-tmp\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.811177 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.811084    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-etc-tuned\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.811344 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.811282    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3d5cd96-7128-42db-963b-e62e14fc1dac-agent-certs\") pod \"konnectivity-agent-mwcv8\" (UID: \"a3d5cd96-7128-42db-963b-e62e14fc1dac\") " pod="kube-system/konnectivity-agent-mwcv8"
Jul 09 16:51:04.818150 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:04.818131    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 16:51:04.818150 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:04.818154    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 16:51:04.818323 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:04.818166    2568 projected.go:196] Error preparing data for projected volume kube-api-access-q8l5n for pod openshift-network-diagnostics/network-check-target-vwcc7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:51:04.818323 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:04.818243    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n podName:f4928566-2544-41f6-805a-f6ecd54be679 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:05.318209511 +0000 UTC m=+2.998625402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q8l5n" (UniqueName: "kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n") pod "network-check-target-vwcc7" (UID: "f4928566-2544-41f6-805a-f6ecd54be679") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:51:04.819449 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.819393    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xgh5\" (UniqueName: \"kubernetes.io/projected/d177bcce-d658-44eb-8737-4c122a657f7f-kube-api-access-5xgh5\") pod \"iptables-alerter-xpczp\" (UID: \"d177bcce-d658-44eb-8737-4c122a657f7f\") " pod="openshift-network-operator/iptables-alerter-xpczp"
Jul 09 16:51:04.820443 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.820423    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvkvk\" (UniqueName: \"kubernetes.io/projected/6b6ee026-c8d9-4d03-8b68-dcae63ba9e93-kube-api-access-rvkvk\") pod \"tuned-dztdq\" (UID: \"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93\") " pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:04.820868 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.820846    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgmgf\" (UniqueName: \"kubernetes.io/projected/a9257dfa-9fdc-40ec-a101-0ee095b14be8-kube-api-access-cgmgf\") pod \"aws-ebs-csi-driver-node-prds7\" (UID: \"a9257dfa-9fdc-40ec-a101-0ee095b14be8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:04.821058 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.821040    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5tkj\" (UniqueName: \"kubernetes.io/projected/bed3615c-b651-41bd-9229-90462d4dddea-kube-api-access-k5tkj\") pod \"node-resolver-dx97p\" (UID: \"bed3615c-b651-41bd-9229-90462d4dddea\") " pod="openshift-dns/node-resolver-dx97p"
Jul 09 16:51:04.821142 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.821042    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdkzn\" (UniqueName: \"kubernetes.io/projected/3e9cd237-d0aa-47e0-8034-af5d77b0d27a-kube-api-access-bdkzn\") pod \"multus-additional-cni-plugins-vmfkk\" (UID: \"3e9cd237-d0aa-47e0-8034-af5d77b0d27a\") " pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:04.822262 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.821943    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb2s8\" (UniqueName: \"kubernetes.io/projected/787d7f86-db4b-4eac-90bf-c79c0fc629ca-kube-api-access-cb2s8\") pod \"node-ca-kcrrm\" (UID: \"787d7f86-db4b-4eac-90bf-c79c0fc629ca\") " pod="openshift-image-registry/node-ca-kcrrm"
Jul 09 16:51:04.909352 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909297    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-host-var-lib-cni-multus\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.909535 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909372    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret\") pod \"global-pull-secret-syncer-glkgj\" (UID: \"6a171ab4-4ad7-4670-8baf-99e5ba09c225\") " pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:04.909535 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909397    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-host-run-netns\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.909535 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909423    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfxxs\" (UniqueName: \"kubernetes.io/projected/54ed8699-4487-4246-9e22-3d15bd9908ca-kube-api-access-xfxxs\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.909535 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909444    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a171ab4-4ad7-4670-8baf-99e5ba09c225-kubelet-config\") pod \"global-pull-secret-syncer-glkgj\" (UID: \"6a171ab4-4ad7-4670-8baf-99e5ba09c225\") " pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:04.909535 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909482    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-etc-kubernetes\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.909535 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909503    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-run-systemd\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.909535 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909514    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-etc-kubernetes\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.909868 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:04.909539    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 16:51:04.909868 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909555    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a171ab4-4ad7-4670-8baf-99e5ba09c225-kubelet-config\") pod \"global-pull-secret-syncer-glkgj\" (UID: \"6a171ab4-4ad7-4670-8baf-99e5ba09c225\") " pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:04.909868 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909574    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-run-systemd\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.909868 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909480    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-host-run-netns\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.909868 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909440    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-host-var-lib-cni-multus\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.909868 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909524    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54ed8699-4487-4246-9e22-3d15bd9908ca-env-overrides\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.909868 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:04.909623    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret podName:6a171ab4-4ad7-4670-8baf-99e5ba09c225 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:05.409603304 +0000 UTC m=+3.090019202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret") pod "global-pull-secret-syncer-glkgj" (UID: "6a171ab4-4ad7-4670-8baf-99e5ba09c225") : object "kube-system"/"original-pull-secret" not registered
Jul 09 16:51:04.909868 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909666    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-host-var-lib-cni-bin\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.909868 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909692    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-host-run-multus-certs\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.909868 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909714    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-slash\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.909868 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909719    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-host-var-lib-cni-bin\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.909868 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909736    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-cni-bin\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.909868 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909742    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-host-run-multus-certs\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.909868 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909766    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-cni-bin\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.910552 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909785    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54ed8699-4487-4246-9e22-3d15bd9908ca-ovn-node-metrics-cert\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.910552 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909791    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-slash\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.910552 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909819    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-run-ovn\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.910552 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909844    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.910552 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909875    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-run-ovn\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.910552 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909887    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-cnibin\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.910552 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909909    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-multus-conf-dir\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.910552 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909909    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.910552 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909932    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-os-release\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.910552 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909972    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54ed8699-4487-4246-9e22-3d15bd9908ca-env-overrides\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.910552 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909978    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d611954-0ce8-4bcb-8173-237304fdd570-cni-binary-copy\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.910552 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.909988    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-os-release\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.910552 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910020    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-multus-conf-dir\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.910552 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910041    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-cnibin\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.910552 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910047    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-hostroot\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.911194 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910084    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h9fg\" (UniqueName: \"kubernetes.io/projected/0d611954-0ce8-4bcb-8173-237304fdd570-kube-api-access-2h9fg\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.911194 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910091    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-hostroot\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.911194 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910113    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-multus-cni-dir\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.911194 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910158    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-etc-openvswitch\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.911194 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910184    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-node-log\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.911194 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910208    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a171ab4-4ad7-4670-8baf-99e5ba09c225-dbus\") pod \"global-pull-secret-syncer-glkgj\" (UID: \"6a171ab4-4ad7-4670-8baf-99e5ba09c225\") " pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:04.911194 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910232    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-system-cni-dir\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.911194 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910240    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-node-log\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.911194 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910207    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-etc-openvswitch\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.911194 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910257    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-host-run-k8s-cni-cncf-io\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.911194 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910280    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-run-openvswitch\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.911194 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910286    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-multus-cni-dir\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.911194 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910305    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a171ab4-4ad7-4670-8baf-99e5ba09c225-dbus\") pod \"global-pull-secret-syncer-glkgj\" (UID: \"6a171ab4-4ad7-4670-8baf-99e5ba09c225\") " pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:04.911194 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910309    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-multus-socket-dir-parent\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.911194 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910307    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-system-cni-dir\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.911674 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910371    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-host-run-k8s-cni-cncf-io\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.911674 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910411    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-run-openvswitch\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.911674 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910428    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-multus-socket-dir-parent\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.911674 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910457    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54ed8699-4487-4246-9e22-3d15bd9908ca-ovnkube-config\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.911674 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910484    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw6wv\" (UniqueName: \"kubernetes.io/projected/ab2233de-a681-4b2a-a1f2-5e1481714409-kube-api-access-zw6wv\") pod \"network-metrics-daemon-9bf8d\" (UID: \"ab2233de-a681-4b2a-a1f2-5e1481714409\") " pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:04.911674 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910510    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-systemd-units\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.911674 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910536    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-var-lib-openvswitch\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.911674 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910580    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-run-ovn-kubernetes\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.911674 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910596    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d611954-0ce8-4bcb-8173-237304fdd570-cni-binary-copy\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.911674 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910606    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54ed8699-4487-4246-9e22-3d15bd9908ca-ovnkube-script-lib\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.911674 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910631    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs\") pod \"network-metrics-daemon-9bf8d\" (UID: \"ab2233de-a681-4b2a-a1f2-5e1481714409\") " pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:04.911674 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910657    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-host-var-lib-kubelet\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.911674 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910691    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-systemd-units\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.911674 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910692    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0d611954-0ce8-4bcb-8173-237304fdd570-multus-daemon-config\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.912093 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910728    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-kubelet\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.912093 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910745    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-run-netns\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.912093 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910759    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-log-socket\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.912093 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910779    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-cni-netd\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.912093 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910828    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-cni-netd\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.912093 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910850    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-kubelet\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.912093 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910881    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-run-netns\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.912093 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910917    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54ed8699-4487-4246-9e22-3d15bd9908ca-ovnkube-config\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.912093 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910912    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-log-socket\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.912093 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910966    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-host-run-ovn-kubernetes\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.912093 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.910977    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54ed8699-4487-4246-9e22-3d15bd9908ca-var-lib-openvswitch\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.912093 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.911021    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d611954-0ce8-4bcb-8173-237304fdd570-host-var-lib-kubelet\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.912093 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:04.911036    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:51:04.912093 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:04.911082    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs podName:ab2233de-a681-4b2a-a1f2-5e1481714409 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:05.411065205 +0000 UTC m=+3.091481093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs") pod "network-metrics-daemon-9bf8d" (UID: "ab2233de-a681-4b2a-a1f2-5e1481714409") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:51:04.912530 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.911154    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0d611954-0ce8-4bcb-8173-237304fdd570-multus-daemon-config\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.912530 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.911400    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54ed8699-4487-4246-9e22-3d15bd9908ca-ovnkube-script-lib\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.912760 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.912738    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54ed8699-4487-4246-9e22-3d15bd9908ca-ovn-node-metrics-cert\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.920032 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.919977    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h9fg\" (UniqueName: \"kubernetes.io/projected/0d611954-0ce8-4bcb-8173-237304fdd570-kube-api-access-2h9fg\") pod \"multus-qn8mx\" (UID: \"0d611954-0ce8-4bcb-8173-237304fdd570\") " pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:04.920032 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.919996    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfxxs\" (UniqueName: \"kubernetes.io/projected/54ed8699-4487-4246-9e22-3d15bd9908ca-kube-api-access-xfxxs\") pod \"ovnkube-node-2ng88\" (UID: \"54ed8699-4487-4246-9e22-3d15bd9908ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:04.920433 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.920417    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw6wv\" (UniqueName: \"kubernetes.io/projected/ab2233de-a681-4b2a-a1f2-5e1481714409-kube-api-access-zw6wv\") pod \"network-metrics-daemon-9bf8d\" (UID: \"ab2233de-a681-4b2a-a1f2-5e1481714409\") " pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:04.923964 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:04.923939    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod641e9bded5c7fc9e1b94316361d7f097.slice/crio-2ba0b56bbbc62c34d80ab73948bf9faf9f0a582e997cf30b90bca23f470cf206 WatchSource:0}: Error finding container 2ba0b56bbbc62c34d80ab73948bf9faf9f0a582e997cf30b90bca23f470cf206: Status 404 returned error can't find the container with id 2ba0b56bbbc62c34d80ab73948bf9faf9f0a582e997cf30b90bca23f470cf206
Jul 09 16:51:04.924251 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:04.924230    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod244d0f9322256235dc0c3747942f9000.slice/crio-87d843ddf3e9d80823955a06c86322be17c5c032136321232fbeac423a1f97f5 WatchSource:0}: Error finding container 87d843ddf3e9d80823955a06c86322be17c5c032136321232fbeac423a1f97f5: Status 404 returned error can't find the container with id 87d843ddf3e9d80823955a06c86322be17c5c032136321232fbeac423a1f97f5
Jul 09 16:51:04.928868 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.928855    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 16:51:04.935655 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.935611    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-229.ec2.internal" event={"ID":"641e9bded5c7fc9e1b94316361d7f097","Type":"ContainerStarted","Data":"2ba0b56bbbc62c34d80ab73948bf9faf9f0a582e997cf30b90bca23f470cf206"}
Jul 09 16:51:04.936564 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:04.936543    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal" event={"ID":"244d0f9322256235dc0c3747942f9000","Type":"ContainerStarted","Data":"87d843ddf3e9d80823955a06c86322be17c5c032136321232fbeac423a1f97f5"}
Jul 09 16:51:05.010273 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.010235    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vmfkk"
Jul 09 16:51:05.020261 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:05.020230    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e9cd237_d0aa_47e0_8034_af5d77b0d27a.slice/crio-f0f2840bf034da906b33da4b7030a94f195652b01ce4b27844bcdd9562d077a2 WatchSource:0}: Error finding container f0f2840bf034da906b33da4b7030a94f195652b01ce4b27844bcdd9562d077a2: Status 404 returned error can't find the container with id f0f2840bf034da906b33da4b7030a94f195652b01ce4b27844bcdd9562d077a2
Jul 09 16:51:05.025414 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.025395    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7"
Jul 09 16:51:05.032011 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.031991    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mwcv8"
Jul 09 16:51:05.032917 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:05.032894    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9257dfa_9fdc_40ec_a101_0ee095b14be8.slice/crio-3f58169fc54be520f8c0800bbbf77fe00657d0159944e40ad65e5777a4b8282e WatchSource:0}: Error finding container 3f58169fc54be520f8c0800bbbf77fe00657d0159944e40ad65e5777a4b8282e: Status 404 returned error can't find the container with id 3f58169fc54be520f8c0800bbbf77fe00657d0159944e40ad65e5777a4b8282e
Jul 09 16:51:05.039962 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.039942    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 16:51:05.041640 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.041627    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dztdq"
Jul 09 16:51:05.041740 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:05.041718    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3d5cd96_7128_42db_963b_e62e14fc1dac.slice/crio-3dfd90b625464f91971169a3ea4564199a648630128ad365ae119fa06ab4c8ed WatchSource:0}: Error finding container 3dfd90b625464f91971169a3ea4564199a648630128ad365ae119fa06ab4c8ed: Status 404 returned error can't find the container with id 3dfd90b625464f91971169a3ea4564199a648630128ad365ae119fa06ab4c8ed
Jul 09 16:51:05.050744 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:05.050720    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b6ee026_c8d9_4d03_8b68_dcae63ba9e93.slice/crio-ad25e0cfb34bf82a0a386ff6dc6ab347aef150ac0b75127ac8f2cbbdfd7ebb4f WatchSource:0}: Error finding container ad25e0cfb34bf82a0a386ff6dc6ab347aef150ac0b75127ac8f2cbbdfd7ebb4f: Status 404 returned error can't find the container with id ad25e0cfb34bf82a0a386ff6dc6ab347aef150ac0b75127ac8f2cbbdfd7ebb4f
Jul 09 16:51:05.065491 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.065467    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dx97p"
Jul 09 16:51:05.074213 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:05.074185    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbed3615c_b651_41bd_9229_90462d4dddea.slice/crio-8217f3a23eb8b1aecfb7fe6fb253d5cc49cb711faf46e666e07b7026e1c4a44f WatchSource:0}: Error finding container 8217f3a23eb8b1aecfb7fe6fb253d5cc49cb711faf46e666e07b7026e1c4a44f: Status 404 returned error can't find the container with id 8217f3a23eb8b1aecfb7fe6fb253d5cc49cb711faf46e666e07b7026e1c4a44f
Jul 09 16:51:05.079138 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.079123    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kcrrm"
Jul 09 16:51:05.086634 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:05.086614    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod787d7f86_db4b_4eac_90bf_c79c0fc629ca.slice/crio-5eadb582eec54148a094dfad1ddf3e2e1075ac55fb17c5f4d53062b9b178253e WatchSource:0}: Error finding container 5eadb582eec54148a094dfad1ddf3e2e1075ac55fb17c5f4d53062b9b178253e: Status 404 returned error can't find the container with id 5eadb582eec54148a094dfad1ddf3e2e1075ac55fb17c5f4d53062b9b178253e
Jul 09 16:51:05.100171 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.100148    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xpczp"
Jul 09 16:51:05.108068 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:05.108047    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd177bcce_d658_44eb_8737_4c122a657f7f.slice/crio-f1fc9dab58da139b72ef0104f0ffc20b8deda313c9f39fd36cf7f785ea296c0e WatchSource:0}: Error finding container f1fc9dab58da139b72ef0104f0ffc20b8deda313c9f39fd36cf7f785ea296c0e: Status 404 returned error can't find the container with id f1fc9dab58da139b72ef0104f0ffc20b8deda313c9f39fd36cf7f785ea296c0e
Jul 09 16:51:05.118923 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.118901    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:05.127494 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:05.127470    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ed8699_4487_4246_9e22_3d15bd9908ca.slice/crio-98c4c79c12832aaa2c8a7260c97bfd6dca22d0becdd632a083d89228d460f292 WatchSource:0}: Error finding container 98c4c79c12832aaa2c8a7260c97bfd6dca22d0becdd632a083d89228d460f292: Status 404 returned error can't find the container with id 98c4c79c12832aaa2c8a7260c97bfd6dca22d0becdd632a083d89228d460f292
Jul 09 16:51:05.134613 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.134595    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qn8mx"
Jul 09 16:51:05.143147 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:05.143122    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d611954_0ce8_4bcb_8173_237304fdd570.slice/crio-34bc57750b79d95eb8e57e06ec65ce4151d1405482f722dc0bb48de77bfd2785 WatchSource:0}: Error finding container 34bc57750b79d95eb8e57e06ec65ce4151d1405482f722dc0bb48de77bfd2785: Status 404 returned error can't find the container with id 34bc57750b79d95eb8e57e06ec65ce4151d1405482f722dc0bb48de77bfd2785
Jul 09 16:51:05.413270 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.413237    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs\") pod \"network-metrics-daemon-9bf8d\" (UID: \"ab2233de-a681-4b2a-a1f2-5e1481714409\") " pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:05.413443 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.413278    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret\") pod \"global-pull-secret-syncer-glkgj\" (UID: \"6a171ab4-4ad7-4670-8baf-99e5ba09c225\") " pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:05.413443 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.413300    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8l5n\" (UniqueName: \"kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n\") pod \"network-check-target-vwcc7\" (UID: \"f4928566-2544-41f6-805a-f6ecd54be679\") " pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:05.413443 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:05.413399    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:51:05.413443 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:05.413412    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 16:51:05.413443 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:05.413430    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 16:51:05.413443 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:05.413439    2568 projected.go:196] Error preparing data for projected volume kube-api-access-q8l5n for pod openshift-network-diagnostics/network-check-target-vwcc7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:51:05.413643 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:05.413462    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs podName:ab2233de-a681-4b2a-a1f2-5e1481714409 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:06.413443449 +0000 UTC m=+4.093859354 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs") pod "network-metrics-daemon-9bf8d" (UID: "ab2233de-a681-4b2a-a1f2-5e1481714409") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:51:05.413643 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:05.413479    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n podName:f4928566-2544-41f6-805a-f6ecd54be679 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:06.413471179 +0000 UTC m=+4.093887064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q8l5n" (UniqueName: "kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n") pod "network-check-target-vwcc7" (UID: "f4928566-2544-41f6-805a-f6ecd54be679") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:51:05.413643 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:05.413402    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 16:51:05.413643 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:05.413503    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret podName:6a171ab4-4ad7-4670-8baf-99e5ba09c225 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:06.413498313 +0000 UTC m=+4.093914198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret") pod "global-pull-secret-syncer-glkgj" (UID: "6a171ab4-4ad7-4670-8baf-99e5ba09c225") : object "kube-system"/"original-pull-secret" not registered
Jul 09 16:51:05.742151 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.741902    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 16:46:04 +0000 UTC" deadline="2028-02-04 10:33:43.299090586 +0000 UTC"
Jul 09 16:51:05.742151 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.742011    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13793h42m37.5570852s"
Jul 09 16:51:05.939260 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.938701    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:05.939260 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:05.938826    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:05.939260 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.938872    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:05.939260 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:05.938989    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:05.946029 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.945960    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qn8mx" event={"ID":"0d611954-0ce8-4bcb-8173-237304fdd570","Type":"ContainerStarted","Data":"34bc57750b79d95eb8e57e06ec65ce4151d1405482f722dc0bb48de77bfd2785"}
Jul 09 16:51:05.950857 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.950828    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ng88" event={"ID":"54ed8699-4487-4246-9e22-3d15bd9908ca","Type":"ContainerStarted","Data":"98c4c79c12832aaa2c8a7260c97bfd6dca22d0becdd632a083d89228d460f292"}
Jul 09 16:51:05.956627 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.956570    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dx97p" event={"ID":"bed3615c-b651-41bd-9229-90462d4dddea","Type":"ContainerStarted","Data":"8217f3a23eb8b1aecfb7fe6fb253d5cc49cb711faf46e666e07b7026e1c4a44f"}
Jul 09 16:51:05.970339 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.970296    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mwcv8" event={"ID":"a3d5cd96-7128-42db-963b-e62e14fc1dac","Type":"ContainerStarted","Data":"3dfd90b625464f91971169a3ea4564199a648630128ad365ae119fa06ab4c8ed"}
Jul 09 16:51:05.987228 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:05.987193    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7" event={"ID":"a9257dfa-9fdc-40ec-a101-0ee095b14be8","Type":"ContainerStarted","Data":"3f58169fc54be520f8c0800bbbf77fe00657d0159944e40ad65e5777a4b8282e"}
Jul 09 16:51:06.004193 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:06.004115    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xpczp" event={"ID":"d177bcce-d658-44eb-8737-4c122a657f7f","Type":"ContainerStarted","Data":"f1fc9dab58da139b72ef0104f0ffc20b8deda313c9f39fd36cf7f785ea296c0e"}
Jul 09 16:51:06.010482 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:06.010449    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kcrrm" event={"ID":"787d7f86-db4b-4eac-90bf-c79c0fc629ca","Type":"ContainerStarted","Data":"5eadb582eec54148a094dfad1ddf3e2e1075ac55fb17c5f4d53062b9b178253e"}
Jul 09 16:51:06.014604 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:06.014567    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dztdq" event={"ID":"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93","Type":"ContainerStarted","Data":"ad25e0cfb34bf82a0a386ff6dc6ab347aef150ac0b75127ac8f2cbbdfd7ebb4f"}
Jul 09 16:51:06.032832 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:06.032797    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmfkk" event={"ID":"3e9cd237-d0aa-47e0-8034-af5d77b0d27a","Type":"ContainerStarted","Data":"f0f2840bf034da906b33da4b7030a94f195652b01ce4b27844bcdd9562d077a2"}
Jul 09 16:51:06.422051 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:06.422015    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8l5n\" (UniqueName: \"kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n\") pod \"network-check-target-vwcc7\" (UID: \"f4928566-2544-41f6-805a-f6ecd54be679\") " pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:06.422238 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:06.422105    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs\") pod \"network-metrics-daemon-9bf8d\" (UID: \"ab2233de-a681-4b2a-a1f2-5e1481714409\") " pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:06.422238 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:06.422140    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret\") pod \"global-pull-secret-syncer-glkgj\" (UID: \"6a171ab4-4ad7-4670-8baf-99e5ba09c225\") " pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:06.422408 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:06.422271    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 16:51:06.422408 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:06.422332    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret podName:6a171ab4-4ad7-4670-8baf-99e5ba09c225 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:08.422313522 +0000 UTC m=+6.102729422 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret") pod "global-pull-secret-syncer-glkgj" (UID: "6a171ab4-4ad7-4670-8baf-99e5ba09c225") : object "kube-system"/"original-pull-secret" not registered
Jul 09 16:51:06.423208 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:06.422770    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 16:51:06.423208 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:06.422792    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 16:51:06.423208 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:06.422805    2568 projected.go:196] Error preparing data for projected volume kube-api-access-q8l5n for pod openshift-network-diagnostics/network-check-target-vwcc7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:51:06.423208 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:06.422850    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n podName:f4928566-2544-41f6-805a-f6ecd54be679 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:08.422835958 +0000 UTC m=+6.103251848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q8l5n" (UniqueName: "kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n") pod "network-check-target-vwcc7" (UID: "f4928566-2544-41f6-805a-f6ecd54be679") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:51:06.423208 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:06.422909    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:51:06.423208 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:06.422944    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs podName:ab2233de-a681-4b2a-a1f2-5e1481714409 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:08.422932257 +0000 UTC m=+6.103348145 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs") pod "network-metrics-daemon-9bf8d" (UID: "ab2233de-a681-4b2a-a1f2-5e1481714409") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:51:06.742848 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:06.742718    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 16:46:04 +0000 UTC" deadline="2027-12-13 04:18:22.271955828 +0000 UTC"
Jul 09 16:51:06.742848 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:06.742755    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12515h27m15.529204864s"
Jul 09 16:51:06.933342 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:06.932821    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:06.933342 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:06.932974    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:07.936214 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:07.935254    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:07.936214 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:07.935401    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:07.936214 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:07.935780    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:07.936214 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:07.935871    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:08.439919 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:08.439881    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs\") pod \"network-metrics-daemon-9bf8d\" (UID: \"ab2233de-a681-4b2a-a1f2-5e1481714409\") " pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:08.440086 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:08.439933    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret\") pod \"global-pull-secret-syncer-glkgj\" (UID: \"6a171ab4-4ad7-4670-8baf-99e5ba09c225\") " pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:08.440086 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:08.440058    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8l5n\" (UniqueName: \"kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n\") pod \"network-check-target-vwcc7\" (UID: \"f4928566-2544-41f6-805a-f6ecd54be679\") " pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:08.440086 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:08.440068    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:51:08.440274 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:08.440152    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs podName:ab2233de-a681-4b2a-a1f2-5e1481714409 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:12.440130487 +0000 UTC m=+10.120546379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs") pod "network-metrics-daemon-9bf8d" (UID: "ab2233de-a681-4b2a-a1f2-5e1481714409") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:51:08.440274 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:08.440196    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 16:51:08.440274 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:08.440219    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 16:51:08.440274 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:08.440231    2568 projected.go:196] Error preparing data for projected volume kube-api-access-q8l5n for pod openshift-network-diagnostics/network-check-target-vwcc7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:51:08.440591 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:08.440315    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n podName:f4928566-2544-41f6-805a-f6ecd54be679 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:12.440297763 +0000 UTC m=+10.120713672 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q8l5n" (UniqueName: "kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n") pod "network-check-target-vwcc7" (UID: "f4928566-2544-41f6-805a-f6ecd54be679") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:51:08.440591 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:08.440402    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 16:51:08.440591 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:08.440441    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret podName:6a171ab4-4ad7-4670-8baf-99e5ba09c225 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:12.440430198 +0000 UTC m=+10.120846084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret") pod "global-pull-secret-syncer-glkgj" (UID: "6a171ab4-4ad7-4670-8baf-99e5ba09c225") : object "kube-system"/"original-pull-secret" not registered
Jul 09 16:51:08.932600 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:08.932568    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:08.932762 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:08.932712    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:09.933670 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:09.933637    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:09.934070 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:09.933765    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:09.934456 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:09.934306    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:09.934456 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:09.934417    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:10.932778 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:10.932655    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:10.932941 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:10.932795    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:11.933716 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:11.933101    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:11.933716 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:11.933124    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:11.933716 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:11.933238    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:11.933716 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:11.933674    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:12.474244 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:12.473667    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret\") pod \"global-pull-secret-syncer-glkgj\" (UID: \"6a171ab4-4ad7-4670-8baf-99e5ba09c225\") " pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:12.474244 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:12.473727    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8l5n\" (UniqueName: \"kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n\") pod \"network-check-target-vwcc7\" (UID: \"f4928566-2544-41f6-805a-f6ecd54be679\") " pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:12.474244 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:12.473854    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs\") pod \"network-metrics-daemon-9bf8d\" (UID: \"ab2233de-a681-4b2a-a1f2-5e1481714409\") " pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:12.474244 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:12.473978    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:51:12.474244 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:12.474004    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 16:51:12.474244 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:12.474045    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs podName:ab2233de-a681-4b2a-a1f2-5e1481714409 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:20.474025109 +0000 UTC m=+18.154441014 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs") pod "network-metrics-daemon-9bf8d" (UID: "ab2233de-a681-4b2a-a1f2-5e1481714409") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:51:12.474244 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:12.474063    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret podName:6a171ab4-4ad7-4670-8baf-99e5ba09c225 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:20.474053471 +0000 UTC m=+18.154469362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret") pod "global-pull-secret-syncer-glkgj" (UID: "6a171ab4-4ad7-4670-8baf-99e5ba09c225") : object "kube-system"/"original-pull-secret" not registered
Jul 09 16:51:12.474244 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:12.474072    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 16:51:12.474244 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:12.474100    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 16:51:12.474244 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:12.474114    2568 projected.go:196] Error preparing data for projected volume kube-api-access-q8l5n for pod openshift-network-diagnostics/network-check-target-vwcc7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:51:12.474244 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:12.474168    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n podName:f4928566-2544-41f6-805a-f6ecd54be679 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:20.47415108 +0000 UTC m=+18.154566970 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q8l5n" (UniqueName: "kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n") pod "network-check-target-vwcc7" (UID: "f4928566-2544-41f6-805a-f6ecd54be679") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:51:12.932745 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:12.932714    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:12.932996 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:12.932863    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:13.933446 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:13.933408    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:13.933920 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:13.933537    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:13.933920 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:13.933613    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:13.933920 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:13.933708    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:14.932751 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:14.932706    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:14.932942 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:14.932848    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:15.933196 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:15.933159    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:15.933697 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:15.933291    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:15.933697 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:15.933339    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:15.933697 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:15.933416    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:16.933407 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:16.933325    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:16.933772 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:16.933468    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:17.933431 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:17.933397    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:17.933858 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:17.933403    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:17.933858 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:17.933539    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:17.933858 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:17.933605    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:18.933032 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:18.932994    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:18.933204 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:18.933119    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:19.932668 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:19.932533    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:19.932668 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:19.932666    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:19.933163 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:19.932738    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:19.933163 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:19.932845    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:20.536948 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:20.536908    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs\") pod \"network-metrics-daemon-9bf8d\" (UID: \"ab2233de-a681-4b2a-a1f2-5e1481714409\") " pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:20.536948 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:20.536960    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret\") pod \"global-pull-secret-syncer-glkgj\" (UID: \"6a171ab4-4ad7-4670-8baf-99e5ba09c225\") " pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:20.537193 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:20.537098    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 16:51:20.537193 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:20.537102    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:51:20.537193 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:20.537101    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8l5n\" (UniqueName: \"kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n\") pod \"network-check-target-vwcc7\" (UID: \"f4928566-2544-41f6-805a-f6ecd54be679\") " pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:20.537193 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:20.537187    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret podName:6a171ab4-4ad7-4670-8baf-99e5ba09c225 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:36.537148254 +0000 UTC m=+34.217564153 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret") pod "global-pull-secret-syncer-glkgj" (UID: "6a171ab4-4ad7-4670-8baf-99e5ba09c225") : object "kube-system"/"original-pull-secret" not registered
Jul 09 16:51:20.537394 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:20.537237    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 16:51:20.537394 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:20.537258    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 16:51:20.537394 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:20.537271    2568 projected.go:196] Error preparing data for projected volume kube-api-access-q8l5n for pod openshift-network-diagnostics/network-check-target-vwcc7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:51:20.537394 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:20.537243    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs podName:ab2233de-a681-4b2a-a1f2-5e1481714409 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:36.537219809 +0000 UTC m=+34.217635703 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs") pod "network-metrics-daemon-9bf8d" (UID: "ab2233de-a681-4b2a-a1f2-5e1481714409") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:51:20.537394 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:20.537347    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n podName:f4928566-2544-41f6-805a-f6ecd54be679 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:36.537317556 +0000 UTC m=+34.217733457 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q8l5n" (UniqueName: "kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n") pod "network-check-target-vwcc7" (UID: "f4928566-2544-41f6-805a-f6ecd54be679") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:51:20.933199 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:20.933165    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:20.933662 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:20.933295    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:21.932651 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:21.932611    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:21.932902 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:21.932662    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:21.932902 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:21.932746    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:21.932902 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:21.932849    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:22.932946 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:22.932917    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:22.933380 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:22.933039    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:23.933764 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:23.933729    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:23.934218 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:23.933834    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:23.934218 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:23.933892    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:23.934218 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:23.934000    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:24.933096 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:24.933028    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:24.933226 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:24.933136    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:25.933133 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:25.932938    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:25.933760 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:25.932977    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:25.933760 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:25.933227    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:25.933760 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:25.933271    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:26.101887 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:26.101847    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dztdq" event={"ID":"6b6ee026-c8d9-4d03-8b68-dcae63ba9e93","Type":"ContainerStarted","Data":"27b71c806ff777a613d2e03c6d520ec5d1fce032bf8fb9680ba9dfcbcf5e72aa"}
Jul 09 16:51:26.104807 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:26.104780    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-229.ec2.internal" event={"ID":"641e9bded5c7fc9e1b94316361d7f097","Type":"ContainerStarted","Data":"0187744170fbd2714e521b0f46155640a6124d23d5d9c814a43570800d870399"}
Jul 09 16:51:26.107586 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:26.107559    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qn8mx" event={"ID":"0d611954-0ce8-4bcb-8173-237304fdd570","Type":"ContainerStarted","Data":"100bcffddc4bbc7b37044498f82b9332165711ab7ed02af141a8189bdb0f3993"}
Jul 09 16:51:26.110947 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:26.110929    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ng88_54ed8699-4487-4246-9e22-3d15bd9908ca/ovn-acl-logging/0.log"
Jul 09 16:51:26.111303 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:26.111282    2568 generic.go:356] "Generic (PLEG): container finished" podID="54ed8699-4487-4246-9e22-3d15bd9908ca" containerID="bff817584d77a5dd4028d66359aa1005f61bf4520e005b4d47e571f3b37f9d24" exitCode=1
Jul 09 16:51:26.111452 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:26.111317    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ng88" event={"ID":"54ed8699-4487-4246-9e22-3d15bd9908ca","Type":"ContainerStarted","Data":"b89b404491c1ce89863cabf341f1c0701b1449ff3f1fb7e4657f3c0c010b0d5b"}
Jul 09 16:51:26.111523 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:26.111465    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ng88" event={"ID":"54ed8699-4487-4246-9e22-3d15bd9908ca","Type":"ContainerStarted","Data":"cf36adcba2e39a5aa9f79f6444ea56126c6f4d209127c869c8011c83298cb716"}
Jul 09 16:51:26.111574 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:26.111522    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ng88" event={"ID":"54ed8699-4487-4246-9e22-3d15bd9908ca","Type":"ContainerStarted","Data":"78c05cc7c9ee1cc4fa84719b34cf902e860bda64bacd3c8689fddf3702dbc463"}
Jul 09 16:51:26.111632 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:26.111572    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ng88" event={"ID":"54ed8699-4487-4246-9e22-3d15bd9908ca","Type":"ContainerStarted","Data":"0f493706c0a311d6d66b36ba83ac3e12cf15d8637613ea1bc6b091970198bd03"}
Jul 09 16:51:26.111632 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:26.111621    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ng88" event={"ID":"54ed8699-4487-4246-9e22-3d15bd9908ca","Type":"ContainerDied","Data":"bff817584d77a5dd4028d66359aa1005f61bf4520e005b4d47e571f3b37f9d24"}
Jul 09 16:51:26.111728 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:26.111671    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ng88" event={"ID":"54ed8699-4487-4246-9e22-3d15bd9908ca","Type":"ContainerStarted","Data":"b0c6dfc4bf68f655da353cd20c1ab2ed4eb68bcbf486cca3578ab4097d2da776"}
Jul 09 16:51:26.121415 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:26.120253    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dztdq" podStartSLOduration=3.232885471 podStartE2EDuration="23.12023024s" totalImagesPullingTime="19.887344769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:26.119042568 +0000 UTC m=+23.799458477" watchObservedRunningTime="2026-07-09 16:51:26.12023024 +0000 UTC m=+23.800646149"
Jul 09 16:51:26.139341 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:26.139272    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qn8mx" podStartSLOduration=2.344070747 podStartE2EDuration="22.139253523s" totalImagesPullingTime="19.795182776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:26.138730777 +0000 UTC m=+23.819146687" watchObservedRunningTime="2026-07-09 16:51:26.139253523 +0000 UTC m=+23.819669433"
Jul 09 16:51:26.156305 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:26.155969    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-229.ec2.internal" podStartSLOduration=22.155949048 podStartE2EDuration="22.155949048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:26.155687996 +0000 UTC m=+23.836103931" watchObservedRunningTime="2026-07-09 16:51:26.155949048 +0000 UTC m=+23.836364957"
Jul 09 16:51:26.933243 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:26.933204    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:26.933712 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:26.933333    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:27.114451 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:27.114411    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dx97p" event={"ID":"bed3615c-b651-41bd-9229-90462d4dddea","Type":"ContainerStarted","Data":"850f7b976729ed23d1eca3890274039bc82c2b8b362e084a301274de347bfe8a"}
Jul 09 16:51:27.115786 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:27.115756    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mwcv8" event={"ID":"a3d5cd96-7128-42db-963b-e62e14fc1dac","Type":"ContainerStarted","Data":"4967da1d90daf715efbc0afb284bc6d72cbc1f379e4d4c2a8cbf69d5ed4f383e"}
Jul 09 16:51:27.117197 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:27.117174    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7" event={"ID":"a9257dfa-9fdc-40ec-a101-0ee095b14be8","Type":"ContainerStarted","Data":"1182396ea4ef7d6c6d6dfd6222c1ed8a72e31b5e13c34784276e53995fbe3cb5"}
Jul 09 16:51:27.118629 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:27.118606    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xpczp" event={"ID":"d177bcce-d658-44eb-8737-4c122a657f7f","Type":"ContainerStarted","Data":"5e8e8ed27624a98921e3877b6dac7730ee33b6051e1765f6f0ccbc397ff50578"}
Jul 09 16:51:27.119927 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:27.119908    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kcrrm" event={"ID":"787d7f86-db4b-4eac-90bf-c79c0fc629ca","Type":"ContainerStarted","Data":"45de4c369b76d5193f509335ff557d0bf060b837b9a6bee011a9b44be9583b2a"}
Jul 09 16:51:27.121251 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:27.121228    2568 generic.go:356] "Generic (PLEG): container finished" podID="3e9cd237-d0aa-47e0-8034-af5d77b0d27a" containerID="21f50dc3985a50dc8c839dfff5cdc49142e5ebc9bdfcf8ca908f9ef2270232d9" exitCode=0
Jul 09 16:51:27.121334 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:27.121300    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmfkk" event={"ID":"3e9cd237-d0aa-47e0-8034-af5d77b0d27a","Type":"ContainerDied","Data":"21f50dc3985a50dc8c839dfff5cdc49142e5ebc9bdfcf8ca908f9ef2270232d9"}
Jul 09 16:51:27.122784 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:27.122764    2568 generic.go:356] "Generic (PLEG): container finished" podID="244d0f9322256235dc0c3747942f9000" containerID="c218780b289e12906f47d13e1abdb1eaae190245c27dbe10c22c61256373f034" exitCode=0
Jul 09 16:51:27.122853 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:27.122827    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal" event={"ID":"244d0f9322256235dc0c3747942f9000","Type":"ContainerDied","Data":"c218780b289e12906f47d13e1abdb1eaae190245c27dbe10c22c61256373f034"}
Jul 09 16:51:27.131521 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:27.131486    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dx97p" podStartSLOduration=4.478277936 podStartE2EDuration="24.131474365s" totalImagesPullingTime="19.653196429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:27.131234151 +0000 UTC m=+24.811650059" watchObservedRunningTime="2026-07-09 16:51:27.131474365 +0000 UTC m=+24.811890272"
Jul 09 16:51:27.160184 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:27.160130    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kcrrm" podStartSLOduration=4.519315229 podStartE2EDuration="24.160108601s" totalImagesPullingTime="19.640793372s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:27.160088357 +0000 UTC m=+24.840504265" watchObservedRunningTime="2026-07-09 16:51:27.160108601 +0000 UTC m=+24.840524508"
Jul 09 16:51:27.197874 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:27.197779    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mwcv8" podStartSLOduration=8.831326511 podStartE2EDuration="24.19776372s" totalImagesPullingTime="15.366437209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:27.197222502 +0000 UTC m=+24.877638411" watchObservedRunningTime="2026-07-09 16:51:27.19776372 +0000 UTC m=+24.878179628"
Jul 09 16:51:27.212031 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:27.211981    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xpczp" podStartSLOduration=4.568725062 podStartE2EDuration="24.211960074s" totalImagesPullingTime="19.643235012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:27.211713645 +0000 UTC m=+24.892129553" watchObservedRunningTime="2026-07-09 16:51:27.211960074 +0000 UTC m=+24.892375983"
Jul 09 16:51:27.373449 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:27.373424    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 16:51:27.813633 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:27.813519    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T16:51:27.373442791Z","UUID":"e1078351-0434-4ad7-a9a7-0eddd2995f8e","Handler":null,"Name":"","Endpoint":""}
Jul 09 16:51:27.815287 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:27.815261    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 16:51:27.815426 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:27.815311    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 16:51:27.932826 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:27.932794    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:27.932976 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:27.932834    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:27.932976 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:27.932918    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:27.933064 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:27.933027    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:28.127575 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:28.127515    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal" event={"ID":"244d0f9322256235dc0c3747942f9000","Type":"ContainerStarted","Data":"d763bb2549669b74c2c8df53dcaa4a266ce83e572baff011eb6336f42b5e568b"}
Jul 09 16:51:28.131114 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:28.131079    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ng88_54ed8699-4487-4246-9e22-3d15bd9908ca/ovn-acl-logging/0.log"
Jul 09 16:51:28.131596 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:28.131564    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ng88" event={"ID":"54ed8699-4487-4246-9e22-3d15bd9908ca","Type":"ContainerStarted","Data":"96b5c4916389b8e36b6f8c8d1ed20cd6caa28132ac48ffd3393d409524310825"}
Jul 09 16:51:28.133225 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:28.133154    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7" event={"ID":"a9257dfa-9fdc-40ec-a101-0ee095b14be8","Type":"ContainerStarted","Data":"641da7cf4419020f93cc2cf96d84df6795b51dff65f3637d41c14cc40d2d224a"}
Jul 09 16:51:28.142666 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:28.142616    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-229.ec2.internal" podStartSLOduration=24.142602731 podStartE2EDuration="24.142602731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:28.142426824 +0000 UTC m=+25.822842733" watchObservedRunningTime="2026-07-09 16:51:28.142602731 +0000 UTC m=+25.823018639"
Jul 09 16:51:28.932864 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:28.932828    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:28.933144 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:28.932964    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:29.935687 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:29.935655    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:29.936098 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:29.935778    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:29.936098 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:29.935835    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:29.936098 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:29.935948    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:30.142195 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:30.141963    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ng88_54ed8699-4487-4246-9e22-3d15bd9908ca/ovn-acl-logging/0.log"
Jul 09 16:51:30.142656 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:30.142622    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ng88" event={"ID":"54ed8699-4487-4246-9e22-3d15bd9908ca","Type":"ContainerStarted","Data":"7b02ce090e2d48ce5881ec884e0c3cebf79850dc41d7b796cd98c050bf5a1fc9"}
Jul 09 16:51:30.143057 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:30.142897    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:30.143057 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:30.142974    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:30.143154 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:30.143078    2568 scope.go:117] "RemoveContainer" containerID="bff817584d77a5dd4028d66359aa1005f61bf4520e005b4d47e571f3b37f9d24"
Jul 09 16:51:30.148253 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:30.145393    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7" event={"ID":"a9257dfa-9fdc-40ec-a101-0ee095b14be8","Type":"ContainerStarted","Data":"cf2a6a84f3ae7b5d9d50b276328abe904a7c2367932c7ad0eaed8679c1c31d25"}
Jul 09 16:51:30.163382 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:30.163325    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:30.193588 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:30.193522    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prds7" podStartSLOduration=4.071201416 podStartE2EDuration="27.193502935s" totalImagesPullingTime="23.122301519s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:30.192663881 +0000 UTC m=+27.873079790" watchObservedRunningTime="2026-07-09 16:51:30.193502935 +0000 UTC m=+27.873918859"
Jul 09 16:51:30.864234 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:30.864133    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mwcv8"
Jul 09 16:51:30.865062 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:30.865036    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mwcv8"
Jul 09 16:51:30.932659 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:30.932623    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:30.932863 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:30.932734    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:31.151755 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:31.151681    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ng88_54ed8699-4487-4246-9e22-3d15bd9908ca/ovn-acl-logging/0.log"
Jul 09 16:51:31.152627 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:31.152145    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2ng88" event={"ID":"54ed8699-4487-4246-9e22-3d15bd9908ca","Type":"ContainerStarted","Data":"2086bb0f1f909b817ce53380e425e7f12fc4c2ac05c41d9f16e6abedcd921cd5"}
Jul 09 16:51:31.152627 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:31.152454    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:31.152936 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:31.152919    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mwcv8"
Jul 09 16:51:31.153319 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:31.153301    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mwcv8"
Jul 09 16:51:31.169521 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:31.169494    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:51:31.181154 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:31.181091    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2ng88" podStartSLOduration=7.268710427 podStartE2EDuration="27.181071016s" totalImagesPullingTime="19.912360589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:31.180525445 +0000 UTC m=+28.860941353" watchObservedRunningTime="2026-07-09 16:51:31.181071016 +0000 UTC m=+28.861486924"
Jul 09 16:51:31.933208 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:31.933027    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:31.933475 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:31.933027    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:31.933475 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:31.933306    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:31.933475 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:31.933347    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:32.330573 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:32.330544    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-glkgj"]
Jul 09 16:51:32.330913 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:32.330644    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:32.330913 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:32.330746    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:32.336586 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:32.336560    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vwcc7"]
Jul 09 16:51:32.336698 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:32.336677    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:32.336823 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:32.336801    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:32.337229 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:32.337210    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9bf8d"]
Jul 09 16:51:32.337336 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:32.337323    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:32.337473 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:32.337452    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:32.885718 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:32.885684    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dx97p_bed3615c-b651-41bd-9229-90462d4dddea/dns-node-resolver/0.log"
Jul 09 16:51:33.158498 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:33.158419    2568 generic.go:356] "Generic (PLEG): container finished" podID="3e9cd237-d0aa-47e0-8034-af5d77b0d27a" containerID="56a9e2e0fece152e76786b828bac9e843f64ca321e721d5bcfec48659772fda1" exitCode=0
Jul 09 16:51:33.158621 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:33.158505    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmfkk" event={"ID":"3e9cd237-d0aa-47e0-8034-af5d77b0d27a","Type":"ContainerDied","Data":"56a9e2e0fece152e76786b828bac9e843f64ca321e721d5bcfec48659772fda1"}
Jul 09 16:51:33.656787 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:33.656759    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kcrrm_787d7f86-db4b-4eac-90bf-c79c0fc629ca/node-ca/0.log"
Jul 09 16:51:33.933565 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:33.933471    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:33.933565 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:33.933548    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:33.933565 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:33.933558    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:33.933795 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:33.933654    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:33.933795 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:33.933700    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:33.933795 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:33.933747    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:35.165911 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:35.165707    2568 generic.go:356] "Generic (PLEG): container finished" podID="3e9cd237-d0aa-47e0-8034-af5d77b0d27a" containerID="a7cd25f6001e88b4a5d5282ecd6af7c968a3bb589df60b85f2cf6830ab6e0070" exitCode=0
Jul 09 16:51:35.166294 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:35.165798    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmfkk" event={"ID":"3e9cd237-d0aa-47e0-8034-af5d77b0d27a","Type":"ContainerDied","Data":"a7cd25f6001e88b4a5d5282ecd6af7c968a3bb589df60b85f2cf6830ab6e0070"}
Jul 09 16:51:35.936230 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:35.936199    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:35.936439 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:35.936292    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:35.936439 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:35.936295    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:35.936439 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:35.936341    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:35.936628 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:35.936459    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:35.936628 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:35.936546    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:36.563214 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:36.563132    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs\") pod \"network-metrics-daemon-9bf8d\" (UID: \"ab2233de-a681-4b2a-a1f2-5e1481714409\") " pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:36.563214 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:36.563171    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret\") pod \"global-pull-secret-syncer-glkgj\" (UID: \"6a171ab4-4ad7-4670-8baf-99e5ba09c225\") " pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:36.563214 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:36.563193    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8l5n\" (UniqueName: \"kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n\") pod \"network-check-target-vwcc7\" (UID: \"f4928566-2544-41f6-805a-f6ecd54be679\") " pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:36.563656 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:36.563292    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 16:51:36.563656 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:36.563294    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:51:36.563656 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:36.563308    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 16:51:36.563656 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:36.563324    2568 projected.go:196] Error preparing data for projected volume kube-api-access-q8l5n for pod openshift-network-diagnostics/network-check-target-vwcc7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:51:36.563656 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:36.563294    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 16:51:36.563656 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:36.563376    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs podName:ab2233de-a681-4b2a-a1f2-5e1481714409 nodeName:}" failed. No retries permitted until 2026-07-09 16:52:08.56333983 +0000 UTC m=+66.243755719 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs") pod "network-metrics-daemon-9bf8d" (UID: "ab2233de-a681-4b2a-a1f2-5e1481714409") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:51:36.563656 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:36.563393    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret podName:6a171ab4-4ad7-4670-8baf-99e5ba09c225 nodeName:}" failed. No retries permitted until 2026-07-09 16:52:08.563382827 +0000 UTC m=+66.243798712 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret") pod "global-pull-secret-syncer-glkgj" (UID: "6a171ab4-4ad7-4670-8baf-99e5ba09c225") : object "kube-system"/"original-pull-secret" not registered
Jul 09 16:51:36.563656 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:36.563406    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n podName:f4928566-2544-41f6-805a-f6ecd54be679 nodeName:}" failed. No retries permitted until 2026-07-09 16:52:08.563400292 +0000 UTC m=+66.243816178 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q8l5n" (UniqueName: "kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n") pod "network-check-target-vwcc7" (UID: "f4928566-2544-41f6-805a-f6ecd54be679") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:51:37.172220 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:37.172180    2568 generic.go:356] "Generic (PLEG): container finished" podID="3e9cd237-d0aa-47e0-8034-af5d77b0d27a" containerID="0fb010eccfd0638f6d52ed31c842f194e3f5880e10cac34ccff4cebf169cb4b2" exitCode=0
Jul 09 16:51:37.172220 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:37.172219    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmfkk" event={"ID":"3e9cd237-d0aa-47e0-8034-af5d77b0d27a","Type":"ContainerDied","Data":"0fb010eccfd0638f6d52ed31c842f194e3f5880e10cac34ccff4cebf169cb4b2"}
Jul 09 16:51:37.935741 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:37.935707    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:37.936187 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:37.935811    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:37.936187 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:37.935824    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:37.936187 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:37.935836    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:37.936187 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:37.935908    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:37.936187 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:37.935974    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:39.936195 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:39.936163    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:39.936551 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:39.936253    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:39.936551 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:39.936259    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:39.936551 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:39.936278    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:39.936551 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:39.936345    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:39.936551 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:39.936424    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:41.933472 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:41.933438    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:41.934206 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:41.933438    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:41.934206 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:41.933556    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:41.934206 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:41.933445    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:41.934206 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:41.933623    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:41.934206 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:41.933688    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:43.934251 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:43.934214    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:43.934765 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:43.934306    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:43.934765 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:43.934367    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:43.934765 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:43.934403    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:43.934765 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:43.934449    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:43.934765 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:43.934530    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:45.194020 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:45.193987    2568 generic.go:356] "Generic (PLEG): container finished" podID="3e9cd237-d0aa-47e0-8034-af5d77b0d27a" containerID="611727d3ebebc88142297a1e4d034ff803cb687a9e41d6cc697056623a415ed1" exitCode=0
Jul 09 16:51:45.194419 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:45.194020    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmfkk" event={"ID":"3e9cd237-d0aa-47e0-8034-af5d77b0d27a","Type":"ContainerDied","Data":"611727d3ebebc88142297a1e4d034ff803cb687a9e41d6cc697056623a415ed1"}
Jul 09 16:51:45.932705 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:45.932670    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:45.932879 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:45.932783    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:45.932879 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:45.932676    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:45.932879 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:45.932802    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:45.932879 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:45.932862    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:45.933115 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:45.932936    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:46.199100 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:46.199021    2568 generic.go:356] "Generic (PLEG): container finished" podID="3e9cd237-d0aa-47e0-8034-af5d77b0d27a" containerID="ee9610c788f06a0ae6c89669dcdc7aee8ede1ea5539725f2f59559e0cd2e5984" exitCode=0
Jul 09 16:51:46.199100 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:46.199080    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmfkk" event={"ID":"3e9cd237-d0aa-47e0-8034-af5d77b0d27a","Type":"ContainerDied","Data":"ee9610c788f06a0ae6c89669dcdc7aee8ede1ea5539725f2f59559e0cd2e5984"}
Jul 09 16:51:47.203734 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:47.203700    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmfkk" event={"ID":"3e9cd237-d0aa-47e0-8034-af5d77b0d27a","Type":"ContainerStarted","Data":"f90f4ab084600ba21501a27338539acbd6a5af584b71b4f2f74a5af03fe9adec"}
Jul 09 16:51:47.228406 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:47.228013    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vmfkk" podStartSLOduration=10.112293366 podStartE2EDuration="44.227990449s" totalImagesPullingTime="34.115697083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:47.225960718 +0000 UTC m=+44.906376626" watchObservedRunningTime="2026-07-09 16:51:47.227990449 +0000 UTC m=+44.908406358"
Jul 09 16:51:47.933177 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:47.933135    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:47.933509 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:47.933135    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:47.933509 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:47.933277    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:47.933509 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:47.933335    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:47.933509 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:47.933247    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:47.933509 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:47.933435    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:49.932904 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:49.932862    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:49.933297 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:49.932869    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:49.933297 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:49.932976    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:49.933297 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:49.933013    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:49.933297 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:49.933134    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:49.933297 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:49.933224    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:51.932676 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:51.932637    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:51.933141 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:51.932647    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:51.933141 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:51.932765    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:51.933141 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:51.932647    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:51.933141 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:51.932819    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:51.933141 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:51.932894    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:53.935572 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:53.935535    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:53.936025 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:53.935983    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-glkgj" podUID="6a171ab4-4ad7-4670-8baf-99e5ba09c225"
Jul 09 16:51:53.936243 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:53.936225    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:53.936321 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:53.936239    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:53.938616 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:53.938570    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9bf8d" podUID="ab2233de-a681-4b2a-a1f2-5e1481714409"
Jul 09 16:51:53.938928 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:51:53.938897    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwcc7" podUID="f4928566-2544-41f6-805a-f6ecd54be679"
Jul 09 16:51:55.120066 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.119990    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-229.ec2.internal" event="NodeReady"
Jul 09 16:51:55.120430 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.120108    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 16:51:55.175082 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.175043    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lb6th"]
Jul 09 16:51:55.176999 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.176976    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lb6th"
Jul 09 16:51:55.179532 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.179508    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 16:51:55.179688 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.179671    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8vwg8\""
Jul 09 16:51:55.179732 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.179684    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 16:51:55.183317 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.183269    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k6sgl"]
Jul 09 16:51:55.184937 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.184915    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k6sgl"
Jul 09 16:51:55.189304 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.189272    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 16:51:55.189825 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.189755    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h84wl\""
Jul 09 16:51:55.189890 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.189853    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 16:51:55.189983 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.189966    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 16:51:55.190881 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.190817    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lb6th"]
Jul 09 16:51:55.196535 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.196515    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k6sgl"]
Jul 09 16:51:55.202150 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.202128    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5abe376b-d71f-4925-8700-3bead0cb2036-cert\") pod \"ingress-canary-k6sgl\" (UID: \"5abe376b-d71f-4925-8700-3bead0cb2036\") " pod="openshift-ingress-canary/ingress-canary-k6sgl"
Jul 09 16:51:55.202247 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.202179    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3aa101ea-5721-4a1b-8012-6a3db8efa1b9-config-volume\") pod \"dns-default-lb6th\" (UID: \"3aa101ea-5721-4a1b-8012-6a3db8efa1b9\") " pod="openshift-dns/dns-default-lb6th"
Jul 09 16:51:55.202247 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.202195    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3aa101ea-5721-4a1b-8012-6a3db8efa1b9-metrics-tls\") pod \"dns-default-lb6th\" (UID: \"3aa101ea-5721-4a1b-8012-6a3db8efa1b9\") " pod="openshift-dns/dns-default-lb6th"
Jul 09 16:51:55.202322 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.202261    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nhtf\" (UniqueName: \"kubernetes.io/projected/5abe376b-d71f-4925-8700-3bead0cb2036-kube-api-access-7nhtf\") pod \"ingress-canary-k6sgl\" (UID: \"5abe376b-d71f-4925-8700-3bead0cb2036\") " pod="openshift-ingress-canary/ingress-canary-k6sgl"
Jul 09 16:51:55.202322 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.202305    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4n52\" (UniqueName: \"kubernetes.io/projected/3aa101ea-5721-4a1b-8012-6a3db8efa1b9-kube-api-access-k4n52\") pod \"dns-default-lb6th\" (UID: \"3aa101ea-5721-4a1b-8012-6a3db8efa1b9\") " pod="openshift-dns/dns-default-lb6th"
Jul 09 16:51:55.202408 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.202326    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3aa101ea-5721-4a1b-8012-6a3db8efa1b9-tmp-dir\") pod \"dns-default-lb6th\" (UID: \"3aa101ea-5721-4a1b-8012-6a3db8efa1b9\") " pod="openshift-dns/dns-default-lb6th"
Jul 09 16:51:55.277212 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.277182    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pmvnf"]
Jul 09 16:51:55.279228 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.279205    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pmvnf"
Jul 09 16:51:55.281697 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.281673    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 16:51:55.281889 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.281843    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 16:51:55.281889 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.281877    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 16:51:55.282026 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.281890    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jjsxm\""
Jul 09 16:51:55.282078 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.282050    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 16:51:55.291401 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.291376    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pmvnf"]
Jul 09 16:51:55.302604 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.302579    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3aa101ea-5721-4a1b-8012-6a3db8efa1b9-config-volume\") pod \"dns-default-lb6th\" (UID: \"3aa101ea-5721-4a1b-8012-6a3db8efa1b9\") " pod="openshift-dns/dns-default-lb6th"
Jul 09 16:51:55.302763 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.302614    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3aa101ea-5721-4a1b-8012-6a3db8efa1b9-metrics-tls\") pod \"dns-default-lb6th\" (UID: \"3aa101ea-5721-4a1b-8012-6a3db8efa1b9\") " pod="openshift-dns/dns-default-lb6th"
Jul 09 16:51:55.302763 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.302643    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nhtf\" (UniqueName: \"kubernetes.io/projected/5abe376b-d71f-4925-8700-3bead0cb2036-kube-api-access-7nhtf\") pod \"ingress-canary-k6sgl\" (UID: \"5abe376b-d71f-4925-8700-3bead0cb2036\") " pod="openshift-ingress-canary/ingress-canary-k6sgl"
Jul 09 16:51:55.302763 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.302683    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be6d2259-b188-45f9-a2bb-024dd002ff77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pmvnf\" (UID: \"be6d2259-b188-45f9-a2bb-024dd002ff77\") " pod="openshift-insights/insights-runtime-extractor-pmvnf"
Jul 09 16:51:55.302763 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.302712    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4n52\" (UniqueName: \"kubernetes.io/projected/3aa101ea-5721-4a1b-8012-6a3db8efa1b9-kube-api-access-k4n52\") pod \"dns-default-lb6th\" (UID: \"3aa101ea-5721-4a1b-8012-6a3db8efa1b9\") " pod="openshift-dns/dns-default-lb6th"
Jul 09 16:51:55.302763 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.302735    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be6d2259-b188-45f9-a2bb-024dd002ff77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pmvnf\" (UID: \"be6d2259-b188-45f9-a2bb-024dd002ff77\") " pod="openshift-insights/insights-runtime-extractor-pmvnf"
Jul 09 16:51:55.303102 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.302765    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3aa101ea-5721-4a1b-8012-6a3db8efa1b9-tmp-dir\") pod \"dns-default-lb6th\" (UID: \"3aa101ea-5721-4a1b-8012-6a3db8efa1b9\") " pod="openshift-dns/dns-default-lb6th"
Jul 09 16:51:55.303192 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.303165    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be6d2259-b188-45f9-a2bb-024dd002ff77-data-volume\") pod \"insights-runtime-extractor-pmvnf\" (UID: \"be6d2259-b188-45f9-a2bb-024dd002ff77\") " pod="openshift-insights/insights-runtime-extractor-pmvnf"
Jul 09 16:51:55.303272 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.303215    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3aa101ea-5721-4a1b-8012-6a3db8efa1b9-config-volume\") pod \"dns-default-lb6th\" (UID: \"3aa101ea-5721-4a1b-8012-6a3db8efa1b9\") " pod="openshift-dns/dns-default-lb6th"
Jul 09 16:51:55.303272 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.303240    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be6d2259-b188-45f9-a2bb-024dd002ff77-crio-socket\") pod \"insights-runtime-extractor-pmvnf\" (UID: \"be6d2259-b188-45f9-a2bb-024dd002ff77\") " pod="openshift-insights/insights-runtime-extractor-pmvnf"
Jul 09 16:51:55.303272 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.303267    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqrb7\" (UniqueName: \"kubernetes.io/projected/be6d2259-b188-45f9-a2bb-024dd002ff77-kube-api-access-wqrb7\") pod \"insights-runtime-extractor-pmvnf\" (UID: \"be6d2259-b188-45f9-a2bb-024dd002ff77\") " pod="openshift-insights/insights-runtime-extractor-pmvnf"
Jul 09 16:51:55.303416 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.303301    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5abe376b-d71f-4925-8700-3bead0cb2036-cert\") pod \"ingress-canary-k6sgl\" (UID: \"5abe376b-d71f-4925-8700-3bead0cb2036\") " pod="openshift-ingress-canary/ingress-canary-k6sgl"
Jul 09 16:51:55.303457 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.303426    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3aa101ea-5721-4a1b-8012-6a3db8efa1b9-tmp-dir\") pod \"dns-default-lb6th\" (UID: \"3aa101ea-5721-4a1b-8012-6a3db8efa1b9\") " pod="openshift-dns/dns-default-lb6th"
Jul 09 16:51:55.307009 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.306987    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3aa101ea-5721-4a1b-8012-6a3db8efa1b9-metrics-tls\") pod \"dns-default-lb6th\" (UID: \"3aa101ea-5721-4a1b-8012-6a3db8efa1b9\") " pod="openshift-dns/dns-default-lb6th"
Jul 09 16:51:55.307125 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.307105    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5abe376b-d71f-4925-8700-3bead0cb2036-cert\") pod \"ingress-canary-k6sgl\" (UID: \"5abe376b-d71f-4925-8700-3bead0cb2036\") " pod="openshift-ingress-canary/ingress-canary-k6sgl"
Jul 09 16:51:55.310436 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.310414    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4n52\" (UniqueName: \"kubernetes.io/projected/3aa101ea-5721-4a1b-8012-6a3db8efa1b9-kube-api-access-k4n52\") pod \"dns-default-lb6th\" (UID: \"3aa101ea-5721-4a1b-8012-6a3db8efa1b9\") " pod="openshift-dns/dns-default-lb6th"
Jul 09 16:51:55.311112 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.311087    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nhtf\" (UniqueName: \"kubernetes.io/projected/5abe376b-d71f-4925-8700-3bead0cb2036-kube-api-access-7nhtf\") pod \"ingress-canary-k6sgl\" (UID: \"5abe376b-d71f-4925-8700-3bead0cb2036\") " pod="openshift-ingress-canary/ingress-canary-k6sgl"
Jul 09 16:51:55.404114 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.404032    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be6d2259-b188-45f9-a2bb-024dd002ff77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pmvnf\" (UID: \"be6d2259-b188-45f9-a2bb-024dd002ff77\") " pod="openshift-insights/insights-runtime-extractor-pmvnf"
Jul 09 16:51:55.404114 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.404072    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be6d2259-b188-45f9-a2bb-024dd002ff77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pmvnf\" (UID: \"be6d2259-b188-45f9-a2bb-024dd002ff77\") " pod="openshift-insights/insights-runtime-extractor-pmvnf"
Jul 09 16:51:55.404114 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.404095    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be6d2259-b188-45f9-a2bb-024dd002ff77-data-volume\") pod \"insights-runtime-extractor-pmvnf\" (UID: \"be6d2259-b188-45f9-a2bb-024dd002ff77\") " pod="openshift-insights/insights-runtime-extractor-pmvnf"
Jul 09 16:51:55.404306 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.404207    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be6d2259-b188-45f9-a2bb-024dd002ff77-crio-socket\") pod \"insights-runtime-extractor-pmvnf\" (UID: \"be6d2259-b188-45f9-a2bb-024dd002ff77\") " pod="openshift-insights/insights-runtime-extractor-pmvnf"
Jul 09 16:51:55.404306 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.404234    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqrb7\" (UniqueName: \"kubernetes.io/projected/be6d2259-b188-45f9-a2bb-024dd002ff77-kube-api-access-wqrb7\") pod \"insights-runtime-extractor-pmvnf\" (UID: \"be6d2259-b188-45f9-a2bb-024dd002ff77\") " pod="openshift-insights/insights-runtime-extractor-pmvnf"
Jul 09 16:51:55.404492 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.404469    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be6d2259-b188-45f9-a2bb-024dd002ff77-crio-socket\") pod \"insights-runtime-extractor-pmvnf\" (UID: \"be6d2259-b188-45f9-a2bb-024dd002ff77\") " pod="openshift-insights/insights-runtime-extractor-pmvnf"
Jul 09 16:51:55.404544 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.404528    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be6d2259-b188-45f9-a2bb-024dd002ff77-data-volume\") pod \"insights-runtime-extractor-pmvnf\" (UID: \"be6d2259-b188-45f9-a2bb-024dd002ff77\") " pod="openshift-insights/insights-runtime-extractor-pmvnf"
Jul 09 16:51:55.404688 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.404672    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be6d2259-b188-45f9-a2bb-024dd002ff77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pmvnf\" (UID: \"be6d2259-b188-45f9-a2bb-024dd002ff77\") " pod="openshift-insights/insights-runtime-extractor-pmvnf"
Jul 09 16:51:55.406420 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.406403    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be6d2259-b188-45f9-a2bb-024dd002ff77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pmvnf\" (UID: \"be6d2259-b188-45f9-a2bb-024dd002ff77\") " pod="openshift-insights/insights-runtime-extractor-pmvnf"
Jul 09 16:51:55.412579 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.412554    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqrb7\" (UniqueName: \"kubernetes.io/projected/be6d2259-b188-45f9-a2bb-024dd002ff77-kube-api-access-wqrb7\") pod \"insights-runtime-extractor-pmvnf\" (UID: \"be6d2259-b188-45f9-a2bb-024dd002ff77\") " pod="openshift-insights/insights-runtime-extractor-pmvnf"
Jul 09 16:51:55.486094 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.486055    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lb6th"
Jul 09 16:51:55.493693 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.493673    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k6sgl"
Jul 09 16:51:55.588200 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.588176    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pmvnf"
Jul 09 16:51:55.646063 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.646037    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lb6th"]
Jul 09 16:51:55.650506 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:55.650472    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa101ea_5721_4a1b_8012_6a3db8efa1b9.slice/crio-971361dc3a8bcc7baa65c4759f1fa066e5f2b80264fb5f40b03071bc1f68ea44 WatchSource:0}: Error finding container 971361dc3a8bcc7baa65c4759f1fa066e5f2b80264fb5f40b03071bc1f68ea44: Status 404 returned error can't find the container with id 971361dc3a8bcc7baa65c4759f1fa066e5f2b80264fb5f40b03071bc1f68ea44
Jul 09 16:51:55.665114 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.665064    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k6sgl"]
Jul 09 16:51:55.669232 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:55.669205    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abe376b_d71f_4925_8700_3bead0cb2036.slice/crio-0de1f67925664552b41a7cb62f0fc03c47cb05260933891978b51f985427828e WatchSource:0}: Error finding container 0de1f67925664552b41a7cb62f0fc03c47cb05260933891978b51f985427828e: Status 404 returned error can't find the container with id 0de1f67925664552b41a7cb62f0fc03c47cb05260933891978b51f985427828e
Jul 09 16:51:55.742916 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.742889    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pmvnf"]
Jul 09 16:51:55.745591 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:55.745562    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe6d2259_b188_45f9_a2bb_024dd002ff77.slice/crio-9df2900fc530cc3a0ae50f375ff2bac476aead137137b942d0377f55a598a8a0 WatchSource:0}: Error finding container 9df2900fc530cc3a0ae50f375ff2bac476aead137137b942d0377f55a598a8a0: Status 404 returned error can't find the container with id 9df2900fc530cc3a0ae50f375ff2bac476aead137137b942d0377f55a598a8a0
Jul 09 16:51:55.933379 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.933266    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:51:55.933379 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.933281    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:51:55.933604 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.933585    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:51:55.936392 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.936215    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 16:51:55.936392 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.936242    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4tqb9\""
Jul 09 16:51:55.936392 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.936271    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 16:51:55.936392 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.936287    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2fgzg\""
Jul 09 16:51:55.936998 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.936986    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 16:51:55.937039 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:55.937002    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 16:51:56.225514 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:56.225421    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k6sgl" event={"ID":"5abe376b-d71f-4925-8700-3bead0cb2036","Type":"ContainerStarted","Data":"0de1f67925664552b41a7cb62f0fc03c47cb05260933891978b51f985427828e"}
Jul 09 16:51:56.226669 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:56.226628    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lb6th" event={"ID":"3aa101ea-5721-4a1b-8012-6a3db8efa1b9","Type":"ContainerStarted","Data":"971361dc3a8bcc7baa65c4759f1fa066e5f2b80264fb5f40b03071bc1f68ea44"}
Jul 09 16:51:56.227785 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:56.227763    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pmvnf" event={"ID":"be6d2259-b188-45f9-a2bb-024dd002ff77","Type":"ContainerStarted","Data":"9df2900fc530cc3a0ae50f375ff2bac476aead137137b942d0377f55a598a8a0"}
Jul 09 16:51:56.850112 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:56.849127    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-9jmr4"]
Jul 09 16:51:56.852485 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:56.851235    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-9jmr4"
Jul 09 16:51:56.855456 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:56.854574    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 16:51:56.855456 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:56.854629    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 16:51:56.855456 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:56.854582    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4spdn\""
Jul 09 16:51:56.861516 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:56.861491    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-9jmr4"]
Jul 09 16:51:56.918880 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:56.918772    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f225t\" (UniqueName: \"kubernetes.io/projected/c1d0a170-6c31-41a3-bbda-560c76896106-kube-api-access-f225t\") pod \"downloads-68c9cbb497-9jmr4\" (UID: \"c1d0a170-6c31-41a3-bbda-560c76896106\") " pod="openshift-console/downloads-68c9cbb497-9jmr4"
Jul 09 16:51:57.020343 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:57.019940    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f225t\" (UniqueName: \"kubernetes.io/projected/c1d0a170-6c31-41a3-bbda-560c76896106-kube-api-access-f225t\") pod \"downloads-68c9cbb497-9jmr4\" (UID: \"c1d0a170-6c31-41a3-bbda-560c76896106\") " pod="openshift-console/downloads-68c9cbb497-9jmr4"
Jul 09 16:51:57.036559 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:57.031697    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f225t\" (UniqueName: \"kubernetes.io/projected/c1d0a170-6c31-41a3-bbda-560c76896106-kube-api-access-f225t\") pod \"downloads-68c9cbb497-9jmr4\" (UID: \"c1d0a170-6c31-41a3-bbda-560c76896106\") " pod="openshift-console/downloads-68c9cbb497-9jmr4"
Jul 09 16:51:57.164367 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:57.164263    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-9jmr4"
Jul 09 16:51:57.326439 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:57.326261    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-9jmr4"]
Jul 09 16:51:57.335384 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:51:57.332951    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d0a170_6c31_41a3_bbda_560c76896106.slice/crio-b036417e8138cbc145b9ffd7be30cee430f199851d1b370e671abd46b97c4dee WatchSource:0}: Error finding container b036417e8138cbc145b9ffd7be30cee430f199851d1b370e671abd46b97c4dee: Status 404 returned error can't find the container with id b036417e8138cbc145b9ffd7be30cee430f199851d1b370e671abd46b97c4dee
Jul 09 16:51:58.236158 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:51:58.236107    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-9jmr4" event={"ID":"c1d0a170-6c31-41a3-bbda-560c76896106","Type":"ContainerStarted","Data":"b036417e8138cbc145b9ffd7be30cee430f199851d1b370e671abd46b97c4dee"}
Jul 09 16:52:01.247312 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:01.247269    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pmvnf" event={"ID":"be6d2259-b188-45f9-a2bb-024dd002ff77","Type":"ContainerStarted","Data":"efaee81508c1ed741f49cfeb21a2c3e7ebc85b5d1a55e149d9f4c9384bf90447"}
Jul 09 16:52:01.250219 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:01.249806    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lb6th" event={"ID":"3aa101ea-5721-4a1b-8012-6a3db8efa1b9","Type":"ContainerStarted","Data":"e1903c2aafee9631bb4b37a2c90fecbc95701e13f9229642ceb60feea24d4320"}
Jul 09 16:52:01.250219 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:01.249857    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lb6th" event={"ID":"3aa101ea-5721-4a1b-8012-6a3db8efa1b9","Type":"ContainerStarted","Data":"098f9cf72a8d8d367cc710c8afaf35a84d83560121f300a29e68fdc8c9c8a221"}
Jul 09 16:52:01.250219 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:01.250090    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lb6th"
Jul 09 16:52:01.251758 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:01.251676    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k6sgl" event={"ID":"5abe376b-d71f-4925-8700-3bead0cb2036","Type":"ContainerStarted","Data":"d49d21bf10495c4088baee674763aac6f14c75d6547fd72c40b4b96ec66a5b91"}
Jul 09 16:52:01.269820 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:01.267659    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lb6th" podStartSLOduration=1.3006442599999999 podStartE2EDuration="6.267639391s" totalImagesPullingTime="4.966995131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:01.265143737 +0000 UTC m=+58.945559658" watchObservedRunningTime="2026-07-09 16:52:01.267639391 +0000 UTC m=+58.948055297"
Jul 09 16:52:01.282463 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:01.282395    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k6sgl" podStartSLOduration=0.953445475 podStartE2EDuration="6.282373597s" totalImagesPullingTime="5.328928122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:01.281497948 +0000 UTC m=+58.961913856" watchObservedRunningTime="2026-07-09 16:52:01.282373597 +0000 UTC m=+58.962789505"
Jul 09 16:52:02.257380 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:02.257326    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pmvnf" event={"ID":"be6d2259-b188-45f9-a2bb-024dd002ff77","Type":"ContainerStarted","Data":"b4f0f42b52451d883ff88c2d96794085ea855dfb8e300da5564b653f936cfd7e"}
Jul 09 16:52:02.936682 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:02.936641    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-686tj"]
Jul 09 16:52:02.940565 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:02.940533    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-686tj"
Jul 09 16:52:02.943483 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:02.943450    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-n6xn7\""
Jul 09 16:52:02.943623 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:02.943605    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 09 16:52:02.957155 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:02.957126    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-686tj"]
Jul 09 16:52:02.973651 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:02.973610    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/96d13014-8a81-4404-b95d-0f8aa82eaa1d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-686tj\" (UID: \"96d13014-8a81-4404-b95d-0f8aa82eaa1d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-686tj"
Jul 09 16:52:03.075143 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:03.074992    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/96d13014-8a81-4404-b95d-0f8aa82eaa1d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-686tj\" (UID: \"96d13014-8a81-4404-b95d-0f8aa82eaa1d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-686tj"
Jul 09 16:52:03.075334 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:52:03.075212    2568 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 09 16:52:03.075334 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:52:03.075286    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d13014-8a81-4404-b95d-0f8aa82eaa1d-tls-certificates podName:96d13014-8a81-4404-b95d-0f8aa82eaa1d nodeName:}" failed. No retries permitted until 2026-07-09 16:52:03.575266149 +0000 UTC m=+61.255682040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/96d13014-8a81-4404-b95d-0f8aa82eaa1d-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-686tj" (UID: "96d13014-8a81-4404-b95d-0f8aa82eaa1d") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 09 16:52:03.171373 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:03.171315    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2ng88"
Jul 09 16:52:03.580348 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:03.580247    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/96d13014-8a81-4404-b95d-0f8aa82eaa1d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-686tj\" (UID: \"96d13014-8a81-4404-b95d-0f8aa82eaa1d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-686tj"
Jul 09 16:52:03.580781 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:52:03.580452    2568 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 09 16:52:03.580781 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:52:03.580533    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d13014-8a81-4404-b95d-0f8aa82eaa1d-tls-certificates podName:96d13014-8a81-4404-b95d-0f8aa82eaa1d nodeName:}" failed. No retries permitted until 2026-07-09 16:52:04.580512214 +0000 UTC m=+62.260928107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/96d13014-8a81-4404-b95d-0f8aa82eaa1d-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-686tj" (UID: "96d13014-8a81-4404-b95d-0f8aa82eaa1d") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 09 16:52:04.590880 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:04.590848    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/96d13014-8a81-4404-b95d-0f8aa82eaa1d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-686tj\" (UID: \"96d13014-8a81-4404-b95d-0f8aa82eaa1d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-686tj"
Jul 09 16:52:04.593270 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:04.593244    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/96d13014-8a81-4404-b95d-0f8aa82eaa1d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-686tj\" (UID: \"96d13014-8a81-4404-b95d-0f8aa82eaa1d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-686tj"
Jul 09 16:52:04.752106 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:04.752072    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-686tj"
Jul 09 16:52:04.894972 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:04.894939    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-686tj"]
Jul 09 16:52:04.898792 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:52:04.898762    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d13014_8a81_4404_b95d_0f8aa82eaa1d.slice/crio-a1d4bb353030ec67b43917512bed53704571b3ecec8752a505185ace97141e7a WatchSource:0}: Error finding container a1d4bb353030ec67b43917512bed53704571b3ecec8752a505185ace97141e7a: Status 404 returned error can't find the container with id a1d4bb353030ec67b43917512bed53704571b3ecec8752a505185ace97141e7a
Jul 09 16:52:05.271277 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:05.271183    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pmvnf" event={"ID":"be6d2259-b188-45f9-a2bb-024dd002ff77","Type":"ContainerStarted","Data":"2ffb45a61d161663fe9653e60d748a385c13d9a90601e1e9eb84c3e43ad4c96a"}
Jul 09 16:52:05.272528 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:05.272506    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-686tj" event={"ID":"96d13014-8a81-4404-b95d-0f8aa82eaa1d","Type":"ContainerStarted","Data":"a1d4bb353030ec67b43917512bed53704571b3ecec8752a505185ace97141e7a"}
Jul 09 16:52:05.288687 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:05.288631    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pmvnf" podStartSLOduration=1.5271247529999998 podStartE2EDuration="10.288616674s" totalImagesPullingTime="8.761491921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:05.288503351 +0000 UTC m=+62.968919256" watchObservedRunningTime="2026-07-09 16:52:05.288616674 +0000 UTC m=+62.969032581"
Jul 09 16:52:07.280881 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:07.280845    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-686tj" event={"ID":"96d13014-8a81-4404-b95d-0f8aa82eaa1d","Type":"ContainerStarted","Data":"b67c11e8ed546dc7a0d8ebd55254dfa12e4ea6e3156cda74a78b01c9afe68482"}
Jul 09 16:52:07.281318 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:07.281127    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-686tj"
Jul 09 16:52:07.286820 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:07.286793    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-686tj"
Jul 09 16:52:07.296464 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:07.296422    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-686tj" podStartSLOduration=3.793583657 podStartE2EDuration="5.296408457s" totalImagesPullingTime="1.5028248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:07.295542893 +0000 UTC m=+64.975958802" watchObservedRunningTime="2026-07-09 16:52:07.296408457 +0000 UTC m=+64.976824343"
Jul 09 16:52:07.982267 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:07.982230    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-dbms7"]
Jul 09 16:52:07.984344 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:07.984325    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-dbms7"
Jul 09 16:52:07.986804 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:07.986780    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 09 16:52:07.986905 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:07.986782    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 09 16:52:07.987921 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:07.987903    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 16:52:07.988167 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:07.988147    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 16:52:07.988265 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:07.988193    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 16:52:07.988335 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:07.988277    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-m8z9z\""
Jul 09 16:52:07.999709 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:07.999684    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-dbms7"]
Jul 09 16:52:08.118851 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.118815    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3973f9fa-f1e4-4669-b3dc-82383a96ffc4-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-dbms7\" (UID: \"3973f9fa-f1e4-4669-b3dc-82383a96ffc4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbms7"
Jul 09 16:52:08.119024 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.118867    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3973f9fa-f1e4-4669-b3dc-82383a96ffc4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-dbms7\" (UID: \"3973f9fa-f1e4-4669-b3dc-82383a96ffc4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbms7"
Jul 09 16:52:08.119024 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.118932    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3973f9fa-f1e4-4669-b3dc-82383a96ffc4-metrics-client-ca\") pod \"prometheus-operator-64785b6675-dbms7\" (UID: \"3973f9fa-f1e4-4669-b3dc-82383a96ffc4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbms7"
Jul 09 16:52:08.119024 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.118979    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqw7p\" (UniqueName: \"kubernetes.io/projected/3973f9fa-f1e4-4669-b3dc-82383a96ffc4-kube-api-access-xqw7p\") pod \"prometheus-operator-64785b6675-dbms7\" (UID: \"3973f9fa-f1e4-4669-b3dc-82383a96ffc4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbms7"
Jul 09 16:52:08.219590 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.219554    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3973f9fa-f1e4-4669-b3dc-82383a96ffc4-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-dbms7\" (UID: \"3973f9fa-f1e4-4669-b3dc-82383a96ffc4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbms7"
Jul 09 16:52:08.219848 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.219603    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3973f9fa-f1e4-4669-b3dc-82383a96ffc4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-dbms7\" (UID: \"3973f9fa-f1e4-4669-b3dc-82383a96ffc4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbms7"
Jul 09 16:52:08.219848 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.219675    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3973f9fa-f1e4-4669-b3dc-82383a96ffc4-metrics-client-ca\") pod \"prometheus-operator-64785b6675-dbms7\" (UID: \"3973f9fa-f1e4-4669-b3dc-82383a96ffc4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbms7"
Jul 09 16:52:08.219848 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.219730    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqw7p\" (UniqueName: \"kubernetes.io/projected/3973f9fa-f1e4-4669-b3dc-82383a96ffc4-kube-api-access-xqw7p\") pod \"prometheus-operator-64785b6675-dbms7\" (UID: \"3973f9fa-f1e4-4669-b3dc-82383a96ffc4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbms7"
Jul 09 16:52:08.220530 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.220506    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3973f9fa-f1e4-4669-b3dc-82383a96ffc4-metrics-client-ca\") pod \"prometheus-operator-64785b6675-dbms7\" (UID: \"3973f9fa-f1e4-4669-b3dc-82383a96ffc4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbms7"
Jul 09 16:52:08.222286 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.222258    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3973f9fa-f1e4-4669-b3dc-82383a96ffc4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-dbms7\" (UID: \"3973f9fa-f1e4-4669-b3dc-82383a96ffc4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbms7"
Jul 09 16:52:08.222476 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.222452    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3973f9fa-f1e4-4669-b3dc-82383a96ffc4-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-dbms7\" (UID: \"3973f9fa-f1e4-4669-b3dc-82383a96ffc4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbms7"
Jul 09 16:52:08.228229 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.228188    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqw7p\" (UniqueName: \"kubernetes.io/projected/3973f9fa-f1e4-4669-b3dc-82383a96ffc4-kube-api-access-xqw7p\") pod \"prometheus-operator-64785b6675-dbms7\" (UID: \"3973f9fa-f1e4-4669-b3dc-82383a96ffc4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbms7"
Jul 09 16:52:08.295470 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.295382    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-dbms7"
Jul 09 16:52:08.622534 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.622488    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8l5n\" (UniqueName: \"kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n\") pod \"network-check-target-vwcc7\" (UID: \"f4928566-2544-41f6-805a-f6ecd54be679\") " pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:52:08.622819 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.622596    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs\") pod \"network-metrics-daemon-9bf8d\" (UID: \"ab2233de-a681-4b2a-a1f2-5e1481714409\") " pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:52:08.622819 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.622621    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret\") pod \"global-pull-secret-syncer-glkgj\" (UID: \"6a171ab4-4ad7-4670-8baf-99e5ba09c225\") " pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:52:08.625196 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.625173    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 16:52:08.625322 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.625223    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 16:52:08.625322 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.625242    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 16:52:08.635745 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.635477    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 16:52:08.635985 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.635965    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a171ab4-4ad7-4670-8baf-99e5ba09c225-original-pull-secret\") pod \"global-pull-secret-syncer-glkgj\" (UID: \"6a171ab4-4ad7-4670-8baf-99e5ba09c225\") " pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:52:08.636059 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.636005    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2233de-a681-4b2a-a1f2-5e1481714409-metrics-certs\") pod \"network-metrics-daemon-9bf8d\" (UID: \"ab2233de-a681-4b2a-a1f2-5e1481714409\") " pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:52:08.645823 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.645799    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8l5n\" (UniqueName: \"kubernetes.io/projected/f4928566-2544-41f6-805a-f6ecd54be679-kube-api-access-q8l5n\") pod \"network-check-target-vwcc7\" (UID: \"f4928566-2544-41f6-805a-f6ecd54be679\") " pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:52:08.845989 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.845953    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2fgzg\""
Jul 09 16:52:08.851880 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.851845    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4tqb9\""
Jul 09 16:52:08.853843 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.853820    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:52:08.853979 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.853825    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-glkgj"
Jul 09 16:52:08.859318 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:08.859299    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9bf8d"
Jul 09 16:52:09.576048 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.576015    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67f66d9b5-f4qzm"]
Jul 09 16:52:09.578109 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.578084    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:09.581672 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.581648    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 16:52:09.581804 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.581676    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 16:52:09.581804 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.581682    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8z4lj\""
Jul 09 16:52:09.581804 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.581690    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 16:52:09.581804 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.581728    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 16:52:09.581804 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.581649    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 16:52:09.593892 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.593852    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f66d9b5-f4qzm"]
Jul 09 16:52:09.630234 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.630188    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-console-serving-cert\") pod \"console-67f66d9b5-f4qzm\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") " pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:09.630234 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.630234    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-oauth-serving-cert\") pod \"console-67f66d9b5-f4qzm\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") " pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:09.630472 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.630268    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2k2c\" (UniqueName: \"kubernetes.io/projected/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-kube-api-access-s2k2c\") pod \"console-67f66d9b5-f4qzm\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") " pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:09.630472 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.630304    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-console-oauth-config\") pod \"console-67f66d9b5-f4qzm\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") " pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:09.630472 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.630338    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-service-ca\") pod \"console-67f66d9b5-f4qzm\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") " pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:09.630472 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.630390    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-console-config\") pod \"console-67f66d9b5-f4qzm\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") " pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:09.731754 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.731717    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-console-oauth-config\") pod \"console-67f66d9b5-f4qzm\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") " pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:09.731958 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.731774    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-service-ca\") pod \"console-67f66d9b5-f4qzm\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") " pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:09.731958 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.731813    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-console-config\") pod \"console-67f66d9b5-f4qzm\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") " pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:09.731958 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.731855    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-console-serving-cert\") pod \"console-67f66d9b5-f4qzm\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") " pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:09.731958 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.731880    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-oauth-serving-cert\") pod \"console-67f66d9b5-f4qzm\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") " pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:09.732179 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.731991    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2k2c\" (UniqueName: \"kubernetes.io/projected/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-kube-api-access-s2k2c\") pod \"console-67f66d9b5-f4qzm\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") " pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:09.732817 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.732788    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-console-config\") pod \"console-67f66d9b5-f4qzm\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") " pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:09.732945 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.732794    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-service-ca\") pod \"console-67f66d9b5-f4qzm\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") " pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:09.733012 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.732955    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-oauth-serving-cert\") pod \"console-67f66d9b5-f4qzm\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") " pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:09.734595 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.734574    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-console-oauth-config\") pod \"console-67f66d9b5-f4qzm\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") " pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:09.734693 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.734624    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-console-serving-cert\") pod \"console-67f66d9b5-f4qzm\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") " pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:09.741112 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.741087    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2k2c\" (UniqueName: \"kubernetes.io/projected/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-kube-api-access-s2k2c\") pod \"console-67f66d9b5-f4qzm\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") " pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:09.891276 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:09.891189    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:11.260234 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:11.260203    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lb6th"
Jul 09 16:52:15.426540 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:15.426505    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-glkgj"]
Jul 09 16:52:15.525935 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:52:15.525864    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a171ab4_4ad7_4670_8baf_99e5ba09c225.slice/crio-9aed9bd47bdda9e5c45db3ba3552e21b77391ba0936b592cace943c88d282d1b WatchSource:0}: Error finding container 9aed9bd47bdda9e5c45db3ba3552e21b77391ba0936b592cace943c88d282d1b: Status 404 returned error can't find the container with id 9aed9bd47bdda9e5c45db3ba3552e21b77391ba0936b592cace943c88d282d1b
Jul 09 16:52:15.653098 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:15.653056    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-dbms7"]
Jul 09 16:52:15.656529 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:52:15.656420    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3973f9fa_f1e4_4669_b3dc_82383a96ffc4.slice/crio-0dfe5dd9749a0522c2203215eb49146eb7e372a45a3253c13248887b5ca64ce7 WatchSource:0}: Error finding container 0dfe5dd9749a0522c2203215eb49146eb7e372a45a3253c13248887b5ca64ce7: Status 404 returned error can't find the container with id 0dfe5dd9749a0522c2203215eb49146eb7e372a45a3253c13248887b5ca64ce7
Jul 09 16:52:15.656716 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:15.656583    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vwcc7"]
Jul 09 16:52:15.657584 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:15.657453    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9bf8d"]
Jul 09 16:52:15.658377 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:15.658269    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f66d9b5-f4qzm"]
Jul 09 16:52:15.660024 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:52:15.660004    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab2233de_a681_4b2a_a1f2_5e1481714409.slice/crio-78c5abdcd45c2a4b5212bfa29bb6c99686f51f34b2809b0dc8202ce5d68537b1 WatchSource:0}: Error finding container 78c5abdcd45c2a4b5212bfa29bb6c99686f51f34b2809b0dc8202ce5d68537b1: Status 404 returned error can't find the container with id 78c5abdcd45c2a4b5212bfa29bb6c99686f51f34b2809b0dc8202ce5d68537b1
Jul 09 16:52:15.660650 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:52:15.660632    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4928566_2544_41f6_805a_f6ecd54be679.slice/crio-9894aa2f8cdf171c7ecf711e6e15df54aa7d52dab4b02361845cc4f1a6beb2b2 WatchSource:0}: Error finding container 9894aa2f8cdf171c7ecf711e6e15df54aa7d52dab4b02361845cc4f1a6beb2b2: Status 404 returned error can't find the container with id 9894aa2f8cdf171c7ecf711e6e15df54aa7d52dab4b02361845cc4f1a6beb2b2
Jul 09 16:52:15.666264 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:52:15.666245    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec3f55a_cfff_4ba7_b214_8c00556d9d2b.slice/crio-eec02d1cadaaa70d4380acd0649465f9b2196b70a9049934313d1e17590ab839 WatchSource:0}: Error finding container eec02d1cadaaa70d4380acd0649465f9b2196b70a9049934313d1e17590ab839: Status 404 returned error can't find the container with id eec02d1cadaaa70d4380acd0649465f9b2196b70a9049934313d1e17590ab839
Jul 09 16:52:16.316608 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:16.316524    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f66d9b5-f4qzm" event={"ID":"dec3f55a-cfff-4ba7-b214-8c00556d9d2b","Type":"ContainerStarted","Data":"eec02d1cadaaa70d4380acd0649465f9b2196b70a9049934313d1e17590ab839"}
Jul 09 16:52:16.321504 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:16.321436    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-glkgj" event={"ID":"6a171ab4-4ad7-4670-8baf-99e5ba09c225","Type":"ContainerStarted","Data":"9aed9bd47bdda9e5c45db3ba3552e21b77391ba0936b592cace943c88d282d1b"}
Jul 09 16:52:16.324511 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:16.324444    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vwcc7" event={"ID":"f4928566-2544-41f6-805a-f6ecd54be679","Type":"ContainerStarted","Data":"9894aa2f8cdf171c7ecf711e6e15df54aa7d52dab4b02361845cc4f1a6beb2b2"}
Jul 09 16:52:16.326019 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:16.325952    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-dbms7" event={"ID":"3973f9fa-f1e4-4669-b3dc-82383a96ffc4","Type":"ContainerStarted","Data":"0dfe5dd9749a0522c2203215eb49146eb7e372a45a3253c13248887b5ca64ce7"}
Jul 09 16:52:16.329434 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:16.328428    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-9jmr4" event={"ID":"c1d0a170-6c31-41a3-bbda-560c76896106","Type":"ContainerStarted","Data":"b64aa156124edc159ade2bcc0f0dc674fc67ce0eeb6d263ed48cdde672c75a1c"}
Jul 09 16:52:16.329434 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:16.329378    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-9jmr4"
Jul 09 16:52:16.334836 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:16.334807    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9bf8d" event={"ID":"ab2233de-a681-4b2a-a1f2-5e1481714409","Type":"ContainerStarted","Data":"78c5abdcd45c2a4b5212bfa29bb6c99686f51f34b2809b0dc8202ce5d68537b1"}
Jul 09 16:52:16.348847 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:16.348784    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-9jmr4" podStartSLOduration=2.098999239 podStartE2EDuration="20.348763395s" totalImagesPullingTime="18.249764156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:16.347015623 +0000 UTC m=+74.027431531" watchObservedRunningTime="2026-07-09 16:52:16.348763395 +0000 UTC m=+74.029179305"
Jul 09 16:52:16.349462 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:16.349376    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-9jmr4"
Jul 09 16:52:17.579095 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.579061    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-659fb76f4c-lf6fd"]
Jul 09 16:52:17.602093 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.601545    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-659fb76f4c-lf6fd"]
Jul 09 16:52:17.602093 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.601666    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.614172 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.614023    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 16:52:17.700717 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.700680    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-trusted-ca-bundle\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.700903 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.700729    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-console-config\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.700903 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.700765    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3df3cb58-cf25-43fc-a28d-3743cedef1e9-console-oauth-config\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.700903 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.700815    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvgpz\" (UniqueName: \"kubernetes.io/projected/3df3cb58-cf25-43fc-a28d-3743cedef1e9-kube-api-access-nvgpz\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.700903 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.700851    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3df3cb58-cf25-43fc-a28d-3743cedef1e9-console-serving-cert\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.700903 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.700878    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-oauth-serving-cert\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.701134 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.700907    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-service-ca\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.803201 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.802342    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-console-config\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.803201 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.802414    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3df3cb58-cf25-43fc-a28d-3743cedef1e9-console-oauth-config\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.803201 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.802461    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvgpz\" (UniqueName: \"kubernetes.io/projected/3df3cb58-cf25-43fc-a28d-3743cedef1e9-kube-api-access-nvgpz\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.803201 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.802494    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3df3cb58-cf25-43fc-a28d-3743cedef1e9-console-serving-cert\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.803201 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.802523    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-oauth-serving-cert\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.803201 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.802549    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-service-ca\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.803201 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.802591    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-trusted-ca-bundle\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.803703 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.803273    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-console-config\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.805068 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.804299    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-oauth-serving-cert\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.805068 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.804869    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-service-ca\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.805553 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.805501    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-trusted-ca-bundle\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.827332 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.826884    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvgpz\" (UniqueName: \"kubernetes.io/projected/3df3cb58-cf25-43fc-a28d-3743cedef1e9-kube-api-access-nvgpz\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.827332 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.827282    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3df3cb58-cf25-43fc-a28d-3743cedef1e9-console-oauth-config\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.828495 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.828442    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3df3cb58-cf25-43fc-a28d-3743cedef1e9-console-serving-cert\") pod \"console-659fb76f4c-lf6fd\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") " pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:17.919325 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:17.918984    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:22.393836 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:22.393759    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-659fb76f4c-lf6fd"]
Jul 09 16:52:24.145467 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:52:24.145437    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3df3cb58_cf25_43fc_a28d_3743cedef1e9.slice/crio-9205058168a5e335662157199c63d253b580f5a00da1489bd05af93238d053b1 WatchSource:0}: Error finding container 9205058168a5e335662157199c63d253b580f5a00da1489bd05af93238d053b1: Status 404 returned error can't find the container with id 9205058168a5e335662157199c63d253b580f5a00da1489bd05af93238d053b1
Jul 09 16:52:24.374716 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:24.374612    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f66d9b5-f4qzm" event={"ID":"dec3f55a-cfff-4ba7-b214-8c00556d9d2b","Type":"ContainerStarted","Data":"5890e14af98df14cf037419669759205ca5af52e649c712e5623cabece7e5058"}
Jul 09 16:52:24.379824 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:24.379738    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-dbms7" event={"ID":"3973f9fa-f1e4-4669-b3dc-82383a96ffc4","Type":"ContainerStarted","Data":"3479e8f1cde2815ad0acc4a91d790fd1aa8240651d8b76f037a9c289dc0c3b49"}
Jul 09 16:52:24.381737 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:24.381667    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9bf8d" event={"ID":"ab2233de-a681-4b2a-a1f2-5e1481714409","Type":"ContainerStarted","Data":"33bf602d0011548809fc544b75ed64e8dc43522e0def7da6ef1d8bf42c9fb8fe"}
Jul 09 16:52:24.383418 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:24.383398    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659fb76f4c-lf6fd" event={"ID":"3df3cb58-cf25-43fc-a28d-3743cedef1e9","Type":"ContainerStarted","Data":"c6eaff05630aeae1e0b713d79a2d6bd1e3500ae1c2574c9af98875a2027a19cf"}
Jul 09 16:52:24.383559 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:24.383439    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659fb76f4c-lf6fd" event={"ID":"3df3cb58-cf25-43fc-a28d-3743cedef1e9","Type":"ContainerStarted","Data":"9205058168a5e335662157199c63d253b580f5a00da1489bd05af93238d053b1"}
Jul 09 16:52:25.388825 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:25.388789    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9bf8d" event={"ID":"ab2233de-a681-4b2a-a1f2-5e1481714409","Type":"ContainerStarted","Data":"b9e69a11c7b8bd525dec54281c19a1ab4ed80d7ad4d9dc12709333ecdcec34c5"}
Jul 09 16:52:25.390207 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:25.390180    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-glkgj" event={"ID":"6a171ab4-4ad7-4670-8baf-99e5ba09c225","Type":"ContainerStarted","Data":"84a17d31857521e7dc21cd3d5dc2188027c25ef7dc01269f2fbb578b3f370868"}
Jul 09 16:52:25.391481 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:25.391459    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vwcc7" event={"ID":"f4928566-2544-41f6-805a-f6ecd54be679","Type":"ContainerStarted","Data":"294862ef6e0957cee26ac68cc10c0f17e930385a5cbc82453d7ad3e2ef78c060"}
Jul 09 16:52:25.391575 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:25.391555    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:52:25.393193 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:25.393171    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-dbms7" event={"ID":"3973f9fa-f1e4-4669-b3dc-82383a96ffc4","Type":"ContainerStarted","Data":"1457796c295dbdb3090f32515296a2eb79abb5aa5a495f220743081c712ca2a1"}
Jul 09 16:52:25.407955 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:25.407899    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9bf8d" podStartSLOduration=72.925521612 podStartE2EDuration="1m21.407882039s" totalImagesPullingTime="8.482360427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:25.406737591 +0000 UTC m=+83.087153498" watchObservedRunningTime="2026-07-09 16:52:25.407882039 +0000 UTC m=+83.088297948"
Jul 09 16:52:25.423158 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:25.423113    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-659fb76f4c-lf6fd" podStartSLOduration=8.423098201 podStartE2EDuration="8.423098201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:52:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:25.422555168 +0000 UTC m=+83.102971080" watchObservedRunningTime="2026-07-09 16:52:25.423098201 +0000 UTC m=+83.103514100"
Jul 09 16:52:25.437776 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:25.437725    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vwcc7" podStartSLOduration=73.901698779 podStartE2EDuration="1m22.437708585s" totalImagesPullingTime="8.536009806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:25.437113243 +0000 UTC m=+83.117529151" watchObservedRunningTime="2026-07-09 16:52:25.437708585 +0000 UTC m=+83.118124493"
Jul 09 16:52:25.453077 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:25.453027    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-glkgj" podStartSLOduration=72.500039741 podStartE2EDuration="1m21.453011361s" totalImagesPullingTime="8.95297162s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:25.452649985 +0000 UTC m=+83.133065893" watchObservedRunningTime="2026-07-09 16:52:25.453011361 +0000 UTC m=+83.133427268"
Jul 09 16:52:25.472529 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:25.472478    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-dbms7" podStartSLOduration=9.987793135 podStartE2EDuration="18.472458442s" totalImagesPullingTime="8.484665307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:25.47241023 +0000 UTC m=+83.152826139" watchObservedRunningTime="2026-07-09 16:52:25.472458442 +0000 UTC m=+83.152874351"
Jul 09 16:52:25.500117 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:25.500067    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67f66d9b5-f4qzm" podStartSLOduration=7.98154951 podStartE2EDuration="16.500050857s" totalImagesPullingTime="8.518501347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:52:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:25.498717047 +0000 UTC m=+83.179132952" watchObservedRunningTime="2026-07-09 16:52:25.500050857 +0000 UTC m=+83.180466765"
Jul 09 16:52:27.920129 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:27.920089    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:27.920578 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:27.920157    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:27.924901 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:27.924880    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:28.408003 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:28.407974    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:52:28.454773 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:28.454743    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67f66d9b5-f4qzm"]
Jul 09 16:52:29.891474 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:29.891445    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:31.474423 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.474389    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q"]
Jul 09 16:52:31.525691 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.525664    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-c28lm"]
Jul 09 16:52:31.525866 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.525796    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q"
Jul 09 16:52:31.528347 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.528323    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 09 16:52:31.528481 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.528333    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 09 16:52:31.528481 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.528333    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-g5tmj\""
Jul 09 16:52:31.540742 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.540717    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q"]
Jul 09 16:52:31.540839 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.540753    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-c28lm"]
Jul 09 16:52:31.540879 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.540833    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:31.540879 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.540855    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wk2f2"]
Jul 09 16:52:31.543396 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.543375    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 09 16:52:31.543396 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.543386    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 09 16:52:31.543578 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.543547    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 09 16:52:31.543636 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.543576    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qv27b\""
Jul 09 16:52:31.555695 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.555676    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.558468 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.558452    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 16:52:31.558468 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.558462    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b9wdr\""
Jul 09 16:52:31.559500 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.559485    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 16:52:31.559576 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.559505    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 16:52:31.620674 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.620638    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bc2e3be-bfc1-459a-918f-7db3cd6ac335-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-ksc9q\" (UID: \"0bc2e3be-bfc1-459a-918f-7db3cd6ac335\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q"
Jul 09 16:52:31.620844 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.620676    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwmhj\" (UniqueName: \"kubernetes.io/projected/0bc2e3be-bfc1-459a-918f-7db3cd6ac335-kube-api-access-qwmhj\") pod \"openshift-state-metrics-84bd68b896-ksc9q\" (UID: \"0bc2e3be-bfc1-459a-918f-7db3cd6ac335\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q"
Jul 09 16:52:31.620844 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.620751    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bc2e3be-bfc1-459a-918f-7db3cd6ac335-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-ksc9q\" (UID: \"0bc2e3be-bfc1-459a-918f-7db3cd6ac335\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q"
Jul 09 16:52:31.620844 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.620824    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0bc2e3be-bfc1-459a-918f-7db3cd6ac335-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-ksc9q\" (UID: \"0bc2e3be-bfc1-459a-918f-7db3cd6ac335\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q"
Jul 09 16:52:31.721533 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.721504    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ad2886b-2a4c-4956-9016-750c52c4bb95-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-c28lm\" (UID: \"5ad2886b-2a4c-4956-9016-750c52c4bb95\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:31.721696 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.721550    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ad2886b-2a4c-4956-9016-750c52c4bb95-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-c28lm\" (UID: \"5ad2886b-2a4c-4956-9016-750c52c4bb95\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:31.721696 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.721601    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/249f6bd1-f57e-4480-9879-c013393983bb-node-exporter-textfile\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.721696 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.721624    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/249f6bd1-f57e-4480-9879-c013393983bb-node-exporter-wtmp\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.721696 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.721676    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ad2886b-2a4c-4956-9016-750c52c4bb95-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-c28lm\" (UID: \"5ad2886b-2a4c-4956-9016-750c52c4bb95\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:31.721886 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.721705    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0bc2e3be-bfc1-459a-918f-7db3cd6ac335-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-ksc9q\" (UID: \"0bc2e3be-bfc1-459a-918f-7db3cd6ac335\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q"
Jul 09 16:52:31.721886 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.721732    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/249f6bd1-f57e-4480-9879-c013393983bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.721886 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.721759    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/249f6bd1-f57e-4480-9879-c013393983bb-metrics-client-ca\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.721886 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:52:31.721854    2568 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 09 16:52:31.722082 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.721859    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/249f6bd1-f57e-4480-9879-c013393983bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.722082 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:52:31.721943    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bc2e3be-bfc1-459a-918f-7db3cd6ac335-openshift-state-metrics-tls podName:0bc2e3be-bfc1-459a-918f-7db3cd6ac335 nodeName:}" failed. No retries permitted until 2026-07-09 16:52:32.221918633 +0000 UTC m=+89.902334532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0bc2e3be-bfc1-459a-918f-7db3cd6ac335-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-ksc9q" (UID: "0bc2e3be-bfc1-459a-918f-7db3cd6ac335") : secret "openshift-state-metrics-tls" not found
Jul 09 16:52:31.722082 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.721985    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/249f6bd1-f57e-4480-9879-c013393983bb-root\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.722082 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.722022    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bc2e3be-bfc1-459a-918f-7db3cd6ac335-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-ksc9q\" (UID: \"0bc2e3be-bfc1-459a-918f-7db3cd6ac335\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q"
Jul 09 16:52:31.722082 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.722051    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwmhj\" (UniqueName: \"kubernetes.io/projected/0bc2e3be-bfc1-459a-918f-7db3cd6ac335-kube-api-access-qwmhj\") pod \"openshift-state-metrics-84bd68b896-ksc9q\" (UID: \"0bc2e3be-bfc1-459a-918f-7db3cd6ac335\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q"
Jul 09 16:52:31.722291 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.722085    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5ad2886b-2a4c-4956-9016-750c52c4bb95-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-c28lm\" (UID: \"5ad2886b-2a4c-4956-9016-750c52c4bb95\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:31.722291 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.722116    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzmdp\" (UniqueName: \"kubernetes.io/projected/5ad2886b-2a4c-4956-9016-750c52c4bb95-kube-api-access-tzmdp\") pod \"kube-state-metrics-785778ff74-c28lm\" (UID: \"5ad2886b-2a4c-4956-9016-750c52c4bb95\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:31.722291 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.722143    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw9nc\" (UniqueName: \"kubernetes.io/projected/249f6bd1-f57e-4480-9879-c013393983bb-kube-api-access-sw9nc\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.722291 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.722202    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5ad2886b-2a4c-4956-9016-750c52c4bb95-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-c28lm\" (UID: \"5ad2886b-2a4c-4956-9016-750c52c4bb95\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:31.722291 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.722238    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/249f6bd1-f57e-4480-9879-c013393983bb-node-exporter-tls\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.722291 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.722284    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/249f6bd1-f57e-4480-9879-c013393983bb-sys\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.722523 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.722316    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bc2e3be-bfc1-459a-918f-7db3cd6ac335-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-ksc9q\" (UID: \"0bc2e3be-bfc1-459a-918f-7db3cd6ac335\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q"
Jul 09 16:52:31.722785 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.722760    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bc2e3be-bfc1-459a-918f-7db3cd6ac335-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-ksc9q\" (UID: \"0bc2e3be-bfc1-459a-918f-7db3cd6ac335\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q"
Jul 09 16:52:31.724953 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.724898    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bc2e3be-bfc1-459a-918f-7db3cd6ac335-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-ksc9q\" (UID: \"0bc2e3be-bfc1-459a-918f-7db3cd6ac335\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q"
Jul 09 16:52:31.731833 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.731811    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwmhj\" (UniqueName: \"kubernetes.io/projected/0bc2e3be-bfc1-459a-918f-7db3cd6ac335-kube-api-access-qwmhj\") pod \"openshift-state-metrics-84bd68b896-ksc9q\" (UID: \"0bc2e3be-bfc1-459a-918f-7db3cd6ac335\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q"
Jul 09 16:52:31.823585 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.823549    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/249f6bd1-f57e-4480-9879-c013393983bb-sys\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.823765 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.823593    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ad2886b-2a4c-4956-9016-750c52c4bb95-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-c28lm\" (UID: \"5ad2886b-2a4c-4956-9016-750c52c4bb95\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:31.823765 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.823677    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/249f6bd1-f57e-4480-9879-c013393983bb-sys\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.823765 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:52:31.823695    2568 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 09 16:52:31.823765 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.823724    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ad2886b-2a4c-4956-9016-750c52c4bb95-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-c28lm\" (UID: \"5ad2886b-2a4c-4956-9016-750c52c4bb95\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:31.823765 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:52:31.823752    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ad2886b-2a4c-4956-9016-750c52c4bb95-kube-state-metrics-tls podName:5ad2886b-2a4c-4956-9016-750c52c4bb95 nodeName:}" failed. No retries permitted until 2026-07-09 16:52:32.323736299 +0000 UTC m=+90.004152186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5ad2886b-2a4c-4956-9016-750c52c4bb95-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-c28lm" (UID: "5ad2886b-2a4c-4956-9016-750c52c4bb95") : secret "kube-state-metrics-tls" not found
Jul 09 16:52:31.824041 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.823868    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/249f6bd1-f57e-4480-9879-c013393983bb-node-exporter-textfile\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.824041 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.823902    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/249f6bd1-f57e-4480-9879-c013393983bb-node-exporter-wtmp\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.824041 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.823928    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ad2886b-2a4c-4956-9016-750c52c4bb95-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-c28lm\" (UID: \"5ad2886b-2a4c-4956-9016-750c52c4bb95\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:31.824041 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.823956    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/249f6bd1-f57e-4480-9879-c013393983bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.824041 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.823991    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/249f6bd1-f57e-4480-9879-c013393983bb-metrics-client-ca\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.824041 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.824010    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/249f6bd1-f57e-4480-9879-c013393983bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.824041 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.824038    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/249f6bd1-f57e-4480-9879-c013393983bb-node-exporter-wtmp\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.824417 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.824057    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/249f6bd1-f57e-4480-9879-c013393983bb-root\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.824417 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.824109    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5ad2886b-2a4c-4956-9016-750c52c4bb95-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-c28lm\" (UID: \"5ad2886b-2a4c-4956-9016-750c52c4bb95\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:31.824417 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.824138    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzmdp\" (UniqueName: \"kubernetes.io/projected/5ad2886b-2a4c-4956-9016-750c52c4bb95-kube-api-access-tzmdp\") pod \"kube-state-metrics-785778ff74-c28lm\" (UID: \"5ad2886b-2a4c-4956-9016-750c52c4bb95\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:31.824417 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.824161    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw9nc\" (UniqueName: \"kubernetes.io/projected/249f6bd1-f57e-4480-9879-c013393983bb-kube-api-access-sw9nc\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.824417 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.824209    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5ad2886b-2a4c-4956-9016-750c52c4bb95-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-c28lm\" (UID: \"5ad2886b-2a4c-4956-9016-750c52c4bb95\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:31.824417 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.824238    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/249f6bd1-f57e-4480-9879-c013393983bb-node-exporter-tls\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.824417 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.824253    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/249f6bd1-f57e-4480-9879-c013393983bb-node-exporter-textfile\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.824417 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:52:31.824394    2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 09 16:52:31.824870 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:52:31.824449    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/249f6bd1-f57e-4480-9879-c013393983bb-node-exporter-tls podName:249f6bd1-f57e-4480-9879-c013393983bb nodeName:}" failed. No retries permitted until 2026-07-09 16:52:32.324431224 +0000 UTC m=+90.004847129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/249f6bd1-f57e-4480-9879-c013393983bb-node-exporter-tls") pod "node-exporter-wk2f2" (UID: "249f6bd1-f57e-4480-9879-c013393983bb") : secret "node-exporter-tls" not found
Jul 09 16:52:31.824870 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.824498    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/249f6bd1-f57e-4480-9879-c013393983bb-root\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.824870 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.824533    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5ad2886b-2a4c-4956-9016-750c52c4bb95-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-c28lm\" (UID: \"5ad2886b-2a4c-4956-9016-750c52c4bb95\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:31.824870 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.824828    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ad2886b-2a4c-4956-9016-750c52c4bb95-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-c28lm\" (UID: \"5ad2886b-2a4c-4956-9016-750c52c4bb95\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:31.825079 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.824929    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5ad2886b-2a4c-4956-9016-750c52c4bb95-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-c28lm\" (UID: \"5ad2886b-2a4c-4956-9016-750c52c4bb95\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:31.825079 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.824937    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/249f6bd1-f57e-4480-9879-c013393983bb-metrics-client-ca\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.825079 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.825038    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/249f6bd1-f57e-4480-9879-c013393983bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.826281 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.826260    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/249f6bd1-f57e-4480-9879-c013393983bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.826391 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.826351    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ad2886b-2a4c-4956-9016-750c52c4bb95-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-c28lm\" (UID: \"5ad2886b-2a4c-4956-9016-750c52c4bb95\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:31.836718 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.836698    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw9nc\" (UniqueName: \"kubernetes.io/projected/249f6bd1-f57e-4480-9879-c013393983bb-kube-api-access-sw9nc\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:31.837213 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:31.837196    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzmdp\" (UniqueName: \"kubernetes.io/projected/5ad2886b-2a4c-4956-9016-750c52c4bb95-kube-api-access-tzmdp\") pod \"kube-state-metrics-785778ff74-c28lm\" (UID: \"5ad2886b-2a4c-4956-9016-750c52c4bb95\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:32.226684 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.226645    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0bc2e3be-bfc1-459a-918f-7db3cd6ac335-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-ksc9q\" (UID: \"0bc2e3be-bfc1-459a-918f-7db3cd6ac335\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q"
Jul 09 16:52:32.228910 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.228884    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0bc2e3be-bfc1-459a-918f-7db3cd6ac335-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-ksc9q\" (UID: \"0bc2e3be-bfc1-459a-918f-7db3cd6ac335\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q"
Jul 09 16:52:32.327616 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.327577    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/249f6bd1-f57e-4480-9879-c013393983bb-node-exporter-tls\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:32.327781 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.327635    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ad2886b-2a4c-4956-9016-750c52c4bb95-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-c28lm\" (UID: \"5ad2886b-2a4c-4956-9016-750c52c4bb95\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:32.330036 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.330006    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/249f6bd1-f57e-4480-9879-c013393983bb-node-exporter-tls\") pod \"node-exporter-wk2f2\" (UID: \"249f6bd1-f57e-4480-9879-c013393983bb\") " pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:32.330147 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.330051    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ad2886b-2a4c-4956-9016-750c52c4bb95-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-c28lm\" (UID: \"5ad2886b-2a4c-4956-9016-750c52c4bb95\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:32.434436 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.434397    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q"
Jul 09 16:52:32.449589 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.449552    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm"
Jul 09 16:52:32.463734 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.463706    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wk2f2"
Jul 09 16:52:32.519977 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:52:32.519939    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod249f6bd1_f57e_4480_9879_c013393983bb.slice/crio-e7de61132d596fdc4ced4beb9aa82cb4d72a4334911787bdc823508dcc99b6d1 WatchSource:0}: Error finding container e7de61132d596fdc4ced4beb9aa82cb4d72a4334911787bdc823508dcc99b6d1: Status 404 returned error can't find the container with id e7de61132d596fdc4ced4beb9aa82cb4d72a4334911787bdc823508dcc99b6d1
Jul 09 16:52:32.540152 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.540128    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 16:52:32.575007 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.574887    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 16:52:32.575007 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.574970    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.578451 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.578166    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 16:52:32.578451 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.578278    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 16:52:32.578451 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.578289    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 16:52:32.578451 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.578287    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 16:52:32.578451 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.578452    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 16:52:32.578857 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.578577    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 16:52:32.578857 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.578657    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 16:52:32.578857 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.578714    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-spmbf\""
Jul 09 16:52:32.579032 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.578868    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 16:52:32.579032 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.578952    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 16:52:32.613955 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.613932    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q"]
Jul 09 16:52:32.616465 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:52:32.616435    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc2e3be_bfc1_459a_918f_7db3cd6ac335.slice/crio-ef1a72ce5987698f2fc94eff09d668b73f3e98a463968bda8699cb54542a2537 WatchSource:0}: Error finding container ef1a72ce5987698f2fc94eff09d668b73f3e98a463968bda8699cb54542a2537: Status 404 returned error can't find the container with id ef1a72ce5987698f2fc94eff09d668b73f3e98a463968bda8699cb54542a2537
Jul 09 16:52:32.636900 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.636871    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-c28lm"]
Jul 09 16:52:32.639632 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:52:32.639611    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ad2886b_2a4c_4956_9016_750c52c4bb95.slice/crio-a544f5c73b2eec7db2251b727eac53e5ae52c1f52f964960725d5f63c56f9ab2 WatchSource:0}: Error finding container a544f5c73b2eec7db2251b727eac53e5ae52c1f52f964960725d5f63c56f9ab2: Status 404 returned error can't find the container with id a544f5c73b2eec7db2251b727eac53e5ae52c1f52f964960725d5f63c56f9ab2
Jul 09 16:52:32.730336 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.730300    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.730336 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.730382    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-web-config\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.730592 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.730469    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.730592 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.730507    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvss7\" (UniqueName: \"kubernetes.io/projected/90b97416-91f3-4150-b7dc-b188679ceddd-kube-api-access-cvss7\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.730592 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.730538    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90b97416-91f3-4150-b7dc-b188679ceddd-config-out\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.730592 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.730570    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90b97416-91f3-4150-b7dc-b188679ceddd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.730717 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.730623    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90b97416-91f3-4150-b7dc-b188679ceddd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.730717 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.730655    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-config-volume\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.730789 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.730716    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.730828 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.730783    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.730828 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.730810    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.730909 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.730845    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/90b97416-91f3-4150-b7dc-b188679ceddd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.730909 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.730871    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90b97416-91f3-4150-b7dc-b188679ceddd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.832373 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.832333    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.832521 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.832385    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-web-config\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.832521 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.832411    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.832521 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.832429    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvss7\" (UniqueName: \"kubernetes.io/projected/90b97416-91f3-4150-b7dc-b188679ceddd-kube-api-access-cvss7\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.832521 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.832455    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90b97416-91f3-4150-b7dc-b188679ceddd-config-out\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.832521 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.832475    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90b97416-91f3-4150-b7dc-b188679ceddd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.832521 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.832509    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90b97416-91f3-4150-b7dc-b188679ceddd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.832848 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.832536    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-config-volume\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.832848 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.832563    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.832848 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.832589    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.832848 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.832611    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.832848 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.832635    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/90b97416-91f3-4150-b7dc-b188679ceddd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.832848 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.832660    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90b97416-91f3-4150-b7dc-b188679ceddd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.833621 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.833592    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90b97416-91f3-4150-b7dc-b188679ceddd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.833727 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.833649    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90b97416-91f3-4150-b7dc-b188679ceddd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.834420 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.834394    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/90b97416-91f3-4150-b7dc-b188679ceddd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.835418 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.835394    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90b97416-91f3-4150-b7dc-b188679ceddd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.835848 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.835740    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.836062 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.835852    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-web-config\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.836128 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.836071    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.836303 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.836281    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.836616 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.836580    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.836785 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.836761    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90b97416-91f3-4150-b7dc-b188679ceddd-config-out\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.836928 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.836909    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-config-volume\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.837101 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.837086    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90b97416-91f3-4150-b7dc-b188679ceddd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.840771 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.840749    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvss7\" (UniqueName: \"kubernetes.io/projected/90b97416-91f3-4150-b7dc-b188679ceddd-kube-api-access-cvss7\") pod \"alertmanager-main-0\" (UID: \"90b97416-91f3-4150-b7dc-b188679ceddd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:32.887462 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:32.887435    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 16:52:33.040889 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:33.040865    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 16:52:33.043270 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:52:33.043244    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b97416_91f3_4150_b7dc_b188679ceddd.slice/crio-ac86ff6f7aaec20ada389acbeee8eb1069bf4ccef9e4adf38d24398119d8e6ea WatchSource:0}: Error finding container ac86ff6f7aaec20ada389acbeee8eb1069bf4ccef9e4adf38d24398119d8e6ea: Status 404 returned error can't find the container with id ac86ff6f7aaec20ada389acbeee8eb1069bf4ccef9e4adf38d24398119d8e6ea
Jul 09 16:52:33.431071 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:33.431019    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wk2f2" event={"ID":"249f6bd1-f57e-4480-9879-c013393983bb","Type":"ContainerStarted","Data":"e7de61132d596fdc4ced4beb9aa82cb4d72a4334911787bdc823508dcc99b6d1"}
Jul 09 16:52:33.432294 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:33.432267    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm" event={"ID":"5ad2886b-2a4c-4956-9016-750c52c4bb95","Type":"ContainerStarted","Data":"a544f5c73b2eec7db2251b727eac53e5ae52c1f52f964960725d5f63c56f9ab2"}
Jul 09 16:52:33.434319 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:33.434266    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q" event={"ID":"0bc2e3be-bfc1-459a-918f-7db3cd6ac335","Type":"ContainerStarted","Data":"afb9730eaa524314cdda10ef923508c27cb6ec317b5ad4a8c31a19ac1d229684"}
Jul 09 16:52:33.434447 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:33.434328    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q" event={"ID":"0bc2e3be-bfc1-459a-918f-7db3cd6ac335","Type":"ContainerStarted","Data":"437cf9e2c1c9683820f96fa863fa2fa1762440e6cf77e261d652eacebbbfa6ad"}
Jul 09 16:52:33.434447 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:33.434374    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q" event={"ID":"0bc2e3be-bfc1-459a-918f-7db3cd6ac335","Type":"ContainerStarted","Data":"ef1a72ce5987698f2fc94eff09d668b73f3e98a463968bda8699cb54542a2537"}
Jul 09 16:52:33.435662 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:33.435641    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90b97416-91f3-4150-b7dc-b188679ceddd","Type":"ContainerStarted","Data":"ac86ff6f7aaec20ada389acbeee8eb1069bf4ccef9e4adf38d24398119d8e6ea"}
Jul 09 16:52:34.441246 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:34.441208    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q" event={"ID":"0bc2e3be-bfc1-459a-918f-7db3cd6ac335","Type":"ContainerStarted","Data":"09f0b6345a66e00c36d2449c9175dbddaba28dc7d7ff6f5128224e6172148abb"}
Jul 09 16:52:34.460317 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:34.460254    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-ksc9q" podStartSLOduration=2.105514177 podStartE2EDuration="3.460237888s" totalImagesPullingTime="1.354723711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:52:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:34.458457421 +0000 UTC m=+92.138873342" watchObservedRunningTime="2026-07-09 16:52:34.460237888 +0000 UTC m=+92.140653795"
Jul 09 16:52:35.447941 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.447902    2568 generic.go:356] "Generic (PLEG): container finished" podID="249f6bd1-f57e-4480-9879-c013393983bb" containerID="73595356ba73f371fd81aaeae42be48b4487341e16ba9ef30105c69e3aad5b0d" exitCode=0
Jul 09 16:52:35.448432 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.448001    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wk2f2" event={"ID":"249f6bd1-f57e-4480-9879-c013393983bb","Type":"ContainerDied","Data":"73595356ba73f371fd81aaeae42be48b4487341e16ba9ef30105c69e3aad5b0d"}
Jul 09 16:52:35.473240 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.473209    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7447644696-ttdjb"]
Jul 09 16:52:35.490758 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.489871    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7447644696-ttdjb"]
Jul 09 16:52:35.490758 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.490021    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.493009 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.492985    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 09 16:52:35.493126 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.493037    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 09 16:52:35.493190 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.493140    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fof0shvv9bi1l\""
Jul 09 16:52:35.493273 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.493255    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 09 16:52:35.493404 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.493387    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 09 16:52:35.493477 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.493351    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 09 16:52:35.494680 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.494660    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cqb6w\""
Jul 09 16:52:35.656374 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.656337    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b6a0122-bd5b-4780-8284-785811b8ce46-metrics-client-ca\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.656492 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.656391    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0b6a0122-bd5b-4780-8284-785811b8ce46-secret-thanos-querier-tls\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.656492 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.656419    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zghbp\" (UniqueName: \"kubernetes.io/projected/0b6a0122-bd5b-4780-8284-785811b8ce46-kube-api-access-zghbp\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.656492 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.656447    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b6a0122-bd5b-4780-8284-785811b8ce46-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.656587 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.656490    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0b6a0122-bd5b-4780-8284-785811b8ce46-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.656587 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.656532    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b6a0122-bd5b-4780-8284-785811b8ce46-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.656587 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.656548    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0b6a0122-bd5b-4780-8284-785811b8ce46-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.656587 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.656578    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b6a0122-bd5b-4780-8284-785811b8ce46-secret-grpc-tls\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.757751 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.757704    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0b6a0122-bd5b-4780-8284-785811b8ce46-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.757938 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.757890    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b6a0122-bd5b-4780-8284-785811b8ce46-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.757938 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.757926    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0b6a0122-bd5b-4780-8284-785811b8ce46-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.758071 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.757958    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b6a0122-bd5b-4780-8284-785811b8ce46-secret-grpc-tls\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.758071 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.757998    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b6a0122-bd5b-4780-8284-785811b8ce46-metrics-client-ca\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.758340 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.758283    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0b6a0122-bd5b-4780-8284-785811b8ce46-secret-thanos-querier-tls\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.758340 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.758320    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zghbp\" (UniqueName: \"kubernetes.io/projected/0b6a0122-bd5b-4780-8284-785811b8ce46-kube-api-access-zghbp\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.758540 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.758378    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b6a0122-bd5b-4780-8284-785811b8ce46-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.758889 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.758787    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b6a0122-bd5b-4780-8284-785811b8ce46-metrics-client-ca\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.761046 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.761005    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b6a0122-bd5b-4780-8284-785811b8ce46-secret-grpc-tls\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.761145 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.761043    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b6a0122-bd5b-4780-8284-785811b8ce46-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.761258 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.761208    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0b6a0122-bd5b-4780-8284-785811b8ce46-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.761336 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.761314    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b6a0122-bd5b-4780-8284-785811b8ce46-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.761522 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.761499    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0b6a0122-bd5b-4780-8284-785811b8ce46-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.761598 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.761532    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0b6a0122-bd5b-4780-8284-785811b8ce46-secret-thanos-querier-tls\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.771162 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.771138    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zghbp\" (UniqueName: \"kubernetes.io/projected/0b6a0122-bd5b-4780-8284-785811b8ce46-kube-api-access-zghbp\") pod \"thanos-querier-7447644696-ttdjb\" (UID: \"0b6a0122-bd5b-4780-8284-785811b8ce46\") " pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.778926 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.778905    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"]
Jul 09 16:52:35.789800 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.789776    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:35.792785 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.792764    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 09 16:52:35.792970 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.792949    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bcdpw\""
Jul 09 16:52:35.793132 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.793111    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bh5thn5m240nm\""
Jul 09 16:52:35.793724 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.793347    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 09 16:52:35.793724 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.793372    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 09 16:52:35.793875 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.793776    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 16:52:35.794115 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.794094    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"]
Jul 09 16:52:35.823050 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.823012    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:35.960201 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.960125    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-client-ca-bundle\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:35.960201 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.960158    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-audit-log\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:35.960201 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.960183    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:35.960488 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.960242    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-secret-metrics-server-client-certs\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:35.960488 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.960277    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qflt\" (UniqueName: \"kubernetes.io/projected/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-kube-api-access-9qflt\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:35.960488 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.960402    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-metrics-server-audit-profiles\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:35.960488 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:35.960451    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-secret-metrics-server-tls\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:36.061561 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.061529    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-client-ca-bundle\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:36.061561 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.061568    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-audit-log\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:36.061814 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.061601    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:36.061814 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.061638    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-secret-metrics-server-client-certs\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:36.061814 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.061664    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qflt\" (UniqueName: \"kubernetes.io/projected/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-kube-api-access-9qflt\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:36.061814 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.061720    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-metrics-server-audit-profiles\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:36.061814 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.061753    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-secret-metrics-server-tls\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:36.062406 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.062326    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-audit-log\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:36.062673 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.062615    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:36.063005 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.062983    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-metrics-server-audit-profiles\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:36.064718 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.064695    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-secret-metrics-server-tls\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:36.064831 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.064701    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-client-ca-bundle\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:36.064894 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.064825    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-secret-metrics-server-client-certs\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:36.069619 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.069601    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qflt\" (UniqueName: \"kubernetes.io/projected/4274fb10-befa-4a5e-8fae-bdb9b92b1e65-kube-api-access-9qflt\") pod \"metrics-server-6df6d8b5f4-xgv2m\" (UID: \"4274fb10-befa-4a5e-8fae-bdb9b92b1e65\") " pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:36.101551 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.101515    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:36.279702 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.279626    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-fj62t"]
Jul 09 16:52:36.298453 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.298429    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-554cd58d6b-g9kjb"]
Jul 09 16:52:36.298627 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.298560    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fj62t"
Jul 09 16:52:36.301338 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.301299    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7nj52\""
Jul 09 16:52:36.301868 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.301763    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 09 16:52:36.315485 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.315462    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-fj62t"]
Jul 09 16:52:36.315583 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.315500    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-554cd58d6b-g9kjb"]
Jul 09 16:52:36.315583 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.315575    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.454007 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.453967    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wk2f2" event={"ID":"249f6bd1-f57e-4480-9879-c013393983bb","Type":"ContainerStarted","Data":"14e1aadf526ff3f89c44693b2d3d29bd30ab5a716b97e17c8f912b37fd4ae6e8"}
Jul 09 16:52:36.454529 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.454019    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wk2f2" event={"ID":"249f6bd1-f57e-4480-9879-c013393983bb","Type":"ContainerStarted","Data":"7d05d3be58e55f22556ead353e91ffb5ad9f96a0f618a81e42942a43eca6d3db"}
Jul 09 16:52:36.465535 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.465494    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-console-config\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.465675 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.465575    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-console-serving-cert\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.465734 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.465669    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-trusted-ca-bundle\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.465734 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.465710    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddhhb\" (UniqueName: \"kubernetes.io/projected/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-kube-api-access-ddhhb\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.465833 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.465746    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/061909ff-3550-4bb1-a854-4a3724e03b1e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-fj62t\" (UID: \"061909ff-3550-4bb1-a854-4a3724e03b1e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fj62t"
Jul 09 16:52:36.465833 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.465817    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-console-oauth-config\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.465912 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.465842    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-service-ca\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.465912 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.465877    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kwpw\" (UniqueName: \"kubernetes.io/projected/061909ff-3550-4bb1-a854-4a3724e03b1e-kube-api-access-2kwpw\") pod \"monitoring-plugin-5f68df7f58-fj62t\" (UID: \"061909ff-3550-4bb1-a854-4a3724e03b1e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fj62t"
Jul 09 16:52:36.465976 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.465919    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-oauth-serving-cert\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.473765 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.473716    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wk2f2" podStartSLOduration=2.759280459 podStartE2EDuration="5.473700541s" totalImagesPullingTime="2.592285329s" totalInitContainerRuntime="122.134753ms" isStatefulPod=true podCreationTimestamp="2026-07-09 16:52:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:36.473376149 +0000 UTC m=+94.153792055" watchObservedRunningTime="2026-07-09 16:52:36.473700541 +0000 UTC m=+94.154116490"
Jul 09 16:52:36.567078 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.566999    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-oauth-serving-cert\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.567078 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.567060    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-console-config\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.567078 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.567081    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-console-serving-cert\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.567385 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.567116    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-trusted-ca-bundle\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.567385 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.567149    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddhhb\" (UniqueName: \"kubernetes.io/projected/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-kube-api-access-ddhhb\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.567385 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.567187    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/061909ff-3550-4bb1-a854-4a3724e03b1e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-fj62t\" (UID: \"061909ff-3550-4bb1-a854-4a3724e03b1e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fj62t"
Jul 09 16:52:36.567385 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.567239    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-console-oauth-config\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.567385 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.567262    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-service-ca\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.567385 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.567321    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kwpw\" (UniqueName: \"kubernetes.io/projected/061909ff-3550-4bb1-a854-4a3724e03b1e-kube-api-access-2kwpw\") pod \"monitoring-plugin-5f68df7f58-fj62t\" (UID: \"061909ff-3550-4bb1-a854-4a3724e03b1e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fj62t"
Jul 09 16:52:36.567811 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.567784    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-oauth-serving-cert\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.567972 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.567811    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-console-config\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.568168 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.568148    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-trusted-ca-bundle\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.568436 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.568413    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-service-ca\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.571513 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.569755    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-console-serving-cert\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.571513 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.569985    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/061909ff-3550-4bb1-a854-4a3724e03b1e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-fj62t\" (UID: \"061909ff-3550-4bb1-a854-4a3724e03b1e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fj62t"
Jul 09 16:52:36.571513 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.570032    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-console-oauth-config\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.575300 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.575279    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddhhb\" (UniqueName: \"kubernetes.io/projected/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-kube-api-access-ddhhb\") pod \"console-554cd58d6b-g9kjb\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") " pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.582715 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.582690    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kwpw\" (UniqueName: \"kubernetes.io/projected/061909ff-3550-4bb1-a854-4a3724e03b1e-kube-api-access-2kwpw\") pod \"monitoring-plugin-5f68df7f58-fj62t\" (UID: \"061909ff-3550-4bb1-a854-4a3724e03b1e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fj62t"
Jul 09 16:52:36.609397 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.609372    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fj62t"
Jul 09 16:52:36.624503 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.624477    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:36.687909 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.687880    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"]
Jul 09 16:52:36.705611 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.705482    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"]
Jul 09 16:52:36.705771 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.705675    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.710770 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.709429    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 09 16:52:36.710770 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.709599    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 09 16:52:36.710770 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.709765    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 09 16:52:36.710770 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.709876    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 09 16:52:36.710770 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.709995    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zl5dk\""
Jul 09 16:52:36.712788 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.712451    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 09 16:52:36.716963 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.716940    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 09 16:52:36.852094 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.852070    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"]
Jul 09 16:52:36.872919 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.872893    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea1596bd-8468-40cb-99f3-bc44e453f0c4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.873063 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.872929    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea1596bd-8468-40cb-99f3-bc44e453f0c4-serving-certs-ca-bundle\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.873063 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.872958    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ea1596bd-8468-40cb-99f3-bc44e453f0c4-telemeter-client-tls\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.873063 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.873010    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea1596bd-8468-40cb-99f3-bc44e453f0c4-metrics-client-ca\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.873063 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.873038    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7tvw\" (UniqueName: \"kubernetes.io/projected/ea1596bd-8468-40cb-99f3-bc44e453f0c4-kube-api-access-b7tvw\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.873270 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.873090    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ea1596bd-8468-40cb-99f3-bc44e453f0c4-federate-client-tls\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.873270 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.873195    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea1596bd-8468-40cb-99f3-bc44e453f0c4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.873270 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.873241    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ea1596bd-8468-40cb-99f3-bc44e453f0c4-secret-telemeter-client\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.974337 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.974302    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ea1596bd-8468-40cb-99f3-bc44e453f0c4-telemeter-client-tls\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.974337 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.974337    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea1596bd-8468-40cb-99f3-bc44e453f0c4-metrics-client-ca\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.974628 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.974375    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7tvw\" (UniqueName: \"kubernetes.io/projected/ea1596bd-8468-40cb-99f3-bc44e453f0c4-kube-api-access-b7tvw\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.974628 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.974490    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ea1596bd-8468-40cb-99f3-bc44e453f0c4-federate-client-tls\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.974628 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.974561    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea1596bd-8468-40cb-99f3-bc44e453f0c4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.974772 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.974596    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ea1596bd-8468-40cb-99f3-bc44e453f0c4-secret-telemeter-client\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.974772 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.974719    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea1596bd-8468-40cb-99f3-bc44e453f0c4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.974772 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.974756    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea1596bd-8468-40cb-99f3-bc44e453f0c4-serving-certs-ca-bundle\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.975138 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.975116    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea1596bd-8468-40cb-99f3-bc44e453f0c4-metrics-client-ca\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.975555 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.975527    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea1596bd-8468-40cb-99f3-bc44e453f0c4-serving-certs-ca-bundle\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.975914 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.975874    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea1596bd-8468-40cb-99f3-bc44e453f0c4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.977452 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.977412    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ea1596bd-8468-40cb-99f3-bc44e453f0c4-telemeter-client-tls\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.977763 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.977745    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ea1596bd-8468-40cb-99f3-bc44e453f0c4-federate-client-tls\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.977866 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.977829    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea1596bd-8468-40cb-99f3-bc44e453f0c4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.978079 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.978062    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ea1596bd-8468-40cb-99f3-bc44e453f0c4-secret-telemeter-client\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:36.983974 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:36.983940    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7tvw\" (UniqueName: \"kubernetes.io/projected/ea1596bd-8468-40cb-99f3-bc44e453f0c4-kube-api-access-b7tvw\") pod \"telemeter-client-7476fc8cd6-xl86h\" (UID: \"ea1596bd-8468-40cb-99f3-bc44e453f0c4\") " pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:37.021903 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.021877    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"
Jul 09 16:52:37.087003 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.086934    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-fj62t"]
Jul 09 16:52:37.102388 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.095285    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-554cd58d6b-g9kjb"]
Jul 09 16:52:37.107668 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.106794    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7447644696-ttdjb"]
Jul 09 16:52:37.191221 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.191194    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7476fc8cd6-xl86h"]
Jul 09 16:52:37.194578 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:52:37.194553    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea1596bd_8468_40cb_99f3_bc44e453f0c4.slice/crio-921a0e8c2f12829e9d5b2c9d930b135e8d1b6519e1e54761e8ea8ea86021ea56 WatchSource:0}: Error finding container 921a0e8c2f12829e9d5b2c9d930b135e8d1b6519e1e54761e8ea8ea86021ea56: Status 404 returned error can't find the container with id 921a0e8c2f12829e9d5b2c9d930b135e8d1b6519e1e54761e8ea8ea86021ea56
Jul 09 16:52:37.461131 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.460693    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm" event={"ID":"5ad2886b-2a4c-4956-9016-750c52c4bb95","Type":"ContainerStarted","Data":"02b28b5da95ecec1ec409ca72b268e0482d2aa10891cfbec2cbb87fa81822001"}
Jul 09 16:52:37.461131 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.460764    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm" event={"ID":"5ad2886b-2a4c-4956-9016-750c52c4bb95","Type":"ContainerStarted","Data":"a03c95d9588159ab1f23cdfc73859f8becde5135a82f3c0d2ab9d494929d18c8"}
Jul 09 16:52:37.461131 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.460793    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm" event={"ID":"5ad2886b-2a4c-4956-9016-750c52c4bb95","Type":"ContainerStarted","Data":"2bce2556e230df1f931f1103a4a39112f63cf0351a07e33729ec01eac39a0a44"}
Jul 09 16:52:37.462881 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.462858    2568 generic.go:356] "Generic (PLEG): container finished" podID="90b97416-91f3-4150-b7dc-b188679ceddd" containerID="619280e972708a9c74d8b0487cf018f14fb838123357f83b6bc493827d506e8f" exitCode=0
Jul 09 16:52:37.463009 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.462932    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90b97416-91f3-4150-b7dc-b188679ceddd","Type":"ContainerDied","Data":"619280e972708a9c74d8b0487cf018f14fb838123357f83b6bc493827d506e8f"}
Jul 09 16:52:37.464145 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.464124    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fj62t" event={"ID":"061909ff-3550-4bb1-a854-4a3724e03b1e","Type":"ContainerStarted","Data":"cd0bc091f693f033c9000746bfaa0d9b53b917bd3b50b123612fe2e5ea7cf435"}
Jul 09 16:52:37.465412 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.465383    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m" event={"ID":"4274fb10-befa-4a5e-8fae-bdb9b92b1e65","Type":"ContainerStarted","Data":"4bbf949cfae36a7a1403a7cd743b5cc0f5f47cd0b079e6ff79314b1c9183d684"}
Jul 09 16:52:37.467410 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.467016    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554cd58d6b-g9kjb" event={"ID":"fb67ee19-dcaa-461e-ac61-c5ca76052fd5","Type":"ContainerStarted","Data":"571cfe5f88836326bf406bfea3a07a67bd08fdcadebd0f75ef0897863073e001"}
Jul 09 16:52:37.467410 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.467056    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554cd58d6b-g9kjb" event={"ID":"fb67ee19-dcaa-461e-ac61-c5ca76052fd5","Type":"ContainerStarted","Data":"d79859fb1f70e1f1ee3de5b984fd60f58c4bc544047f86d41a59db85d0d0b049"}
Jul 09 16:52:37.468584 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.468445    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h" event={"ID":"ea1596bd-8468-40cb-99f3-bc44e453f0c4","Type":"ContainerStarted","Data":"921a0e8c2f12829e9d5b2c9d930b135e8d1b6519e1e54761e8ea8ea86021ea56"}
Jul 09 16:52:37.470097 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.470073    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7447644696-ttdjb" event={"ID":"0b6a0122-bd5b-4780-8284-785811b8ce46","Type":"ContainerStarted","Data":"17e3a5fae7f7bbba57b346695289beafe3b2f4ca3cf5dc4251764484aefe9dfa"}
Jul 09 16:52:37.481280 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.480655    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-c28lm" podStartSLOduration=2.436157016 podStartE2EDuration="6.480634032s" totalImagesPullingTime="4.044477016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:52:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:37.479351352 +0000 UTC m=+95.159767262" watchObservedRunningTime="2026-07-09 16:52:37.480634032 +0000 UTC m=+95.161049942"
Jul 09 16:52:37.500717 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.500656    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-554cd58d6b-g9kjb" podStartSLOduration=1.5006351 podStartE2EDuration="1.5006351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:52:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:37.499838015 +0000 UTC m=+95.180253924" watchObservedRunningTime="2026-07-09 16:52:37.5006351 +0000 UTC m=+95.181051009"
Jul 09 16:52:37.658153 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.658120    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 16:52:37.678062 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.678029    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.679792 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.679763    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 16:52:37.681794 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.681514    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 09 16:52:37.681794 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.681542    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 09 16:52:37.681794 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.681547    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 09 16:52:37.681794 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.681554    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d83o9d9fdhr55\""
Jul 09 16:52:37.681794 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.681602    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 09 16:52:37.681794 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.681554    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 09 16:52:37.682187 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.681979    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 09 16:52:37.682187 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.682059    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 09 16:52:37.682187 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.682059    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 09 16:52:37.682340 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.682298    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h6w44\""
Jul 09 16:52:37.682582 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.682549    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 09 16:52:37.682582 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.682563    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 09 16:52:37.682732 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.682610    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 09 16:52:37.682732 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.682647    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 09 16:52:37.682732 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.682559    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 09 16:52:37.684796 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.684772    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.684921 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.684812    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.684921 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.684845    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.684921 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.684871    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.684921 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.684895    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.685114 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.684942    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-config\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.685114 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.684985    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.685114 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.685036    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.685114 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.685066    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.685114 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.685089    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9758w\" (UniqueName: \"kubernetes.io/projected/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-kube-api-access-9758w\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.685307 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.685123    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.685307 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.685149    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-web-config\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.685307 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.685202    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.685307 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.685266    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.685307 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.685298    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.685515 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.685331    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.685515 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.685381    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.685515 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.685408    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.685515 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.685446    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-config-out\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.685515 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.685472    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.688893 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.688334    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 09 16:52:37.786376 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.786270    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.786376 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.786324    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.786376 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.786349    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9758w\" (UniqueName: \"kubernetes.io/projected/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-kube-api-access-9758w\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.786672 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.786404    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.786672 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.786433    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-web-config\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.786672 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.786486    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.786672 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.786525    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.786672 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.786548    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.786672 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.786579    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.786672 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.786619    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.786672 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.786644    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.787080 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.786687    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-config-out\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.787080 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.786713    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.787080 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.786756    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.787080 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.786804    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.787080 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.786836    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.787080 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.786864    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.787080 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.786890    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.787080 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.786932    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-config\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.787080 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.786953    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.788335 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.787907    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.789649 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.789546    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.791800 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.790339    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.791800 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.791021    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.791800 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.791380    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.797076 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.796847    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.797076 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.796989    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-config-out\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.797076 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.797016    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.797282 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.797233    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.797930 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.797561    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.797930 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.797743    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-web-config\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.797930 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.797895    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.798128 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.797972    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.798253 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.798194    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.798253 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.797960    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.798836 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.798448    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.798836 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.798528    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.798836 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.798725    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.798836 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.798733    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-config\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.798836 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.798807    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9758w\" (UniqueName: \"kubernetes.io/projected/a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62-kube-api-access-9758w\") pod \"prometheus-k8s-0\" (UID: \"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:37.993275 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:37.993237    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:38.207652 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:38.207627    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 16:52:38.210045 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:52:38.210018    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8ea6f9b_9a94_4aa6_848f_bd1e2d0ffd62.slice/crio-bd93e9dcc03f8a94a1058f6689357f2deb9805bbf7274f685325ffdce6a15e77 WatchSource:0}: Error finding container bd93e9dcc03f8a94a1058f6689357f2deb9805bbf7274f685325ffdce6a15e77: Status 404 returned error can't find the container with id bd93e9dcc03f8a94a1058f6689357f2deb9805bbf7274f685325ffdce6a15e77
Jul 09 16:52:38.476964 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:38.476928    2568 generic.go:356] "Generic (PLEG): container finished" podID="a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62" containerID="a0b6f289d46c2017f4489d4f2bbed18870864420483633870e44a54409bd2ee3" exitCode=0
Jul 09 16:52:38.479720 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:38.478127    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62","Type":"ContainerDied","Data":"a0b6f289d46c2017f4489d4f2bbed18870864420483633870e44a54409bd2ee3"}
Jul 09 16:52:38.479720 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:38.478214    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62","Type":"ContainerStarted","Data":"bd93e9dcc03f8a94a1058f6689357f2deb9805bbf7274f685325ffdce6a15e77"}
Jul 09 16:52:43.503352 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:43.503312    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h" event={"ID":"ea1596bd-8468-40cb-99f3-bc44e453f0c4","Type":"ContainerStarted","Data":"1a3e7e0b77348647dad4964faafab6434dad054dedbfaae43697cf1991df471d"}
Jul 09 16:52:43.503887 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:43.503408    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h" event={"ID":"ea1596bd-8468-40cb-99f3-bc44e453f0c4","Type":"ContainerStarted","Data":"060b012f7cdd408943850b4518487cb34b6abc3a25a000447095f965e767571f"}
Jul 09 16:52:43.503887 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:43.503441    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h" event={"ID":"ea1596bd-8468-40cb-99f3-bc44e453f0c4","Type":"ContainerStarted","Data":"94d9f824f4af1e92c4daba9e546a1ff94a5baeec99e80235ca686b4ebd65296b"}
Jul 09 16:52:43.506502 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:43.506475    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7447644696-ttdjb" event={"ID":"0b6a0122-bd5b-4780-8284-785811b8ce46","Type":"ContainerStarted","Data":"43da976d014c8e3a8c94423b5c6cd53c3a4df23b2c35fda740141f6a3f1cf080"}
Jul 09 16:52:43.506624 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:43.506563    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7447644696-ttdjb" event={"ID":"0b6a0122-bd5b-4780-8284-785811b8ce46","Type":"ContainerStarted","Data":"40a5a52809bee001a59508f696c63310be15eb44f613d69e99636a3818460ac0"}
Jul 09 16:52:43.506624 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:43.506603    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7447644696-ttdjb" event={"ID":"0b6a0122-bd5b-4780-8284-785811b8ce46","Type":"ContainerStarted","Data":"6a42fffa21b7c7a64c38ca72ad9ce4bcee3ad5cc2cd6212ed6bffc5d68cc7c88"}
Jul 09 16:52:43.511202 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:43.510974    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90b97416-91f3-4150-b7dc-b188679ceddd","Type":"ContainerStarted","Data":"1ae237f6bc91faa8b337f972b3ae70e9435ba383c871d0547ad4769b0109cf56"}
Jul 09 16:52:43.511202 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:43.511041    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90b97416-91f3-4150-b7dc-b188679ceddd","Type":"ContainerStarted","Data":"74963c6d90ca328a186ca4e07185c3865011c1877923362cdb32b5183a1e352b"}
Jul 09 16:52:43.511202 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:43.511080    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90b97416-91f3-4150-b7dc-b188679ceddd","Type":"ContainerStarted","Data":"ccf12431586183a41e3209e4f419444b717498e7dfcc360eabe4a030b1da3c42"}
Jul 09 16:52:43.511202 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:43.511124    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90b97416-91f3-4150-b7dc-b188679ceddd","Type":"ContainerStarted","Data":"34bc5ca479520b54b95bd3a240f9135a2f9be4dae36c7200362336f0018e76f2"}
Jul 09 16:52:43.511202 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:43.511162    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90b97416-91f3-4150-b7dc-b188679ceddd","Type":"ContainerStarted","Data":"9fd1e9cd0622b243aae9d0f93480ba58c52cd26f5cc23bfca7a966cb58c93bd5"}
Jul 09 16:52:43.514019 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:43.513967    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fj62t" event={"ID":"061909ff-3550-4bb1-a854-4a3724e03b1e","Type":"ContainerStarted","Data":"5b04c40c83e99986b4b173e0106c767c5fc1f2519bcdd07e7a9506a3aea02dd9"}
Jul 09 16:52:43.514438 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:43.514420    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fj62t"
Jul 09 16:52:43.517973 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:43.517945    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m" event={"ID":"4274fb10-befa-4a5e-8fae-bdb9b92b1e65","Type":"ContainerStarted","Data":"769c64317663a4e1dd7db959aef6887eed0f4d9222cb90a995769a2b5179f992"}
Jul 09 16:52:43.522064 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:43.521379    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fj62t"
Jul 09 16:52:43.528168 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:43.527385    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7476fc8cd6-xl86h" podStartSLOduration=2.192874583 podStartE2EDuration="7.527367183s" totalImagesPullingTime="5.3344926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:43.525747934 +0000 UTC m=+101.206163843" watchObservedRunningTime="2026-07-09 16:52:43.527367183 +0000 UTC m=+101.207783082"
Jul 09 16:52:43.542578 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:43.542513    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-fj62t" podStartSLOduration=2.11751401 podStartE2EDuration="7.542488628s" totalImagesPullingTime="5.424974618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:43.54046097 +0000 UTC m=+101.220876880" watchObservedRunningTime="2026-07-09 16:52:43.542488628 +0000 UTC m=+101.222904537"
Jul 09 16:52:43.562148 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:43.561176    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m" podStartSLOduration=2.885473876 podStartE2EDuration="8.561155879s" totalImagesPullingTime="5.675682003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:43.559840586 +0000 UTC m=+101.240256494" watchObservedRunningTime="2026-07-09 16:52:43.561155879 +0000 UTC m=+101.241571788"
Jul 09 16:52:44.837663 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:44.837631    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-554cd58d6b-g9kjb"]
Jul 09 16:52:44.867413 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:44.867378    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c8887f78f-4mv89"]
Jul 09 16:52:44.891335 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:44.891306    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c8887f78f-4mv89"]
Jul 09 16:52:44.891528 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:44.891459    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:44.972347 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:44.972313    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-oauth-serving-cert\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:44.972545 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:44.972383    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db56cefb-a351-4f9b-8dd4-b0117d76f538-console-oauth-config\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:44.972545 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:44.972418    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-trusted-ca-bundle\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:44.972545 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:44.972490    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-console-config\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:44.972676 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:44.972538    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv2qs\" (UniqueName: \"kubernetes.io/projected/db56cefb-a351-4f9b-8dd4-b0117d76f538-kube-api-access-cv2qs\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:44.972676 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:44.972594    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-service-ca\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:44.972676 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:44.972618    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db56cefb-a351-4f9b-8dd4-b0117d76f538-console-serving-cert\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:45.073687 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:45.073652    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-console-config\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:45.073687 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:45.073697    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv2qs\" (UniqueName: \"kubernetes.io/projected/db56cefb-a351-4f9b-8dd4-b0117d76f538-kube-api-access-cv2qs\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:45.073965 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:45.073734    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-service-ca\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:45.073965 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:45.073756    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db56cefb-a351-4f9b-8dd4-b0117d76f538-console-serving-cert\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:45.073965 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:45.073814    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-oauth-serving-cert\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:45.073965 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:45.073928    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db56cefb-a351-4f9b-8dd4-b0117d76f538-console-oauth-config\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:45.074167 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:45.073978    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-trusted-ca-bundle\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:45.074541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:45.074491    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-console-config\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:45.074541 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:45.074517    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-service-ca\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:45.074728 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:45.074614    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-oauth-serving-cert\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:45.075010 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:45.074988    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-trusted-ca-bundle\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:45.076643 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:45.076618    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db56cefb-a351-4f9b-8dd4-b0117d76f538-console-serving-cert\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:45.076835 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:45.076814    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db56cefb-a351-4f9b-8dd4-b0117d76f538-console-oauth-config\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:45.082659 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:45.082635    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv2qs\" (UniqueName: \"kubernetes.io/projected/db56cefb-a351-4f9b-8dd4-b0117d76f538-kube-api-access-cv2qs\") pod \"console-7c8887f78f-4mv89\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") " pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:45.203760 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:45.203681    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:45.643311 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:45.643288    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c8887f78f-4mv89"]
Jul 09 16:52:45.647685 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:52:45.647650    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb56cefb_a351_4f9b_8dd4_b0117d76f538.slice/crio-db3792398431fbd3791aa87b63200fc3ce886ad8892b5c88b059bc621663d46f WatchSource:0}: Error finding container db3792398431fbd3791aa87b63200fc3ce886ad8892b5c88b059bc621663d46f: Status 404 returned error can't find the container with id db3792398431fbd3791aa87b63200fc3ce886ad8892b5c88b059bc621663d46f
Jul 09 16:52:46.535663 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:46.535632    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7447644696-ttdjb" event={"ID":"0b6a0122-bd5b-4780-8284-785811b8ce46","Type":"ContainerStarted","Data":"5a756760a3c970b75412525f12e12386d509cd6ff0582e599e25ef5e98a7a01f"}
Jul 09 16:52:46.536048 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:46.535710    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7447644696-ttdjb" event={"ID":"0b6a0122-bd5b-4780-8284-785811b8ce46","Type":"ContainerStarted","Data":"f4587a9aaf6b517c4bac64940e24d30ff8c87b79740196c1cbab9219ff10eb5c"}
Jul 09 16:52:46.536048 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:46.535758    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7447644696-ttdjb" event={"ID":"0b6a0122-bd5b-4780-8284-785811b8ce46","Type":"ContainerStarted","Data":"c63837c6f19ebb3a8b3965367f849a287331c83fc80f9ae6fc91499759cc4974"}
Jul 09 16:52:46.536048 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:46.535795    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:46.538542 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:46.538524    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62","Type":"ContainerStarted","Data":"9b23e01a8953ff23a4574546f98b5956fa13684d131689b9a68653b06eb6d009"}
Jul 09 16:52:46.538635 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:46.538573    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62","Type":"ContainerStarted","Data":"2bff4d91b4262fb9e2c8f0c4def255c575228442356d7dc2771d28ba5bfc0a0f"}
Jul 09 16:52:46.538635 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:46.538610    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62","Type":"ContainerStarted","Data":"e21d0f0a24483c9798b8d21304580f0c023e95ce37174ee4977c123c279919d7"}
Jul 09 16:52:46.538728 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:46.538640    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62","Type":"ContainerStarted","Data":"f662eb57ed201c9f8d5e99a5bfdc848a8da8d49ef64306445ead2b43da9d2dd9"}
Jul 09 16:52:46.538728 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:46.538674    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62","Type":"ContainerStarted","Data":"3e5cbb861cfa160f9cdac9a3bb887a0b0f709b7bada5fd207dcdd5529e4cf87f"}
Jul 09 16:52:46.540038 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:46.540017    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8887f78f-4mv89" event={"ID":"db56cefb-a351-4f9b-8dd4-b0117d76f538","Type":"ContainerStarted","Data":"c332b53781a1699d40f4fac9aa86b1c696562f2b8b73b35ced4c24e99945e710"}
Jul 09 16:52:46.540108 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:46.540054    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8887f78f-4mv89" event={"ID":"db56cefb-a351-4f9b-8dd4-b0117d76f538","Type":"ContainerStarted","Data":"db3792398431fbd3791aa87b63200fc3ce886ad8892b5c88b059bc621663d46f"}
Jul 09 16:52:46.543201 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:46.543176    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90b97416-91f3-4150-b7dc-b188679ceddd","Type":"ContainerStarted","Data":"6f97ffe95836a5a5b7e7643d1d4322870522a34f5dbdec09a8eb4593731c3a61"}
Jul 09 16:52:46.559949 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:46.559905    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7447644696-ttdjb" podStartSLOduration=3.607501186 podStartE2EDuration="11.559887667s" totalImagesPullingTime="7.952386481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:52:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:46.558496115 +0000 UTC m=+104.238912015" watchObservedRunningTime="2026-07-09 16:52:46.559887667 +0000 UTC m=+104.240303569"
Jul 09 16:52:46.576111 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:46.576056    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c8887f78f-4mv89" podStartSLOduration=2.57603778 podStartE2EDuration="2.57603778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:52:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:46.574863532 +0000 UTC m=+104.255279451" watchObservedRunningTime="2026-07-09 16:52:46.57603778 +0000 UTC m=+104.256453688"
Jul 09 16:52:46.599547 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:46.599487    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.698997639 podStartE2EDuration="14.599470547s" totalImagesPullingTime="10.859806149s" totalInitContainerRuntime="40.666759ms" isStatefulPod=false podCreationTimestamp="2026-07-09 16:52:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:46.596895434 +0000 UTC m=+104.277311342" watchObservedRunningTime="2026-07-09 16:52:46.599470547 +0000 UTC m=+104.279886455"
Jul 09 16:52:46.624992 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:46.624921    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:52:47.550892 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:47.550855    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62","Type":"ContainerStarted","Data":"493aaec3133a04b2a3e2ddcc4d942309019fe7b06235109746dbde3af80fad1e"}
Jul 09 16:52:47.556640 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:47.556614    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7447644696-ttdjb"
Jul 09 16:52:47.582006 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:47.581942    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.187720005 podStartE2EDuration="10.581917789s" totalImagesPullingTime="7.367458737s" totalInitContainerRuntime="26.739047ms" isStatefulPod=false podCreationTimestamp="2026-07-09 16:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:47.579099024 +0000 UTC m=+105.259514956" watchObservedRunningTime="2026-07-09 16:52:47.581917789 +0000 UTC m=+105.262333698"
Jul 09 16:52:47.993922 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:47.993885    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:52:53.474243 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:53.474197    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67f66d9b5-f4qzm" podUID="dec3f55a-cfff-4ba7-b214-8c00556d9d2b" containerName="console" containerID="cri-o://5890e14af98df14cf037419669759205ca5af52e649c712e5623cabece7e5058" gracePeriod=15
Jul 09 16:52:53.745302 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:53.745242    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:53.855879 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:53.855846    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-service-ca\") pod \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") "
Jul 09 16:52:53.855879 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:53.855885    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-console-oauth-config\") pod \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") "
Jul 09 16:52:53.856087 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:53.855962    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-console-config\") pod \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") "
Jul 09 16:52:53.856087 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:53.855998    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-console-serving-cert\") pod \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") "
Jul 09 16:52:53.856167 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:53.856124    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2k2c\" (UniqueName: \"kubernetes.io/projected/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-kube-api-access-s2k2c\") pod \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") "
Jul 09 16:52:53.856223 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:53.856197    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-oauth-serving-cert\") pod \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\" (UID: \"dec3f55a-cfff-4ba7-b214-8c00556d9d2b\") "
Jul 09 16:52:53.856321 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:53.856299    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-service-ca" (OuterVolumeSpecName: "service-ca") pod "dec3f55a-cfff-4ba7-b214-8c00556d9d2b" (UID: "dec3f55a-cfff-4ba7-b214-8c00556d9d2b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:52:53.856517 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:53.856401    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-console-config" (OuterVolumeSpecName: "console-config") pod "dec3f55a-cfff-4ba7-b214-8c00556d9d2b" (UID: "dec3f55a-cfff-4ba7-b214-8c00556d9d2b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:52:53.856626 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:53.856575    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-service-ca\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:52:53.856626 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:53.856575    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dec3f55a-cfff-4ba7-b214-8c00556d9d2b" (UID: "dec3f55a-cfff-4ba7-b214-8c00556d9d2b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:52:53.856626 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:53.856595    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-console-config\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:52:53.858403 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:53.858379    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dec3f55a-cfff-4ba7-b214-8c00556d9d2b" (UID: "dec3f55a-cfff-4ba7-b214-8c00556d9d2b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 16:52:53.858492 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:53.858443    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dec3f55a-cfff-4ba7-b214-8c00556d9d2b" (UID: "dec3f55a-cfff-4ba7-b214-8c00556d9d2b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 16:52:53.858492 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:53.858450    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-kube-api-access-s2k2c" (OuterVolumeSpecName: "kube-api-access-s2k2c") pod "dec3f55a-cfff-4ba7-b214-8c00556d9d2b" (UID: "dec3f55a-cfff-4ba7-b214-8c00556d9d2b"). InnerVolumeSpecName "kube-api-access-s2k2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:52:53.957831 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:53.957803    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-console-oauth-config\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:52:53.957831 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:53.957828    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-console-serving-cert\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:52:53.957831 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:53.957837    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2k2c\" (UniqueName: \"kubernetes.io/projected/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-kube-api-access-s2k2c\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:52:53.958024 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:53.957846    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dec3f55a-cfff-4ba7-b214-8c00556d9d2b-oauth-serving-cert\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:52:54.589602 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:54.589563    2568 generic.go:356] "Generic (PLEG): container finished" podID="dec3f55a-cfff-4ba7-b214-8c00556d9d2b" containerID="5890e14af98df14cf037419669759205ca5af52e649c712e5623cabece7e5058" exitCode=0
Jul 09 16:52:54.589997 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:54.589614    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f66d9b5-f4qzm"
Jul 09 16:52:54.589997 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:54.589652    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f66d9b5-f4qzm" event={"ID":"dec3f55a-cfff-4ba7-b214-8c00556d9d2b","Type":"ContainerDied","Data":"5890e14af98df14cf037419669759205ca5af52e649c712e5623cabece7e5058"}
Jul 09 16:52:54.589997 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:54.589708    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f66d9b5-f4qzm" event={"ID":"dec3f55a-cfff-4ba7-b214-8c00556d9d2b","Type":"ContainerDied","Data":"eec02d1cadaaa70d4380acd0649465f9b2196b70a9049934313d1e17590ab839"}
Jul 09 16:52:54.589997 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:54.589727    2568 scope.go:117] "RemoveContainer" containerID="5890e14af98df14cf037419669759205ca5af52e649c712e5623cabece7e5058"
Jul 09 16:52:54.604834 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:54.604805    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67f66d9b5-f4qzm"]
Jul 09 16:52:54.611581 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:54.611471    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67f66d9b5-f4qzm"]
Jul 09 16:52:54.611722 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:54.611705    2568 scope.go:117] "RemoveContainer" containerID="5890e14af98df14cf037419669759205ca5af52e649c712e5623cabece7e5058"
Jul 09 16:52:54.612012 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:52:54.611994    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5890e14af98df14cf037419669759205ca5af52e649c712e5623cabece7e5058\": container with ID starting with 5890e14af98df14cf037419669759205ca5af52e649c712e5623cabece7e5058 not found: ID does not exist" containerID="5890e14af98df14cf037419669759205ca5af52e649c712e5623cabece7e5058"
Jul 09 16:52:54.612054 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:54.612023    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5890e14af98df14cf037419669759205ca5af52e649c712e5623cabece7e5058"} err="failed to get container status \"5890e14af98df14cf037419669759205ca5af52e649c712e5623cabece7e5058\": rpc error: code = NotFound desc = could not find container \"5890e14af98df14cf037419669759205ca5af52e649c712e5623cabece7e5058\": container with ID starting with 5890e14af98df14cf037419669759205ca5af52e649c712e5623cabece7e5058 not found: ID does not exist"
Jul 09 16:52:55.204033 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:55.203997    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:55.204239 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:55.204070    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:55.208655 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:55.208627    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:55.598892 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:55.598864    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:52:55.643791 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:55.643759    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-659fb76f4c-lf6fd"]
Jul 09 16:52:55.938407 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:55.938319    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dec3f55a-cfff-4ba7-b214-8c00556d9d2b" path="/var/lib/kubelet/pods/dec3f55a-cfff-4ba7-b214-8c00556d9d2b/volumes"
Jul 09 16:52:56.102602 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:56.102560    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:56.102792 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:56.102634    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:52:56.399709 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:52:56.399680    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vwcc7"
Jul 09 16:53:09.859645 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:09.859581    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-554cd58d6b-g9kjb" podUID="fb67ee19-dcaa-461e-ac61-c5ca76052fd5" containerName="console" containerID="cri-o://571cfe5f88836326bf406bfea3a07a67bd08fdcadebd0f75ef0897863073e001" gracePeriod=15
Jul 09 16:53:10.129165 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.129109    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:53:10.308094 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.308055    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-console-config\") pod \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") "
Jul 09 16:53:10.308290 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.308119    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddhhb\" (UniqueName: \"kubernetes.io/projected/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-kube-api-access-ddhhb\") pod \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") "
Jul 09 16:53:10.308290 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.308143    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-console-serving-cert\") pod \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") "
Jul 09 16:53:10.308290 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.308170    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-trusted-ca-bundle\") pod \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") "
Jul 09 16:53:10.308290 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.308196    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-oauth-serving-cert\") pod \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") "
Jul 09 16:53:10.308290 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.308234    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-service-ca\") pod \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") "
Jul 09 16:53:10.308578 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.308462    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-console-oauth-config\") pod \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\" (UID: \"fb67ee19-dcaa-461e-ac61-c5ca76052fd5\") "
Jul 09 16:53:10.308770 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.308701    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-service-ca" (OuterVolumeSpecName: "service-ca") pod "fb67ee19-dcaa-461e-ac61-c5ca76052fd5" (UID: "fb67ee19-dcaa-461e-ac61-c5ca76052fd5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:53:10.308770 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.308710    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fb67ee19-dcaa-461e-ac61-c5ca76052fd5" (UID: "fb67ee19-dcaa-461e-ac61-c5ca76052fd5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:53:10.308770 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.308719    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fb67ee19-dcaa-461e-ac61-c5ca76052fd5" (UID: "fb67ee19-dcaa-461e-ac61-c5ca76052fd5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:53:10.308770 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.308741    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-console-config" (OuterVolumeSpecName: "console-config") pod "fb67ee19-dcaa-461e-ac61-c5ca76052fd5" (UID: "fb67ee19-dcaa-461e-ac61-c5ca76052fd5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:53:10.308986 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.308820    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-console-config\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:53:10.308986 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.308831    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-trusted-ca-bundle\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:53:10.308986 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.308840    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-oauth-serving-cert\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:53:10.308986 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.308849    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-service-ca\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:53:10.310294 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.310261    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-kube-api-access-ddhhb" (OuterVolumeSpecName: "kube-api-access-ddhhb") pod "fb67ee19-dcaa-461e-ac61-c5ca76052fd5" (UID: "fb67ee19-dcaa-461e-ac61-c5ca76052fd5"). InnerVolumeSpecName "kube-api-access-ddhhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:53:10.310472 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.310308    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fb67ee19-dcaa-461e-ac61-c5ca76052fd5" (UID: "fb67ee19-dcaa-461e-ac61-c5ca76052fd5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 16:53:10.310527 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.310473    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fb67ee19-dcaa-461e-ac61-c5ca76052fd5" (UID: "fb67ee19-dcaa-461e-ac61-c5ca76052fd5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 16:53:10.409793 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.409709    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddhhb\" (UniqueName: \"kubernetes.io/projected/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-kube-api-access-ddhhb\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:53:10.409793 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.409740    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-console-serving-cert\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:53:10.409793 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.409753    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb67ee19-dcaa-461e-ac61-c5ca76052fd5-console-oauth-config\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:53:10.661811 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.661719    2568 generic.go:356] "Generic (PLEG): container finished" podID="fb67ee19-dcaa-461e-ac61-c5ca76052fd5" containerID="571cfe5f88836326bf406bfea3a07a67bd08fdcadebd0f75ef0897863073e001" exitCode=0
Jul 09 16:53:10.661811 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.661763    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554cd58d6b-g9kjb"
Jul 09 16:53:10.662025 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.661807    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554cd58d6b-g9kjb" event={"ID":"fb67ee19-dcaa-461e-ac61-c5ca76052fd5","Type":"ContainerDied","Data":"571cfe5f88836326bf406bfea3a07a67bd08fdcadebd0f75ef0897863073e001"}
Jul 09 16:53:10.662025 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.661857    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554cd58d6b-g9kjb" event={"ID":"fb67ee19-dcaa-461e-ac61-c5ca76052fd5","Type":"ContainerDied","Data":"d79859fb1f70e1f1ee3de5b984fd60f58c4bc544047f86d41a59db85d0d0b049"}
Jul 09 16:53:10.662025 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.661877    2568 scope.go:117] "RemoveContainer" containerID="571cfe5f88836326bf406bfea3a07a67bd08fdcadebd0f75ef0897863073e001"
Jul 09 16:53:10.670813 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.670794    2568 scope.go:117] "RemoveContainer" containerID="571cfe5f88836326bf406bfea3a07a67bd08fdcadebd0f75ef0897863073e001"
Jul 09 16:53:10.671048 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:53:10.671031    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"571cfe5f88836326bf406bfea3a07a67bd08fdcadebd0f75ef0897863073e001\": container with ID starting with 571cfe5f88836326bf406bfea3a07a67bd08fdcadebd0f75ef0897863073e001 not found: ID does not exist" containerID="571cfe5f88836326bf406bfea3a07a67bd08fdcadebd0f75ef0897863073e001"
Jul 09 16:53:10.671094 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.671057    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"571cfe5f88836326bf406bfea3a07a67bd08fdcadebd0f75ef0897863073e001"} err="failed to get container status \"571cfe5f88836326bf406bfea3a07a67bd08fdcadebd0f75ef0897863073e001\": rpc error: code = NotFound desc = could not find container \"571cfe5f88836326bf406bfea3a07a67bd08fdcadebd0f75ef0897863073e001\": container with ID starting with 571cfe5f88836326bf406bfea3a07a67bd08fdcadebd0f75ef0897863073e001 not found: ID does not exist"
Jul 09 16:53:10.682024 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.682001    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-554cd58d6b-g9kjb"]
Jul 09 16:53:10.684341 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:10.684320    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-554cd58d6b-g9kjb"]
Jul 09 16:53:11.938428 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:11.938394    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb67ee19-dcaa-461e-ac61-c5ca76052fd5" path="/var/lib/kubelet/pods/fb67ee19-dcaa-461e-ac61-c5ca76052fd5/volumes"
Jul 09 16:53:16.113113 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:16.113076    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:53:16.120896 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:16.120860    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6df6d8b5f4-xgv2m"
Jul 09 16:53:20.664432 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:20.664346    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-659fb76f4c-lf6fd" podUID="3df3cb58-cf25-43fc-a28d-3743cedef1e9" containerName="console" containerID="cri-o://c6eaff05630aeae1e0b713d79a2d6bd1e3500ae1c2574c9af98875a2027a19cf" gracePeriod=15
Jul 09 16:53:20.912750 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:20.912720    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:53:21.110946 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.110913    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-console-config\") pod \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") "
Jul 09 16:53:21.111125 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.110962    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3df3cb58-cf25-43fc-a28d-3743cedef1e9-console-oauth-config\") pod \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") "
Jul 09 16:53:21.111125 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.111003    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-trusted-ca-bundle\") pod \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") "
Jul 09 16:53:21.111125 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.111023    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-oauth-serving-cert\") pod \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") "
Jul 09 16:53:21.111125 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.111054    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3df3cb58-cf25-43fc-a28d-3743cedef1e9-console-serving-cert\") pod \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") "
Jul 09 16:53:21.111125 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.111085    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvgpz\" (UniqueName: \"kubernetes.io/projected/3df3cb58-cf25-43fc-a28d-3743cedef1e9-kube-api-access-nvgpz\") pod \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") "
Jul 09 16:53:21.111125 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.111106    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-service-ca\") pod \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\" (UID: \"3df3cb58-cf25-43fc-a28d-3743cedef1e9\") "
Jul 09 16:53:21.111455 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.111408    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-console-config" (OuterVolumeSpecName: "console-config") pod "3df3cb58-cf25-43fc-a28d-3743cedef1e9" (UID: "3df3cb58-cf25-43fc-a28d-3743cedef1e9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:53:21.111537 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.111500    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3df3cb58-cf25-43fc-a28d-3743cedef1e9" (UID: "3df3cb58-cf25-43fc-a28d-3743cedef1e9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:53:21.111603 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.111572    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3df3cb58-cf25-43fc-a28d-3743cedef1e9" (UID: "3df3cb58-cf25-43fc-a28d-3743cedef1e9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:53:21.111654 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.111605    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-service-ca" (OuterVolumeSpecName: "service-ca") pod "3df3cb58-cf25-43fc-a28d-3743cedef1e9" (UID: "3df3cb58-cf25-43fc-a28d-3743cedef1e9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:53:21.113386 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.113341    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3df3cb58-cf25-43fc-a28d-3743cedef1e9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3df3cb58-cf25-43fc-a28d-3743cedef1e9" (UID: "3df3cb58-cf25-43fc-a28d-3743cedef1e9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 16:53:21.113492 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.113394    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3df3cb58-cf25-43fc-a28d-3743cedef1e9-kube-api-access-nvgpz" (OuterVolumeSpecName: "kube-api-access-nvgpz") pod "3df3cb58-cf25-43fc-a28d-3743cedef1e9" (UID: "3df3cb58-cf25-43fc-a28d-3743cedef1e9"). InnerVolumeSpecName "kube-api-access-nvgpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:53:21.113492 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.113429    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3df3cb58-cf25-43fc-a28d-3743cedef1e9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3df3cb58-cf25-43fc-a28d-3743cedef1e9" (UID: "3df3cb58-cf25-43fc-a28d-3743cedef1e9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 16:53:21.212450 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.212412    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-trusted-ca-bundle\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:53:21.212450 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.212443    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-oauth-serving-cert\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:53:21.212450 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.212454    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3df3cb58-cf25-43fc-a28d-3743cedef1e9-console-serving-cert\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:53:21.212450 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.212463    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvgpz\" (UniqueName: \"kubernetes.io/projected/3df3cb58-cf25-43fc-a28d-3743cedef1e9-kube-api-access-nvgpz\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:53:21.212715 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.212472    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-service-ca\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:53:21.212715 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.212481    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3df3cb58-cf25-43fc-a28d-3743cedef1e9-console-config\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:53:21.212715 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.212489    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3df3cb58-cf25-43fc-a28d-3743cedef1e9-console-oauth-config\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:53:21.717556 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.717525    2568 generic.go:356] "Generic (PLEG): container finished" podID="3df3cb58-cf25-43fc-a28d-3743cedef1e9" containerID="c6eaff05630aeae1e0b713d79a2d6bd1e3500ae1c2574c9af98875a2027a19cf" exitCode=0
Jul 09 16:53:21.718056 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.717581    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659fb76f4c-lf6fd"
Jul 09 16:53:21.718056 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.717616    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659fb76f4c-lf6fd" event={"ID":"3df3cb58-cf25-43fc-a28d-3743cedef1e9","Type":"ContainerDied","Data":"c6eaff05630aeae1e0b713d79a2d6bd1e3500ae1c2574c9af98875a2027a19cf"}
Jul 09 16:53:21.718056 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.717673    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659fb76f4c-lf6fd" event={"ID":"3df3cb58-cf25-43fc-a28d-3743cedef1e9","Type":"ContainerDied","Data":"9205058168a5e335662157199c63d253b580f5a00da1489bd05af93238d053b1"}
Jul 09 16:53:21.718056 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.717692    2568 scope.go:117] "RemoveContainer" containerID="c6eaff05630aeae1e0b713d79a2d6bd1e3500ae1c2574c9af98875a2027a19cf"
Jul 09 16:53:21.727295 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.727277    2568 scope.go:117] "RemoveContainer" containerID="c6eaff05630aeae1e0b713d79a2d6bd1e3500ae1c2574c9af98875a2027a19cf"
Jul 09 16:53:21.727630 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:53:21.727608    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6eaff05630aeae1e0b713d79a2d6bd1e3500ae1c2574c9af98875a2027a19cf\": container with ID starting with c6eaff05630aeae1e0b713d79a2d6bd1e3500ae1c2574c9af98875a2027a19cf not found: ID does not exist" containerID="c6eaff05630aeae1e0b713d79a2d6bd1e3500ae1c2574c9af98875a2027a19cf"
Jul 09 16:53:21.727689 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.727639    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6eaff05630aeae1e0b713d79a2d6bd1e3500ae1c2574c9af98875a2027a19cf"} err="failed to get container status \"c6eaff05630aeae1e0b713d79a2d6bd1e3500ae1c2574c9af98875a2027a19cf\": rpc error: code = NotFound desc = could not find container \"c6eaff05630aeae1e0b713d79a2d6bd1e3500ae1c2574c9af98875a2027a19cf\": container with ID starting with c6eaff05630aeae1e0b713d79a2d6bd1e3500ae1c2574c9af98875a2027a19cf not found: ID does not exist"
Jul 09 16:53:21.738244 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.738215    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-659fb76f4c-lf6fd"]
Jul 09 16:53:21.742003 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.741980    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-659fb76f4c-lf6fd"]
Jul 09 16:53:21.938187 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:21.938158    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3df3cb58-cf25-43fc-a28d-3743cedef1e9" path="/var/lib/kubelet/pods/3df3cb58-cf25-43fc-a28d-3743cedef1e9/volumes"
Jul 09 16:53:37.993793 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:37.993748    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:53:38.014236 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:38.014205    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:53:38.811152 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:38.811121    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 16:53:56.881298 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:56.881259    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68ffb7c5f9-dbcm6"]
Jul 09 16:53:56.881961 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:56.881692    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dec3f55a-cfff-4ba7-b214-8c00556d9d2b" containerName="console"
Jul 09 16:53:56.881961 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:56.881709    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dec3f55a-cfff-4ba7-b214-8c00556d9d2b" containerName="console"
Jul 09 16:53:56.881961 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:56.881719    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3df3cb58-cf25-43fc-a28d-3743cedef1e9" containerName="console"
Jul 09 16:53:56.881961 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:56.881726    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3df3cb58-cf25-43fc-a28d-3743cedef1e9" containerName="console"
Jul 09 16:53:56.881961 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:56.881746    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb67ee19-dcaa-461e-ac61-c5ca76052fd5" containerName="console"
Jul 09 16:53:56.881961 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:56.881751    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb67ee19-dcaa-461e-ac61-c5ca76052fd5" containerName="console"
Jul 09 16:53:56.881961 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:56.881804    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb67ee19-dcaa-461e-ac61-c5ca76052fd5" containerName="console"
Jul 09 16:53:56.881961 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:56.881811    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="dec3f55a-cfff-4ba7-b214-8c00556d9d2b" containerName="console"
Jul 09 16:53:56.881961 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:56.881818    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3df3cb58-cf25-43fc-a28d-3743cedef1e9" containerName="console"
Jul 09 16:53:56.883771 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:56.883751    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:56.914467 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:56.914433    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68ffb7c5f9-dbcm6"]
Jul 09 16:53:57.015866 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.015807    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-console-serving-cert\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.015866 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.015860    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-trusted-ca-bundle\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.016151 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.015896    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-service-ca\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.016151 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.016025    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-console-config\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.016151 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.016054    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-oauth-serving-cert\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.016326 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.016149    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-console-oauth-config\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.016326 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.016275    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6t5z\" (UniqueName: \"kubernetes.io/projected/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-kube-api-access-d6t5z\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.116931 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.116889    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-console-serving-cert\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.116931 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.116927    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-trusted-ca-bundle\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.117193 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.116954    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-service-ca\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.117193 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.116999    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-console-config\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.117193 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.117014    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-oauth-serving-cert\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.117193 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.117035    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-console-oauth-config\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.117193 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.117054    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6t5z\" (UniqueName: \"kubernetes.io/projected/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-kube-api-access-d6t5z\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.117953 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.117924    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-console-config\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.118056 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.117924    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-oauth-serving-cert\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.118056 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.117972    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-service-ca\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.118056 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.117981    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-trusted-ca-bundle\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.119403 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.119381    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-console-oauth-config\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.119524 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.119507    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-console-serving-cert\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.125463 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.125436    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6t5z\" (UniqueName: \"kubernetes.io/projected/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-kube-api-access-d6t5z\") pod \"console-68ffb7c5f9-dbcm6\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") " pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.194839 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.194744    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:53:57.332754 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.332722    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68ffb7c5f9-dbcm6"]
Jul 09 16:53:57.335499 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:53:57.335472    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ea525c8_73c1_4a82_8af4_e731e72d6bfe.slice/crio-696dd23c70365f65f06e6c895721b6f4af2dbca1f0b9e014595388e81d62d683 WatchSource:0}: Error finding container 696dd23c70365f65f06e6c895721b6f4af2dbca1f0b9e014595388e81d62d683: Status 404 returned error can't find the container with id 696dd23c70365f65f06e6c895721b6f4af2dbca1f0b9e014595388e81d62d683
Jul 09 16:53:57.882659 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.882631    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68ffb7c5f9-dbcm6" event={"ID":"6ea525c8-73c1-4a82-8af4-e731e72d6bfe","Type":"ContainerStarted","Data":"e06dc555331a05fc231e26a5a842512d019d29b71275f91153a45144e3090be2"}
Jul 09 16:53:57.883142 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.882676    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68ffb7c5f9-dbcm6" event={"ID":"6ea525c8-73c1-4a82-8af4-e731e72d6bfe","Type":"ContainerStarted","Data":"696dd23c70365f65f06e6c895721b6f4af2dbca1f0b9e014595388e81d62d683"}
Jul 09 16:53:57.903124 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:53:57.903068    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68ffb7c5f9-dbcm6" podStartSLOduration=1.903050729 podStartE2EDuration="1.903050729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:53:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:53:57.901658153 +0000 UTC m=+175.582074074" watchObservedRunningTime="2026-07-09 16:53:57.903050729 +0000 UTC m=+175.583466636"
Jul 09 16:54:07.195782 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:07.195728    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:54:07.195782 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:07.195800    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:54:07.200594 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:07.200569    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:54:07.931625 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:07.931591    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:54:07.979175 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:07.979128    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c8887f78f-4mv89"]
Jul 09 16:54:33.000749 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.000702    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c8887f78f-4mv89" podUID="db56cefb-a351-4f9b-8dd4-b0117d76f538" containerName="console" containerID="cri-o://c332b53781a1699d40f4fac9aa86b1c696562f2b8b73b35ced4c24e99945e710" gracePeriod=15
Jul 09 16:54:33.257178 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.257109    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:54:33.333446 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.333406    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db56cefb-a351-4f9b-8dd4-b0117d76f538-console-serving-cert\") pod \"db56cefb-a351-4f9b-8dd4-b0117d76f538\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") "
Jul 09 16:54:33.333649 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.333473    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cv2qs\" (UniqueName: \"kubernetes.io/projected/db56cefb-a351-4f9b-8dd4-b0117d76f538-kube-api-access-cv2qs\") pod \"db56cefb-a351-4f9b-8dd4-b0117d76f538\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") "
Jul 09 16:54:33.333649 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.333504    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-service-ca\") pod \"db56cefb-a351-4f9b-8dd4-b0117d76f538\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") "
Jul 09 16:54:33.333649 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.333526    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db56cefb-a351-4f9b-8dd4-b0117d76f538-console-oauth-config\") pod \"db56cefb-a351-4f9b-8dd4-b0117d76f538\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") "
Jul 09 16:54:33.333649 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.333541    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-trusted-ca-bundle\") pod \"db56cefb-a351-4f9b-8dd4-b0117d76f538\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") "
Jul 09 16:54:33.333867 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.333702    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-console-config\") pod \"db56cefb-a351-4f9b-8dd4-b0117d76f538\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") "
Jul 09 16:54:33.333867 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.333804    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-oauth-serving-cert\") pod \"db56cefb-a351-4f9b-8dd4-b0117d76f538\" (UID: \"db56cefb-a351-4f9b-8dd4-b0117d76f538\") "
Jul 09 16:54:33.333965 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.333910    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "db56cefb-a351-4f9b-8dd4-b0117d76f538" (UID: "db56cefb-a351-4f9b-8dd4-b0117d76f538"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:54:33.334055 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.334027    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-service-ca" (OuterVolumeSpecName: "service-ca") pod "db56cefb-a351-4f9b-8dd4-b0117d76f538" (UID: "db56cefb-a351-4f9b-8dd4-b0117d76f538"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:54:33.334154 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.334140    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-service-ca\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:54:33.334209 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.334160    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-trusted-ca-bundle\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:54:33.334209 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.334150    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-console-config" (OuterVolumeSpecName: "console-config") pod "db56cefb-a351-4f9b-8dd4-b0117d76f538" (UID: "db56cefb-a351-4f9b-8dd4-b0117d76f538"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:54:33.334281 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.334203    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "db56cefb-a351-4f9b-8dd4-b0117d76f538" (UID: "db56cefb-a351-4f9b-8dd4-b0117d76f538"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:54:33.335817 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.335787    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db56cefb-a351-4f9b-8dd4-b0117d76f538-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "db56cefb-a351-4f9b-8dd4-b0117d76f538" (UID: "db56cefb-a351-4f9b-8dd4-b0117d76f538"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 16:54:33.336122 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.336103    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db56cefb-a351-4f9b-8dd4-b0117d76f538-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "db56cefb-a351-4f9b-8dd4-b0117d76f538" (UID: "db56cefb-a351-4f9b-8dd4-b0117d76f538"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 16:54:33.336173 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.336127    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db56cefb-a351-4f9b-8dd4-b0117d76f538-kube-api-access-cv2qs" (OuterVolumeSpecName: "kube-api-access-cv2qs") pod "db56cefb-a351-4f9b-8dd4-b0117d76f538" (UID: "db56cefb-a351-4f9b-8dd4-b0117d76f538"). InnerVolumeSpecName "kube-api-access-cv2qs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:54:33.435259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.435217    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-oauth-serving-cert\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:54:33.435259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.435253    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db56cefb-a351-4f9b-8dd4-b0117d76f538-console-serving-cert\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:54:33.435259 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.435263    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cv2qs\" (UniqueName: \"kubernetes.io/projected/db56cefb-a351-4f9b-8dd4-b0117d76f538-kube-api-access-cv2qs\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:54:33.435604 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.435272    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db56cefb-a351-4f9b-8dd4-b0117d76f538-console-oauth-config\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:54:33.435604 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:33.435282    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db56cefb-a351-4f9b-8dd4-b0117d76f538-console-config\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:54:34.047531 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:34.047483    2568 generic.go:356] "Generic (PLEG): container finished" podID="db56cefb-a351-4f9b-8dd4-b0117d76f538" containerID="c332b53781a1699d40f4fac9aa86b1c696562f2b8b73b35ced4c24e99945e710" exitCode=0
Jul 09 16:54:34.047531 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:34.047534    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8887f78f-4mv89" event={"ID":"db56cefb-a351-4f9b-8dd4-b0117d76f538","Type":"ContainerDied","Data":"c332b53781a1699d40f4fac9aa86b1c696562f2b8b73b35ced4c24e99945e710"}
Jul 09 16:54:34.048021 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:34.047555    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8887f78f-4mv89"
Jul 09 16:54:34.048021 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:34.047611    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8887f78f-4mv89" event={"ID":"db56cefb-a351-4f9b-8dd4-b0117d76f538","Type":"ContainerDied","Data":"db3792398431fbd3791aa87b63200fc3ce886ad8892b5c88b059bc621663d46f"}
Jul 09 16:54:34.048021 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:34.047641    2568 scope.go:117] "RemoveContainer" containerID="c332b53781a1699d40f4fac9aa86b1c696562f2b8b73b35ced4c24e99945e710"
Jul 09 16:54:34.056662 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:34.056640    2568 scope.go:117] "RemoveContainer" containerID="c332b53781a1699d40f4fac9aa86b1c696562f2b8b73b35ced4c24e99945e710"
Jul 09 16:54:34.056976 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:54:34.056957    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c332b53781a1699d40f4fac9aa86b1c696562f2b8b73b35ced4c24e99945e710\": container with ID starting with c332b53781a1699d40f4fac9aa86b1c696562f2b8b73b35ced4c24e99945e710 not found: ID does not exist" containerID="c332b53781a1699d40f4fac9aa86b1c696562f2b8b73b35ced4c24e99945e710"
Jul 09 16:54:34.057046 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:34.056990    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c332b53781a1699d40f4fac9aa86b1c696562f2b8b73b35ced4c24e99945e710"} err="failed to get container status \"c332b53781a1699d40f4fac9aa86b1c696562f2b8b73b35ced4c24e99945e710\": rpc error: code = NotFound desc = could not find container \"c332b53781a1699d40f4fac9aa86b1c696562f2b8b73b35ced4c24e99945e710\": container with ID starting with c332b53781a1699d40f4fac9aa86b1c696562f2b8b73b35ced4c24e99945e710 not found: ID does not exist"
Jul 09 16:54:34.063898 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:34.063846    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c8887f78f-4mv89"]
Jul 09 16:54:34.066280 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:34.066250    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c8887f78f-4mv89"]
Jul 09 16:54:35.938418 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:54:35.938382    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db56cefb-a351-4f9b-8dd4-b0117d76f538" path="/var/lib/kubelet/pods/db56cefb-a351-4f9b-8dd4-b0117d76f538/volumes"
Jul 09 16:55:33.856798 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:33.856713    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-t2f2d"]
Jul 09 16:55:33.857256 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:33.857082    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db56cefb-a351-4f9b-8dd4-b0117d76f538" containerName="console"
Jul 09 16:55:33.857256 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:33.857093    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="db56cefb-a351-4f9b-8dd4-b0117d76f538" containerName="console"
Jul 09 16:55:33.857256 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:33.857160    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="db56cefb-a351-4f9b-8dd4-b0117d76f538" containerName="console"
Jul 09 16:55:33.859449 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:33.859428    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-t2f2d"
Jul 09 16:55:33.862103 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:33.862083    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 16:55:33.862206 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:33.862113    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4fd7f\""
Jul 09 16:55:33.863070 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:33.863051    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 16:55:33.869418 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:33.869388    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-t2f2d"]
Jul 09 16:55:33.986709 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:33.986665    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pkn4\" (UniqueName: \"kubernetes.io/projected/1a333596-ea65-4624-bcae-5572d62146d9-kube-api-access-7pkn4\") pod \"cert-manager-webhook-6486ffd997-t2f2d\" (UID: \"1a333596-ea65-4624-bcae-5572d62146d9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t2f2d"
Jul 09 16:55:33.986709 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:33.986708    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a333596-ea65-4624-bcae-5572d62146d9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-t2f2d\" (UID: \"1a333596-ea65-4624-bcae-5572d62146d9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t2f2d"
Jul 09 16:55:34.088073 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:34.088033    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pkn4\" (UniqueName: \"kubernetes.io/projected/1a333596-ea65-4624-bcae-5572d62146d9-kube-api-access-7pkn4\") pod \"cert-manager-webhook-6486ffd997-t2f2d\" (UID: \"1a333596-ea65-4624-bcae-5572d62146d9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t2f2d"
Jul 09 16:55:34.088073 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:34.088072    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a333596-ea65-4624-bcae-5572d62146d9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-t2f2d\" (UID: \"1a333596-ea65-4624-bcae-5572d62146d9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t2f2d"
Jul 09 16:55:34.096647 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:34.096610    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a333596-ea65-4624-bcae-5572d62146d9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-t2f2d\" (UID: \"1a333596-ea65-4624-bcae-5572d62146d9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t2f2d"
Jul 09 16:55:34.096808 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:34.096768    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pkn4\" (UniqueName: \"kubernetes.io/projected/1a333596-ea65-4624-bcae-5572d62146d9-kube-api-access-7pkn4\") pod \"cert-manager-webhook-6486ffd997-t2f2d\" (UID: \"1a333596-ea65-4624-bcae-5572d62146d9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t2f2d"
Jul 09 16:55:34.184833 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:34.184739    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-t2f2d"
Jul 09 16:55:34.325588 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:34.325553    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-t2f2d"]
Jul 09 16:55:34.329406 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:55:34.329374    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a333596_ea65_4624_bcae_5572d62146d9.slice/crio-3a9b6f86bd0544ec49b86cd03fe550a89a99380b83eaaedd3a8356fdea0b1104 WatchSource:0}: Error finding container 3a9b6f86bd0544ec49b86cd03fe550a89a99380b83eaaedd3a8356fdea0b1104: Status 404 returned error can't find the container with id 3a9b6f86bd0544ec49b86cd03fe550a89a99380b83eaaedd3a8356fdea0b1104
Jul 09 16:55:35.306229 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:35.306182    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-t2f2d" event={"ID":"1a333596-ea65-4624-bcae-5572d62146d9","Type":"ContainerStarted","Data":"3a9b6f86bd0544ec49b86cd03fe550a89a99380b83eaaedd3a8356fdea0b1104"}
Jul 09 16:55:37.317227 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:37.317112    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-t2f2d" event={"ID":"1a333596-ea65-4624-bcae-5572d62146d9","Type":"ContainerStarted","Data":"3e3c28ad8ca9db2cd91fb14c1da8659f442778419fbef6ac75bcc6fae5b7cb9d"}
Jul 09 16:55:37.317227 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:37.317197    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-t2f2d"
Jul 09 16:55:37.333409 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:37.333323    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-t2f2d" podStartSLOduration=1.547437697 podStartE2EDuration="4.333301445s" totalImagesPullingTime="2.785863748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:55:37.332456187 +0000 UTC m=+275.012872096" watchObservedRunningTime="2026-07-09 16:55:37.333301445 +0000 UTC m=+275.013717353"
Jul 09 16:55:43.324744 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:43.324712    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-t2f2d"
Jul 09 16:55:44.519436 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:44.519402    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-28wgn"]
Jul 09 16:55:44.521696 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:44.521677    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-28wgn"
Jul 09 16:55:44.524145 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:44.524115    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 16:55:44.524224 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:44.524177    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 16:55:44.524997 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:44.524978    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-tbxb6\""
Jul 09 16:55:44.535672 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:44.534176    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-28wgn"]
Jul 09 16:55:44.685972 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:44.685922    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b65b7d1b-f96f-4dd7-ac2d-3e0e100b7bbf-tmp\") pod \"openshift-lws-operator-fd8ccff4c-28wgn\" (UID: \"b65b7d1b-f96f-4dd7-ac2d-3e0e100b7bbf\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-28wgn"
Jul 09 16:55:44.686165 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:44.685994    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grjkg\" (UniqueName: \"kubernetes.io/projected/b65b7d1b-f96f-4dd7-ac2d-3e0e100b7bbf-kube-api-access-grjkg\") pod \"openshift-lws-operator-fd8ccff4c-28wgn\" (UID: \"b65b7d1b-f96f-4dd7-ac2d-3e0e100b7bbf\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-28wgn"
Jul 09 16:55:44.786920 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:44.786832    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b65b7d1b-f96f-4dd7-ac2d-3e0e100b7bbf-tmp\") pod \"openshift-lws-operator-fd8ccff4c-28wgn\" (UID: \"b65b7d1b-f96f-4dd7-ac2d-3e0e100b7bbf\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-28wgn"
Jul 09 16:55:44.786920 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:44.786887    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grjkg\" (UniqueName: \"kubernetes.io/projected/b65b7d1b-f96f-4dd7-ac2d-3e0e100b7bbf-kube-api-access-grjkg\") pod \"openshift-lws-operator-fd8ccff4c-28wgn\" (UID: \"b65b7d1b-f96f-4dd7-ac2d-3e0e100b7bbf\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-28wgn"
Jul 09 16:55:44.787254 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:44.787231    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b65b7d1b-f96f-4dd7-ac2d-3e0e100b7bbf-tmp\") pod \"openshift-lws-operator-fd8ccff4c-28wgn\" (UID: \"b65b7d1b-f96f-4dd7-ac2d-3e0e100b7bbf\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-28wgn"
Jul 09 16:55:44.794719 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:44.794694    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grjkg\" (UniqueName: \"kubernetes.io/projected/b65b7d1b-f96f-4dd7-ac2d-3e0e100b7bbf-kube-api-access-grjkg\") pod \"openshift-lws-operator-fd8ccff4c-28wgn\" (UID: \"b65b7d1b-f96f-4dd7-ac2d-3e0e100b7bbf\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-28wgn"
Jul 09 16:55:44.831681 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:44.831647    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-28wgn"
Jul 09 16:55:44.964666 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:44.964638    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-28wgn"]
Jul 09 16:55:44.967541 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:55:44.967514    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb65b7d1b_f96f_4dd7_ac2d_3e0e100b7bbf.slice/crio-766c23ad8d4ff33fe184d4b9683cc9f83d096a0dc3ecfb6b01f4a0a449404f93 WatchSource:0}: Error finding container 766c23ad8d4ff33fe184d4b9683cc9f83d096a0dc3ecfb6b01f4a0a449404f93: Status 404 returned error can't find the container with id 766c23ad8d4ff33fe184d4b9683cc9f83d096a0dc3ecfb6b01f4a0a449404f93
Jul 09 16:55:45.354219 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:45.354182    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-28wgn" event={"ID":"b65b7d1b-f96f-4dd7-ac2d-3e0e100b7bbf","Type":"ContainerStarted","Data":"766c23ad8d4ff33fe184d4b9683cc9f83d096a0dc3ecfb6b01f4a0a449404f93"}
Jul 09 16:55:48.372336 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:48.372288    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-28wgn" event={"ID":"b65b7d1b-f96f-4dd7-ac2d-3e0e100b7bbf","Type":"ContainerStarted","Data":"f0ffab9c30310d438e19ed9a9172f60f45a56b87f783d4e4c4c188f2b9eaa8ec"}
Jul 09 16:55:48.389233 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:55:48.389159    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-28wgn" podStartSLOduration=1.61498809 podStartE2EDuration="4.389126292s" totalImagesPullingTime="2.774138202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:55:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:55:48.38791245 +0000 UTC m=+286.068328362" watchObservedRunningTime="2026-07-09 16:55:48.389126292 +0000 UTC m=+286.069542199"
Jul 09 16:56:02.712847 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:02.712816    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ng88_54ed8699-4487-4246-9e22-3d15bd9908ca/ovn-acl-logging/0.log"
Jul 09 16:56:02.720920 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:02.720897    2568 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 16:56:02.721835 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:02.721817    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ng88_54ed8699-4487-4246-9e22-3d15bd9908ca/ovn-acl-logging/0.log"
Jul 09 16:56:08.020896 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.020857    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"]
Jul 09 16:56:08.026869 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.026849    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"
Jul 09 16:56:08.030111 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.030083    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p2xv8\""
Jul 09 16:56:08.030267 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.030086    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 16:56:08.030537 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.030521    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 16:56:08.030697 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.030681    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 16:56:08.030770 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.030720    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 16:56:08.054810 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.054780    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"]
Jul 09 16:56:08.098339 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.098297    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c4a4283c-2d84-49ca-8347-b6a90684d01a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fdb769df8-lrclt\" (UID: \"c4a4283c-2d84-49ca-8347-b6a90684d01a\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"
Jul 09 16:56:08.098339 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.098344    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4a4283c-2d84-49ca-8347-b6a90684d01a-tmp\") pod \"opendatahub-operator-controller-manager-fdb769df8-lrclt\" (UID: \"c4a4283c-2d84-49ca-8347-b6a90684d01a\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"
Jul 09 16:56:08.098632 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.098394    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvxhd\" (UniqueName: \"kubernetes.io/projected/c4a4283c-2d84-49ca-8347-b6a90684d01a-kube-api-access-nvxhd\") pod \"opendatahub-operator-controller-manager-fdb769df8-lrclt\" (UID: \"c4a4283c-2d84-49ca-8347-b6a90684d01a\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"
Jul 09 16:56:08.098632 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.098534    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4a4283c-2d84-49ca-8347-b6a90684d01a-webhook-cert\") pod \"opendatahub-operator-controller-manager-fdb769df8-lrclt\" (UID: \"c4a4283c-2d84-49ca-8347-b6a90684d01a\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"
Jul 09 16:56:08.098632 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.098572    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c4a4283c-2d84-49ca-8347-b6a90684d01a-manifests\") pod \"opendatahub-operator-controller-manager-fdb769df8-lrclt\" (UID: \"c4a4283c-2d84-49ca-8347-b6a90684d01a\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"
Jul 09 16:56:08.199479 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.199438    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c4a4283c-2d84-49ca-8347-b6a90684d01a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fdb769df8-lrclt\" (UID: \"c4a4283c-2d84-49ca-8347-b6a90684d01a\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"
Jul 09 16:56:08.199479 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.199484    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4a4283c-2d84-49ca-8347-b6a90684d01a-tmp\") pod \"opendatahub-operator-controller-manager-fdb769df8-lrclt\" (UID: \"c4a4283c-2d84-49ca-8347-b6a90684d01a\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"
Jul 09 16:56:08.199747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.199511    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvxhd\" (UniqueName: \"kubernetes.io/projected/c4a4283c-2d84-49ca-8347-b6a90684d01a-kube-api-access-nvxhd\") pod \"opendatahub-operator-controller-manager-fdb769df8-lrclt\" (UID: \"c4a4283c-2d84-49ca-8347-b6a90684d01a\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"
Jul 09 16:56:08.199747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.199596    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4a4283c-2d84-49ca-8347-b6a90684d01a-webhook-cert\") pod \"opendatahub-operator-controller-manager-fdb769df8-lrclt\" (UID: \"c4a4283c-2d84-49ca-8347-b6a90684d01a\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"
Jul 09 16:56:08.199747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.199620    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c4a4283c-2d84-49ca-8347-b6a90684d01a-manifests\") pod \"opendatahub-operator-controller-manager-fdb769df8-lrclt\" (UID: \"c4a4283c-2d84-49ca-8347-b6a90684d01a\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"
Jul 09 16:56:08.200019 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.199992    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c4a4283c-2d84-49ca-8347-b6a90684d01a-manifests\") pod \"opendatahub-operator-controller-manager-fdb769df8-lrclt\" (UID: \"c4a4283c-2d84-49ca-8347-b6a90684d01a\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"
Jul 09 16:56:08.201903 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.201882    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4a4283c-2d84-49ca-8347-b6a90684d01a-tmp\") pod \"opendatahub-operator-controller-manager-fdb769df8-lrclt\" (UID: \"c4a4283c-2d84-49ca-8347-b6a90684d01a\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"
Jul 09 16:56:08.202119 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.202101    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c4a4283c-2d84-49ca-8347-b6a90684d01a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fdb769df8-lrclt\" (UID: \"c4a4283c-2d84-49ca-8347-b6a90684d01a\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"
Jul 09 16:56:08.202181 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.202158    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4a4283c-2d84-49ca-8347-b6a90684d01a-webhook-cert\") pod \"opendatahub-operator-controller-manager-fdb769df8-lrclt\" (UID: \"c4a4283c-2d84-49ca-8347-b6a90684d01a\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"
Jul 09 16:56:08.208681 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.208650    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvxhd\" (UniqueName: \"kubernetes.io/projected/c4a4283c-2d84-49ca-8347-b6a90684d01a-kube-api-access-nvxhd\") pod \"opendatahub-operator-controller-manager-fdb769df8-lrclt\" (UID: \"c4a4283c-2d84-49ca-8347-b6a90684d01a\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"
Jul 09 16:56:08.337078 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.337044    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"
Jul 09 16:56:08.482170 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.482143    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"]
Jul 09 16:56:08.484395 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:56:08.484343    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4a4283c_2d84_49ca_8347_b6a90684d01a.slice/crio-c80913c02706cd1aaafbe7fb296f714c35fbad7afd495ef69442cd089f6b4760 WatchSource:0}: Error finding container c80913c02706cd1aaafbe7fb296f714c35fbad7afd495ef69442cd089f6b4760: Status 404 returned error can't find the container with id c80913c02706cd1aaafbe7fb296f714c35fbad7afd495ef69442cd089f6b4760
Jul 09 16:56:08.486296 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:08.486277    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 16:56:09.474578 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:09.474538    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt" event={"ID":"c4a4283c-2d84-49ca-8347-b6a90684d01a","Type":"ContainerStarted","Data":"c80913c02706cd1aaafbe7fb296f714c35fbad7afd495ef69442cd089f6b4760"}
Jul 09 16:56:12.491435 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:12.491395    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt" event={"ID":"c4a4283c-2d84-49ca-8347-b6a90684d01a","Type":"ContainerStarted","Data":"3eb2098fd8fd9e992d00abf35d831470a675cfc5ade979b00ed965350b5b9bea"}
Jul 09 16:56:13.497675 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:13.497637    2568 generic.go:356] "Generic (PLEG): container finished" podID="c4a4283c-2d84-49ca-8347-b6a90684d01a" containerID="3eb2098fd8fd9e992d00abf35d831470a675cfc5ade979b00ed965350b5b9bea" exitCode=0
Jul 09 16:56:13.498093 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:13.497732    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt" event={"ID":"c4a4283c-2d84-49ca-8347-b6a90684d01a","Type":"ContainerDied","Data":"3eb2098fd8fd9e992d00abf35d831470a675cfc5ade979b00ed965350b5b9bea"}
Jul 09 16:56:14.504517 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:14.504487    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt" event={"ID":"c4a4283c-2d84-49ca-8347-b6a90684d01a","Type":"ContainerStarted","Data":"a57bd788b5e6ff4722fd4a4145d521094ff6b0ae8b90887b90189da51bfa982a"}
Jul 09 16:56:14.504900 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:14.504622    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"
Jul 09 16:56:14.527704 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:14.527628    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt" podStartSLOduration=2.205807196 podStartE2EDuration="7.527577158s" totalImagesPullingTime="4.255310087s" totalInitContainerRuntime="1.066459875s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:56:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:56:14.526077842 +0000 UTC m=+312.206493752" watchObservedRunningTime="2026-07-09 16:56:14.527577158 +0000 UTC m=+312.207993067"
Jul 09 16:56:25.511231 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:25.511198    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-lrclt"
Jul 09 16:56:39.113904 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.113865    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc"]
Jul 09 16:56:39.116798 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.116774    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc"
Jul 09 16:56:39.120474 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.120441    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 16:56:39.120622 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.120483    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 16:56:39.120622 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.120518    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nv68j\""
Jul 09 16:56:39.120622 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.120449    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 16:56:39.128607 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.128580    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc"]
Jul 09 16:56:39.193672 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.193628    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b708a4f8-1731-4f38-b156-a72b8d8d1f88-metrics-cert\") pod \"lws-controller-manager-5c969b7c4d-wx9vc\" (UID: \"b708a4f8-1731-4f38-b156-a72b8d8d1f88\") " pod="openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc"
Jul 09 16:56:39.193672 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.193668    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcmkf\" (UniqueName: \"kubernetes.io/projected/b708a4f8-1731-4f38-b156-a72b8d8d1f88-kube-api-access-xcmkf\") pod \"lws-controller-manager-5c969b7c4d-wx9vc\" (UID: \"b708a4f8-1731-4f38-b156-a72b8d8d1f88\") " pod="openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc"
Jul 09 16:56:39.193933 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.193707    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b708a4f8-1731-4f38-b156-a72b8d8d1f88-manager-config\") pod \"lws-controller-manager-5c969b7c4d-wx9vc\" (UID: \"b708a4f8-1731-4f38-b156-a72b8d8d1f88\") " pod="openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc"
Jul 09 16:56:39.193933 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.193785    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b708a4f8-1731-4f38-b156-a72b8d8d1f88-cert\") pod \"lws-controller-manager-5c969b7c4d-wx9vc\" (UID: \"b708a4f8-1731-4f38-b156-a72b8d8d1f88\") " pod="openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc"
Jul 09 16:56:39.294303 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.294260    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b708a4f8-1731-4f38-b156-a72b8d8d1f88-metrics-cert\") pod \"lws-controller-manager-5c969b7c4d-wx9vc\" (UID: \"b708a4f8-1731-4f38-b156-a72b8d8d1f88\") " pod="openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc"
Jul 09 16:56:39.294303 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.294304    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcmkf\" (UniqueName: \"kubernetes.io/projected/b708a4f8-1731-4f38-b156-a72b8d8d1f88-kube-api-access-xcmkf\") pod \"lws-controller-manager-5c969b7c4d-wx9vc\" (UID: \"b708a4f8-1731-4f38-b156-a72b8d8d1f88\") " pod="openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc"
Jul 09 16:56:39.294587 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.294403    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b708a4f8-1731-4f38-b156-a72b8d8d1f88-manager-config\") pod \"lws-controller-manager-5c969b7c4d-wx9vc\" (UID: \"b708a4f8-1731-4f38-b156-a72b8d8d1f88\") " pod="openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc"
Jul 09 16:56:39.294587 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.294439    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b708a4f8-1731-4f38-b156-a72b8d8d1f88-cert\") pod \"lws-controller-manager-5c969b7c4d-wx9vc\" (UID: \"b708a4f8-1731-4f38-b156-a72b8d8d1f88\") " pod="openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc"
Jul 09 16:56:39.295116 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.295095    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b708a4f8-1731-4f38-b156-a72b8d8d1f88-manager-config\") pod \"lws-controller-manager-5c969b7c4d-wx9vc\" (UID: \"b708a4f8-1731-4f38-b156-a72b8d8d1f88\") " pod="openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc"
Jul 09 16:56:39.297038 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.297009    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b708a4f8-1731-4f38-b156-a72b8d8d1f88-cert\") pod \"lws-controller-manager-5c969b7c4d-wx9vc\" (UID: \"b708a4f8-1731-4f38-b156-a72b8d8d1f88\") " pod="openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc"
Jul 09 16:56:39.297132 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.297009    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b708a4f8-1731-4f38-b156-a72b8d8d1f88-metrics-cert\") pod \"lws-controller-manager-5c969b7c4d-wx9vc\" (UID: \"b708a4f8-1731-4f38-b156-a72b8d8d1f88\") " pod="openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc"
Jul 09 16:56:39.307467 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.307442    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcmkf\" (UniqueName: \"kubernetes.io/projected/b708a4f8-1731-4f38-b156-a72b8d8d1f88-kube-api-access-xcmkf\") pod \"lws-controller-manager-5c969b7c4d-wx9vc\" (UID: \"b708a4f8-1731-4f38-b156-a72b8d8d1f88\") " pod="openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc"
Jul 09 16:56:39.426756 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.426664    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc"
Jul 09 16:56:39.560408 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.560314    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc"]
Jul 09 16:56:39.563169 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:56:39.563138    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb708a4f8_1731_4f38_b156_a72b8d8d1f88.slice/crio-88ec85d1c6fe0b2bab8601ae5061c500753ceca0f2bc34500bcbd460328c53ed WatchSource:0}: Error finding container 88ec85d1c6fe0b2bab8601ae5061c500753ceca0f2bc34500bcbd460328c53ed: Status 404 returned error can't find the container with id 88ec85d1c6fe0b2bab8601ae5061c500753ceca0f2bc34500bcbd460328c53ed
Jul 09 16:56:39.621348 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:39.621314    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc" event={"ID":"b708a4f8-1731-4f38-b156-a72b8d8d1f88","Type":"ContainerStarted","Data":"88ec85d1c6fe0b2bab8601ae5061c500753ceca0f2bc34500bcbd460328c53ed"}
Jul 09 16:56:40.603709 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.603671    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zs8tf"]
Jul 09 16:56:40.607221 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.607191    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs8tf"
Jul 09 16:56:40.610245 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.610218    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-nltpt\""
Jul 09 16:56:40.610404 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.610260    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 09 16:56:40.621920 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.621886    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8mrww"]
Jul 09 16:56:40.625567 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.625541    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mrww"
Jul 09 16:56:40.627625 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.627591    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zs8tf"]
Jul 09 16:56:40.628254 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.628056    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 09 16:56:40.628254 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.628083    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-nxxqf\""
Jul 09 16:56:40.639220 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.639193    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8mrww"]
Jul 09 16:56:40.709375 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.709314    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvrnt\" (UniqueName: \"kubernetes.io/projected/1b3b0989-2d21-49a1-be0b-a78fe7cd64a3-kube-api-access-hvrnt\") pod \"llmisvc-controller-manager-777c6bd7d5-8mrww\" (UID: \"1b3b0989-2d21-49a1-be0b-a78fe7cd64a3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mrww"
Jul 09 16:56:40.709566 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.709400    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvzjj\" (UniqueName: \"kubernetes.io/projected/839507ef-1950-44c7-97b2-d85dcd8bb6dc-kube-api-access-dvzjj\") pod \"kserve-controller-manager-d6f4b65b8-zs8tf\" (UID: \"839507ef-1950-44c7-97b2-d85dcd8bb6dc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs8tf"
Jul 09 16:56:40.709566 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.709462    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/839507ef-1950-44c7-97b2-d85dcd8bb6dc-cert\") pod \"kserve-controller-manager-d6f4b65b8-zs8tf\" (UID: \"839507ef-1950-44c7-97b2-d85dcd8bb6dc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs8tf"
Jul 09 16:56:40.709566 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.709498    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b3b0989-2d21-49a1-be0b-a78fe7cd64a3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8mrww\" (UID: \"1b3b0989-2d21-49a1-be0b-a78fe7cd64a3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mrww"
Jul 09 16:56:40.811110 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.811072    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvrnt\" (UniqueName: \"kubernetes.io/projected/1b3b0989-2d21-49a1-be0b-a78fe7cd64a3-kube-api-access-hvrnt\") pod \"llmisvc-controller-manager-777c6bd7d5-8mrww\" (UID: \"1b3b0989-2d21-49a1-be0b-a78fe7cd64a3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mrww"
Jul 09 16:56:40.811312 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.811145    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvzjj\" (UniqueName: \"kubernetes.io/projected/839507ef-1950-44c7-97b2-d85dcd8bb6dc-kube-api-access-dvzjj\") pod \"kserve-controller-manager-d6f4b65b8-zs8tf\" (UID: \"839507ef-1950-44c7-97b2-d85dcd8bb6dc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs8tf"
Jul 09 16:56:40.811312 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.811189    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/839507ef-1950-44c7-97b2-d85dcd8bb6dc-cert\") pod \"kserve-controller-manager-d6f4b65b8-zs8tf\" (UID: \"839507ef-1950-44c7-97b2-d85dcd8bb6dc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs8tf"
Jul 09 16:56:40.811312 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.811210    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b3b0989-2d21-49a1-be0b-a78fe7cd64a3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8mrww\" (UID: \"1b3b0989-2d21-49a1-be0b-a78fe7cd64a3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mrww"
Jul 09 16:56:40.811529 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:56:40.811330    2568 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 09 16:56:40.811529 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:56:40.811447    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/839507ef-1950-44c7-97b2-d85dcd8bb6dc-cert podName:839507ef-1950-44c7-97b2-d85dcd8bb6dc nodeName:}" failed. No retries permitted until 2026-07-09 16:56:41.311428501 +0000 UTC m=+338.991844398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/839507ef-1950-44c7-97b2-d85dcd8bb6dc-cert") pod "kserve-controller-manager-d6f4b65b8-zs8tf" (UID: "839507ef-1950-44c7-97b2-d85dcd8bb6dc") : secret "kserve-webhook-server-cert" not found
Jul 09 16:56:40.814013 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.813986    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b3b0989-2d21-49a1-be0b-a78fe7cd64a3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8mrww\" (UID: \"1b3b0989-2d21-49a1-be0b-a78fe7cd64a3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mrww"
Jul 09 16:56:40.833376 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.833324    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvzjj\" (UniqueName: \"kubernetes.io/projected/839507ef-1950-44c7-97b2-d85dcd8bb6dc-kube-api-access-dvzjj\") pod \"kserve-controller-manager-d6f4b65b8-zs8tf\" (UID: \"839507ef-1950-44c7-97b2-d85dcd8bb6dc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs8tf"
Jul 09 16:56:40.839824 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.839793    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvrnt\" (UniqueName: \"kubernetes.io/projected/1b3b0989-2d21-49a1-be0b-a78fe7cd64a3-kube-api-access-hvrnt\") pod \"llmisvc-controller-manager-777c6bd7d5-8mrww\" (UID: \"1b3b0989-2d21-49a1-be0b-a78fe7cd64a3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mrww"
Jul 09 16:56:40.940898 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:40.940817    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mrww"
Jul 09 16:56:41.204429 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:41.204405    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8mrww"]
Jul 09 16:56:41.205694 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:56:41.205662    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1b3b0989_2d21_49a1_be0b_a78fe7cd64a3.slice/crio-2595bb6d9804c539f39adc8918b21c1a8be8b91e7fab813aa268fb0221efdec8 WatchSource:0}: Error finding container 2595bb6d9804c539f39adc8918b21c1a8be8b91e7fab813aa268fb0221efdec8: Status 404 returned error can't find the container with id 2595bb6d9804c539f39adc8918b21c1a8be8b91e7fab813aa268fb0221efdec8
Jul 09 16:56:41.317938 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:41.317897    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/839507ef-1950-44c7-97b2-d85dcd8bb6dc-cert\") pod \"kserve-controller-manager-d6f4b65b8-zs8tf\" (UID: \"839507ef-1950-44c7-97b2-d85dcd8bb6dc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs8tf"
Jul 09 16:56:41.320320 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:41.320290    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/839507ef-1950-44c7-97b2-d85dcd8bb6dc-cert\") pod \"kserve-controller-manager-d6f4b65b8-zs8tf\" (UID: \"839507ef-1950-44c7-97b2-d85dcd8bb6dc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs8tf"
Jul 09 16:56:41.522090 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:41.521991    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs8tf"
Jul 09 16:56:41.634340 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:41.634298    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc" event={"ID":"b708a4f8-1731-4f38-b156-a72b8d8d1f88","Type":"ContainerStarted","Data":"a9ba9f5578c91204ba4dcd91aca58f339956c5704fa6e36120526bd8ee9db0fc"}
Jul 09 16:56:41.634831 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:41.634483    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc"
Jul 09 16:56:41.635649 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:41.635623    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mrww" event={"ID":"1b3b0989-2d21-49a1-be0b-a78fe7cd64a3","Type":"ContainerStarted","Data":"2595bb6d9804c539f39adc8918b21c1a8be8b91e7fab813aa268fb0221efdec8"}
Jul 09 16:56:41.675348 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:41.675275    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zs8tf"]
Jul 09 16:56:41.676694 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:41.676651    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc" podStartSLOduration=1.130149792 podStartE2EDuration="2.676633982s" totalImagesPullingTime="1.54648419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:56:41.674327505 +0000 UTC m=+339.354743413" watchObservedRunningTime="2026-07-09 16:56:41.676633982 +0000 UTC m=+339.357049905"
Jul 09 16:56:41.677620 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:56:41.677596    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod839507ef_1950_44c7_97b2_d85dcd8bb6dc.slice/crio-b80b90f6b989f5610126c277f8811fca560b6e74ac819d74827f890eec3dab6e WatchSource:0}: Error finding container b80b90f6b989f5610126c277f8811fca560b6e74ac819d74827f890eec3dab6e: Status 404 returned error can't find the container with id b80b90f6b989f5610126c277f8811fca560b6e74ac819d74827f890eec3dab6e
Jul 09 16:56:42.643935 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:42.643892    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs8tf" event={"ID":"839507ef-1950-44c7-97b2-d85dcd8bb6dc","Type":"ContainerStarted","Data":"b80b90f6b989f5610126c277f8811fca560b6e74ac819d74827f890eec3dab6e"}
Jul 09 16:56:45.661418 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:45.661382    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mrww" event={"ID":"1b3b0989-2d21-49a1-be0b-a78fe7cd64a3","Type":"ContainerStarted","Data":"01e03ef69895c41c7a4b50dee340a157df6483b008b22461fed033aba9fd3936"}
Jul 09 16:56:45.661876 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:45.661451    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mrww"
Jul 09 16:56:45.662947 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:45.662920    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs8tf" event={"ID":"839507ef-1950-44c7-97b2-d85dcd8bb6dc","Type":"ContainerStarted","Data":"da39e2015ca40b5041551bdba3145aee23acdb06f8bfaa949cd1bb7c37abe00b"}
Jul 09 16:56:45.663068 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:45.663043    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs8tf"
Jul 09 16:56:45.679434 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:45.679381    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mrww" podStartSLOduration=2.11471116 podStartE2EDuration="5.679347352s" totalImagesPullingTime="3.564636192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:56:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:56:45.677611878 +0000 UTC m=+343.358027786" watchObservedRunningTime="2026-07-09 16:56:45.679347352 +0000 UTC m=+343.359763260"
Jul 09 16:56:45.695233 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:45.695179    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs8tf" podStartSLOduration=2.607720582 podStartE2EDuration="5.695159838s" totalImagesPullingTime="3.087439256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:56:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:56:45.693760207 +0000 UTC m=+343.374176115" watchObservedRunningTime="2026-07-09 16:56:45.695159838 +0000 UTC m=+343.375575745"
Jul 09 16:56:52.646815 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:56:52.646781    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c969b7c4d-wx9vc"
Jul 09 16:57:16.670299 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:16.670269    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8mrww"
Jul 09 16:57:16.673490 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:16.673462    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zs8tf"
Jul 09 16:57:29.250999 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:29.250961    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pjxts"]
Jul 09 16:57:29.253572 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:29.253553    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pjxts"
Jul 09 16:57:29.256322 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:29.256301    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rbzcb\""
Jul 09 16:57:29.256442 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:29.256306    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 16:57:29.257462 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:29.257428    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 16:57:29.273040 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:29.273004    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pjxts"]
Jul 09 16:57:29.351265 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:29.351224    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m95hn\" (UniqueName: \"kubernetes.io/projected/2669a3bd-8f11-4460-ade0-f16269bd6c8a-kube-api-access-m95hn\") pod \"kuadrant-operator-catalog-pjxts\" (UID: \"2669a3bd-8f11-4460-ade0-f16269bd6c8a\") " pod="kuadrant-system/kuadrant-operator-catalog-pjxts"
Jul 09 16:57:29.451772 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:29.451733    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m95hn\" (UniqueName: \"kubernetes.io/projected/2669a3bd-8f11-4460-ade0-f16269bd6c8a-kube-api-access-m95hn\") pod \"kuadrant-operator-catalog-pjxts\" (UID: \"2669a3bd-8f11-4460-ade0-f16269bd6c8a\") " pod="kuadrant-system/kuadrant-operator-catalog-pjxts"
Jul 09 16:57:29.464173 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:29.464137    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m95hn\" (UniqueName: \"kubernetes.io/projected/2669a3bd-8f11-4460-ade0-f16269bd6c8a-kube-api-access-m95hn\") pod \"kuadrant-operator-catalog-pjxts\" (UID: \"2669a3bd-8f11-4460-ade0-f16269bd6c8a\") " pod="kuadrant-system/kuadrant-operator-catalog-pjxts"
Jul 09 16:57:29.564389 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:29.564268    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pjxts"
Jul 09 16:57:29.606687 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:29.606652    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pjxts"]
Jul 09 16:57:29.698154 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:29.698129    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pjxts"]
Jul 09 16:57:29.700946 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:57:29.700917    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2669a3bd_8f11_4460_ade0_f16269bd6c8a.slice/crio-8e2eb2dbcc89aacf897afff553a22949eada5d39718b06e3e4ddf1227570e161 WatchSource:0}: Error finding container 8e2eb2dbcc89aacf897afff553a22949eada5d39718b06e3e4ddf1227570e161: Status 404 returned error can't find the container with id 8e2eb2dbcc89aacf897afff553a22949eada5d39718b06e3e4ddf1227570e161
Jul 09 16:57:29.825691 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:29.825660    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-whrfc"]
Jul 09 16:57:29.828622 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:29.828603    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-whrfc"
Jul 09 16:57:29.840777 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:29.840751    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-whrfc"]
Jul 09 16:57:29.855389 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:29.855339    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnlv5\" (UniqueName: \"kubernetes.io/projected/122284ef-8934-4639-a463-f4875532a01c-kube-api-access-pnlv5\") pod \"kuadrant-operator-catalog-whrfc\" (UID: \"122284ef-8934-4639-a463-f4875532a01c\") " pod="kuadrant-system/kuadrant-operator-catalog-whrfc"
Jul 09 16:57:29.872495 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:29.872459    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pjxts" event={"ID":"2669a3bd-8f11-4460-ade0-f16269bd6c8a","Type":"ContainerStarted","Data":"8e2eb2dbcc89aacf897afff553a22949eada5d39718b06e3e4ddf1227570e161"}
Jul 09 16:57:29.956856 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:29.956812    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnlv5\" (UniqueName: \"kubernetes.io/projected/122284ef-8934-4639-a463-f4875532a01c-kube-api-access-pnlv5\") pod \"kuadrant-operator-catalog-whrfc\" (UID: \"122284ef-8934-4639-a463-f4875532a01c\") " pod="kuadrant-system/kuadrant-operator-catalog-whrfc"
Jul 09 16:57:29.965174 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:29.965146    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnlv5\" (UniqueName: \"kubernetes.io/projected/122284ef-8934-4639-a463-f4875532a01c-kube-api-access-pnlv5\") pod \"kuadrant-operator-catalog-whrfc\" (UID: \"122284ef-8934-4639-a463-f4875532a01c\") " pod="kuadrant-system/kuadrant-operator-catalog-whrfc"
Jul 09 16:57:30.137834 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:30.137727    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-whrfc"
Jul 09 16:57:30.270825 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:30.270800    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-whrfc"]
Jul 09 16:57:30.272791 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:57:30.272764    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod122284ef_8934_4639_a463_f4875532a01c.slice/crio-4d73105c44f59b9adea4fa71ae23eb5bd57ee6b3449aedf6c7f9f6ff509ec421 WatchSource:0}: Error finding container 4d73105c44f59b9adea4fa71ae23eb5bd57ee6b3449aedf6c7f9f6ff509ec421: Status 404 returned error can't find the container with id 4d73105c44f59b9adea4fa71ae23eb5bd57ee6b3449aedf6c7f9f6ff509ec421
Jul 09 16:57:30.879710 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:30.879664    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-whrfc" event={"ID":"122284ef-8934-4639-a463-f4875532a01c","Type":"ContainerStarted","Data":"4d73105c44f59b9adea4fa71ae23eb5bd57ee6b3449aedf6c7f9f6ff509ec421"}
Jul 09 16:57:32.891623 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:32.891582    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pjxts" event={"ID":"2669a3bd-8f11-4460-ade0-f16269bd6c8a","Type":"ContainerStarted","Data":"3f970c209931309af12fbc6218f4a9e7bec8e5a0b60e87c10f16f71eac7fed95"}
Jul 09 16:57:32.892136 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:32.891659    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-pjxts" podUID="2669a3bd-8f11-4460-ade0-f16269bd6c8a" containerName="registry-server" containerID="cri-o://3f970c209931309af12fbc6218f4a9e7bec8e5a0b60e87c10f16f71eac7fed95" gracePeriod=2
Jul 09 16:57:32.893297 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:32.893267    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-whrfc" event={"ID":"122284ef-8934-4639-a463-f4875532a01c","Type":"ContainerStarted","Data":"0ed2200fa4322f18f6d7437a371e58d79661e4843608fe1fd706607768dcee34"}
Jul 09 16:57:32.906226 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:32.906178    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pjxts" podStartSLOduration=1.543940871 podStartE2EDuration="3.906159713s" totalImagesPullingTime="2.362218842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:57:32.905986638 +0000 UTC m=+390.586402545" watchObservedRunningTime="2026-07-09 16:57:32.906159713 +0000 UTC m=+390.586575621"
Jul 09 16:57:32.919979 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:32.919929    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-whrfc" podStartSLOduration=2.129074869 podStartE2EDuration="3.91991432s" totalImagesPullingTime="1.790839451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:57:32.91907768 +0000 UTC m=+390.599493581" watchObservedRunningTime="2026-07-09 16:57:32.91991432 +0000 UTC m=+390.600330228"
Jul 09 16:57:33.140092 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:33.140064    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pjxts"
Jul 09 16:57:33.188083 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:33.187998    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m95hn\" (UniqueName: \"kubernetes.io/projected/2669a3bd-8f11-4460-ade0-f16269bd6c8a-kube-api-access-m95hn\") pod \"2669a3bd-8f11-4460-ade0-f16269bd6c8a\" (UID: \"2669a3bd-8f11-4460-ade0-f16269bd6c8a\") "
Jul 09 16:57:33.190130 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:33.190098    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2669a3bd-8f11-4460-ade0-f16269bd6c8a-kube-api-access-m95hn" (OuterVolumeSpecName: "kube-api-access-m95hn") pod "2669a3bd-8f11-4460-ade0-f16269bd6c8a" (UID: "2669a3bd-8f11-4460-ade0-f16269bd6c8a"). InnerVolumeSpecName "kube-api-access-m95hn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:57:33.289625 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:33.289588    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m95hn\" (UniqueName: \"kubernetes.io/projected/2669a3bd-8f11-4460-ade0-f16269bd6c8a-kube-api-access-m95hn\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:57:33.899955 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:33.899917    2568 generic.go:356] "Generic (PLEG): container finished" podID="2669a3bd-8f11-4460-ade0-f16269bd6c8a" containerID="3f970c209931309af12fbc6218f4a9e7bec8e5a0b60e87c10f16f71eac7fed95" exitCode=0
Jul 09 16:57:33.900447 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:33.899959    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pjxts" event={"ID":"2669a3bd-8f11-4460-ade0-f16269bd6c8a","Type":"ContainerDied","Data":"3f970c209931309af12fbc6218f4a9e7bec8e5a0b60e87c10f16f71eac7fed95"}
Jul 09 16:57:33.900447 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:33.899965    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pjxts"
Jul 09 16:57:33.900447 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:33.900008    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pjxts" event={"ID":"2669a3bd-8f11-4460-ade0-f16269bd6c8a","Type":"ContainerDied","Data":"8e2eb2dbcc89aacf897afff553a22949eada5d39718b06e3e4ddf1227570e161"}
Jul 09 16:57:33.900447 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:33.900037    2568 scope.go:117] "RemoveContainer" containerID="3f970c209931309af12fbc6218f4a9e7bec8e5a0b60e87c10f16f71eac7fed95"
Jul 09 16:57:33.919395 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:33.919322    2568 scope.go:117] "RemoveContainer" containerID="3f970c209931309af12fbc6218f4a9e7bec8e5a0b60e87c10f16f71eac7fed95"
Jul 09 16:57:33.919556 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:57:33.919534    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f970c209931309af12fbc6218f4a9e7bec8e5a0b60e87c10f16f71eac7fed95\": container with ID starting with 3f970c209931309af12fbc6218f4a9e7bec8e5a0b60e87c10f16f71eac7fed95 not found: ID does not exist" containerID="3f970c209931309af12fbc6218f4a9e7bec8e5a0b60e87c10f16f71eac7fed95"
Jul 09 16:57:33.919620 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:33.919565    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f970c209931309af12fbc6218f4a9e7bec8e5a0b60e87c10f16f71eac7fed95"} err="failed to get container status \"3f970c209931309af12fbc6218f4a9e7bec8e5a0b60e87c10f16f71eac7fed95\": rpc error: code = NotFound desc = could not find container \"3f970c209931309af12fbc6218f4a9e7bec8e5a0b60e87c10f16f71eac7fed95\": container with ID starting with 3f970c209931309af12fbc6218f4a9e7bec8e5a0b60e87c10f16f71eac7fed95 not found: ID does not exist"
Jul 09 16:57:33.925168 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:33.925143    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pjxts"]
Jul 09 16:57:33.928923 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:33.928891    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pjxts"]
Jul 09 16:57:33.939118 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:33.939092    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2669a3bd-8f11-4460-ade0-f16269bd6c8a" path="/var/lib/kubelet/pods/2669a3bd-8f11-4460-ade0-f16269bd6c8a/volumes"
Jul 09 16:57:40.138202 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:40.138157    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-whrfc"
Jul 09 16:57:40.138725 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:40.138228    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-whrfc"
Jul 09 16:57:40.162135 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:40.162109    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-whrfc"
Jul 09 16:57:40.957836 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:40.956995    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-whrfc"
Jul 09 16:57:53.221452 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.221420    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cbff4d568-hb9ff"]
Jul 09 16:57:53.222003 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.221785    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2669a3bd-8f11-4460-ade0-f16269bd6c8a" containerName="registry-server"
Jul 09 16:57:53.222003 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.221795    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2669a3bd-8f11-4460-ade0-f16269bd6c8a" containerName="registry-server"
Jul 09 16:57:53.222003 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.221868    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2669a3bd-8f11-4460-ade0-f16269bd6c8a" containerName="registry-server"
Jul 09 16:57:53.226340 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.226311    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.238035 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.238003    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cbff4d568-hb9ff"]
Jul 09 16:57:53.378774 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.378731    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/900053bf-e287-4ab6-b916-1f46cfa77715-console-serving-cert\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.378946 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.378809    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/900053bf-e287-4ab6-b916-1f46cfa77715-console-oauth-config\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.378946 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.378831    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/900053bf-e287-4ab6-b916-1f46cfa77715-service-ca\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.378946 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.378863    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/900053bf-e287-4ab6-b916-1f46cfa77715-console-config\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.378946 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.378904    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/900053bf-e287-4ab6-b916-1f46cfa77715-trusted-ca-bundle\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.378946 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.378920    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kllsr\" (UniqueName: \"kubernetes.io/projected/900053bf-e287-4ab6-b916-1f46cfa77715-kube-api-access-kllsr\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.379121 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.378984    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/900053bf-e287-4ab6-b916-1f46cfa77715-oauth-serving-cert\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.479662 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.479571    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/900053bf-e287-4ab6-b916-1f46cfa77715-console-serving-cert\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.479797 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.479730    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/900053bf-e287-4ab6-b916-1f46cfa77715-console-oauth-config\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.479797 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.479777    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/900053bf-e287-4ab6-b916-1f46cfa77715-service-ca\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.479906 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.479829    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/900053bf-e287-4ab6-b916-1f46cfa77715-console-config\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.479906 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.479891    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/900053bf-e287-4ab6-b916-1f46cfa77715-trusted-ca-bundle\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.480009 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.479915    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kllsr\" (UniqueName: \"kubernetes.io/projected/900053bf-e287-4ab6-b916-1f46cfa77715-kube-api-access-kllsr\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.480009 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.479957    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/900053bf-e287-4ab6-b916-1f46cfa77715-oauth-serving-cert\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.480648 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.480622    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/900053bf-e287-4ab6-b916-1f46cfa77715-console-config\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.480756 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.480651    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/900053bf-e287-4ab6-b916-1f46cfa77715-oauth-serving-cert\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.480756 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.480653    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/900053bf-e287-4ab6-b916-1f46cfa77715-service-ca\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.480932 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.480908    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/900053bf-e287-4ab6-b916-1f46cfa77715-trusted-ca-bundle\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.482295 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.482273    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/900053bf-e287-4ab6-b916-1f46cfa77715-console-oauth-config\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.482345 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.482299    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/900053bf-e287-4ab6-b916-1f46cfa77715-console-serving-cert\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.488924 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.488901    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kllsr\" (UniqueName: \"kubernetes.io/projected/900053bf-e287-4ab6-b916-1f46cfa77715-kube-api-access-kllsr\") pod \"console-6cbff4d568-hb9ff\" (UID: \"900053bf-e287-4ab6-b916-1f46cfa77715\") " pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.536917 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.536877    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:57:53.679027 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.679000    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cbff4d568-hb9ff"]
Jul 09 16:57:53.682032 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:57:53.682003    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod900053bf_e287_4ab6_b916_1f46cfa77715.slice/crio-0ef52818afdc10bebda2a9d9f83cc3e451559342d3df5b76e51ee6439282b65a WatchSource:0}: Error finding container 0ef52818afdc10bebda2a9d9f83cc3e451559342d3df5b76e51ee6439282b65a: Status 404 returned error can't find the container with id 0ef52818afdc10bebda2a9d9f83cc3e451559342d3df5b76e51ee6439282b65a
Jul 09 16:57:53.997692 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.997590    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cbff4d568-hb9ff" event={"ID":"900053bf-e287-4ab6-b916-1f46cfa77715","Type":"ContainerStarted","Data":"3305dff4b70ad9891d451fc25a6dda7080cec92f06f6e97591411b10241d264f"}
Jul 09 16:57:53.997692 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:53.997647    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cbff4d568-hb9ff" event={"ID":"900053bf-e287-4ab6-b916-1f46cfa77715","Type":"ContainerStarted","Data":"0ef52818afdc10bebda2a9d9f83cc3e451559342d3df5b76e51ee6439282b65a"}
Jul 09 16:57:54.020988 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:57:54.020920    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cbff4d568-hb9ff" podStartSLOduration=1.020904391 podStartE2EDuration="1.020904391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:57:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:57:54.01902758 +0000 UTC m=+411.699443490" watchObservedRunningTime="2026-07-09 16:57:54.020904391 +0000 UTC m=+411.701320299"
Jul 09 16:58:03.537956 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:03.537918    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:58:03.538394 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:03.537977    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:58:03.542679 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:03.542657    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:58:04.054827 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:04.054799    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cbff4d568-hb9ff"
Jul 09 16:58:04.123018 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:04.122984    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68ffb7c5f9-dbcm6"]
Jul 09 16:58:09.511781 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:09.511740    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"]
Jul 09 16:58:09.520071 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:09.520046    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"
Jul 09 16:58:09.523177 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:09.523157    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n7fkt\""
Jul 09 16:58:09.542761 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:09.542732    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"]
Jul 09 16:58:09.626677 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:09.626639    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c969c794-7d09-4b0b-900f-0ba55ed1b60c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wwzsh\" (UID: \"c969c794-7d09-4b0b-900f-0ba55ed1b60c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"
Jul 09 16:58:09.626677 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:09.626676    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx4j7\" (UniqueName: \"kubernetes.io/projected/c969c794-7d09-4b0b-900f-0ba55ed1b60c-kube-api-access-mx4j7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wwzsh\" (UID: \"c969c794-7d09-4b0b-900f-0ba55ed1b60c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"
Jul 09 16:58:09.727927 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:09.727877    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c969c794-7d09-4b0b-900f-0ba55ed1b60c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wwzsh\" (UID: \"c969c794-7d09-4b0b-900f-0ba55ed1b60c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"
Jul 09 16:58:09.727927 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:09.727931    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx4j7\" (UniqueName: \"kubernetes.io/projected/c969c794-7d09-4b0b-900f-0ba55ed1b60c-kube-api-access-mx4j7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wwzsh\" (UID: \"c969c794-7d09-4b0b-900f-0ba55ed1b60c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"
Jul 09 16:58:09.728314 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:09.728289    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c969c794-7d09-4b0b-900f-0ba55ed1b60c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wwzsh\" (UID: \"c969c794-7d09-4b0b-900f-0ba55ed1b60c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"
Jul 09 16:58:09.738440 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:09.738414    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx4j7\" (UniqueName: \"kubernetes.io/projected/c969c794-7d09-4b0b-900f-0ba55ed1b60c-kube-api-access-mx4j7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wwzsh\" (UID: \"c969c794-7d09-4b0b-900f-0ba55ed1b60c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"
Jul 09 16:58:09.830228 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:09.830182    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"
Jul 09 16:58:09.990210 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:09.990172    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"]
Jul 09 16:58:09.992346 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:58:09.992322    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc969c794_7d09_4b0b_900f_0ba55ed1b60c.slice/crio-add7d1121bc61cdbf1edbf02b47c7733931ef29272a11ca026023ae558f0e757 WatchSource:0}: Error finding container add7d1121bc61cdbf1edbf02b47c7733931ef29272a11ca026023ae558f0e757: Status 404 returned error can't find the container with id add7d1121bc61cdbf1edbf02b47c7733931ef29272a11ca026023ae558f0e757
Jul 09 16:58:10.081606 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:10.081522    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh" event={"ID":"c969c794-7d09-4b0b-900f-0ba55ed1b60c","Type":"ContainerStarted","Data":"add7d1121bc61cdbf1edbf02b47c7733931ef29272a11ca026023ae558f0e757"}
Jul 09 16:58:14.137442 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:14.137408    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgn7"]
Jul 09 16:58:14.141482 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:14.141448    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgn7"
Jul 09 16:58:14.143978 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:14.143955    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 09 16:58:14.143978 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:14.143955    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-z25p7\""
Jul 09 16:58:14.154009 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:14.153987    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgn7"]
Jul 09 16:58:14.169606 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:14.169574    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmwch\" (UniqueName: \"kubernetes.io/projected/c1f9e985-28cd-4ef3-8dbe-13c1199f65b8-kube-api-access-dmwch\") pod \"dns-operator-controller-manager-864dd78c4c-qhgn7\" (UID: \"c1f9e985-28cd-4ef3-8dbe-13c1199f65b8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgn7"
Jul 09 16:58:14.270017 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:14.269985    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmwch\" (UniqueName: \"kubernetes.io/projected/c1f9e985-28cd-4ef3-8dbe-13c1199f65b8-kube-api-access-dmwch\") pod \"dns-operator-controller-manager-864dd78c4c-qhgn7\" (UID: \"c1f9e985-28cd-4ef3-8dbe-13c1199f65b8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgn7"
Jul 09 16:58:14.280633 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:14.280606    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmwch\" (UniqueName: \"kubernetes.io/projected/c1f9e985-28cd-4ef3-8dbe-13c1199f65b8-kube-api-access-dmwch\") pod \"dns-operator-controller-manager-864dd78c4c-qhgn7\" (UID: \"c1f9e985-28cd-4ef3-8dbe-13c1199f65b8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgn7"
Jul 09 16:58:14.453368 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:14.453257    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgn7"
Jul 09 16:58:15.558208 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:15.558184    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgn7"]
Jul 09 16:58:15.560890 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:58:15.560854    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1f9e985_28cd_4ef3_8dbe_13c1199f65b8.slice/crio-ba0c9c27bb31c03d32d9979550c06fac8c66cebe2eb7c9f2aae7bb0477a6822f WatchSource:0}: Error finding container ba0c9c27bb31c03d32d9979550c06fac8c66cebe2eb7c9f2aae7bb0477a6822f: Status 404 returned error can't find the container with id ba0c9c27bb31c03d32d9979550c06fac8c66cebe2eb7c9f2aae7bb0477a6822f
Jul 09 16:58:16.116140 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:16.116064    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgn7" event={"ID":"c1f9e985-28cd-4ef3-8dbe-13c1199f65b8","Type":"ContainerStarted","Data":"ba0c9c27bb31c03d32d9979550c06fac8c66cebe2eb7c9f2aae7bb0477a6822f"}
Jul 09 16:58:16.118221 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:16.118188    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh" event={"ID":"c969c794-7d09-4b0b-900f-0ba55ed1b60c","Type":"ContainerStarted","Data":"5389e1b2dfaecff98cc9f74a261cef2e88feed08916cc22489fc44d73fdf6caa"}
Jul 09 16:58:16.118426 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:16.118283    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"
Jul 09 16:58:16.141186 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:16.141130    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh" podStartSLOduration=1.642168324 podStartE2EDuration="7.141114588s" totalImagesPullingTime="5.498946264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:58:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:58:16.139657716 +0000 UTC m=+433.820073624" watchObservedRunningTime="2026-07-09 16:58:16.141114588 +0000 UTC m=+433.821530542"
Jul 09 16:58:16.681423 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:16.681379    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw"]
Jul 09 16:58:16.685298 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:16.685274    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw"
Jul 09 16:58:16.688313 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:16.688294    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-r6mnf\""
Jul 09 16:58:16.710025 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:16.709946    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw"]
Jul 09 16:58:16.794338 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:16.794296    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghdw9\" (UniqueName: \"kubernetes.io/projected/99a13dc2-dfa4-48e8-a158-65a071ad5da3-kube-api-access-ghdw9\") pod \"limitador-operator-controller-manager-859d7b78bd-2k8zw\" (UID: \"99a13dc2-dfa4-48e8-a158-65a071ad5da3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw"
Jul 09 16:58:16.895510 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:16.895470    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghdw9\" (UniqueName: \"kubernetes.io/projected/99a13dc2-dfa4-48e8-a158-65a071ad5da3-kube-api-access-ghdw9\") pod \"limitador-operator-controller-manager-859d7b78bd-2k8zw\" (UID: \"99a13dc2-dfa4-48e8-a158-65a071ad5da3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw"
Jul 09 16:58:16.909839 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:16.909808    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghdw9\" (UniqueName: \"kubernetes.io/projected/99a13dc2-dfa4-48e8-a158-65a071ad5da3-kube-api-access-ghdw9\") pod \"limitador-operator-controller-manager-859d7b78bd-2k8zw\" (UID: \"99a13dc2-dfa4-48e8-a158-65a071ad5da3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw"
Jul 09 16:58:16.999075 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:16.998990    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw"
Jul 09 16:58:17.153043 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:17.153012    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw"]
Jul 09 16:58:17.381842 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:58:17.381807    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99a13dc2_dfa4_48e8_a158_65a071ad5da3.slice/crio-f963bf726c289e8d763284dbcdf4a4f5b64a5cc23519fb891518d8114e2eff03 WatchSource:0}: Error finding container f963bf726c289e8d763284dbcdf4a4f5b64a5cc23519fb891518d8114e2eff03: Status 404 returned error can't find the container with id f963bf726c289e8d763284dbcdf4a4f5b64a5cc23519fb891518d8114e2eff03
Jul 09 16:58:18.131641 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:18.131558    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgn7" event={"ID":"c1f9e985-28cd-4ef3-8dbe-13c1199f65b8","Type":"ContainerStarted","Data":"e7bc10137d631f7e523210fc39dfd1227ce2ed37de5ee71bc1d45b599ce844dd"}
Jul 09 16:58:18.132067 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:18.131710    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgn7"
Jul 09 16:58:18.132988 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:18.132968    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw" event={"ID":"99a13dc2-dfa4-48e8-a158-65a071ad5da3","Type":"ContainerStarted","Data":"f963bf726c289e8d763284dbcdf4a4f5b64a5cc23519fb891518d8114e2eff03"}
Jul 09 16:58:18.167326 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:18.167269    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgn7" podStartSLOduration=2.299649615 podStartE2EDuration="4.167253479s" totalImagesPullingTime="1.867603864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:58:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:58:18.166727335 +0000 UTC m=+435.847143240" watchObservedRunningTime="2026-07-09 16:58:18.167253479 +0000 UTC m=+435.847669386"
Jul 09 16:58:19.139962 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:19.139922    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw" event={"ID":"99a13dc2-dfa4-48e8-a158-65a071ad5da3","Type":"ContainerStarted","Data":"8211a293f3beb178bfa8260e58ce682c655d88bfd8c1f119359e210ded05ba0f"}
Jul 09 16:58:19.140442 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:19.140188    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw"
Jul 09 16:58:19.190569 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:19.190513    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw" podStartSLOduration=1.782620214 podStartE2EDuration="3.19049141s" totalImagesPullingTime="1.407871196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:58:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:58:19.189491989 +0000 UTC m=+436.869907889" watchObservedRunningTime="2026-07-09 16:58:19.19049141 +0000 UTC m=+436.870907317"
Jul 09 16:58:27.126747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:27.126676    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"
Jul 09 16:58:28.947245 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:28.947207    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"]
Jul 09 16:58:28.947675 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:28.947408    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh" podUID="c969c794-7d09-4b0b-900f-0ba55ed1b60c" containerName="manager" containerID="cri-o://5389e1b2dfaecff98cc9f74a261cef2e88feed08916cc22489fc44d73fdf6caa" gracePeriod=2
Jul 09 16:58:28.957044 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:28.956756    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"]
Jul 09 16:58:28.999774 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:28.999745    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847"]
Jul 09 16:58:29.000387 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.000343    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c969c794-7d09-4b0b-900f-0ba55ed1b60c" containerName="manager"
Jul 09 16:58:29.000446 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.000391    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c969c794-7d09-4b0b-900f-0ba55ed1b60c" containerName="manager"
Jul 09 16:58:29.000534 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.000523    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c969c794-7d09-4b0b-900f-0ba55ed1b60c" containerName="manager"
Jul 09 16:58:29.004211 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.004191    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw"]
Jul 09 16:58:29.004336 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.004317    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847"
Jul 09 16:58:29.004416 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.004335    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw" podUID="99a13dc2-dfa4-48e8-a158-65a071ad5da3" containerName="manager" containerID="cri-o://8211a293f3beb178bfa8260e58ce682c655d88bfd8c1f119359e210ded05ba0f" gracePeriod=2
Jul 09 16:58:29.006455 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.006431    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw"
Jul 09 16:58:29.010299 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.010274    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw"]
Jul 09 16:58:29.030465 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.030417    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847"]
Jul 09 16:58:29.050851 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.050820    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxbxz"]
Jul 09 16:58:29.051921 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.051893    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99a13dc2-dfa4-48e8-a158-65a071ad5da3" containerName="manager"
Jul 09 16:58:29.052521 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.051920    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="99a13dc2-dfa4-48e8-a158-65a071ad5da3" containerName="manager"
Jul 09 16:58:29.052521 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.052068    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="99a13dc2-dfa4-48e8-a158-65a071ad5da3" containerName="manager"
Jul 09 16:58:29.052521 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:58:29.052348    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wwzsh\" is forbidden: User \"system:node:ip-10-0-140-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-229.ec2.internal' and this object" podUID="c969c794-7d09-4b0b-900f-0ba55ed1b60c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"
Jul 09 16:58:29.055657 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.055634    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxbxz"
Jul 09 16:58:29.057611 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:58:29.057585    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2k8zw\" is forbidden: User \"system:node:ip-10-0-140-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-229.ec2.internal' and this object" podUID="99a13dc2-dfa4-48e8-a158-65a071ad5da3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw"
Jul 09 16:58:29.059837 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:58:29.059811    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2k8zw\" is forbidden: User \"system:node:ip-10-0-140-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-229.ec2.internal' and this object" podUID="99a13dc2-dfa4-48e8-a158-65a071ad5da3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw"
Jul 09 16:58:29.062833 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:58:29.062770    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wwzsh\" is forbidden: User \"system:node:ip-10-0-140-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-229.ec2.internal' and this object" podUID="c969c794-7d09-4b0b-900f-0ba55ed1b60c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"
Jul 09 16:58:29.069102 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.069079    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxbxz"]
Jul 09 16:58:29.110908 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.110875    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b23acdd9-500c-481a-a87d-da4fc054af56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4m847\" (UID: \"b23acdd9-500c-481a-a87d-da4fc054af56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847"
Jul 09 16:58:29.111009 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.110933    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs5x5\" (UniqueName: \"kubernetes.io/projected/b23acdd9-500c-481a-a87d-da4fc054af56-kube-api-access-bs5x5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4m847\" (UID: \"b23acdd9-500c-481a-a87d-da4fc054af56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847"
Jul 09 16:58:29.111009 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.110972    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2p47\" (UniqueName: \"kubernetes.io/projected/d948c6cb-6dc9-46d2-8651-8b6b0b2ef03a-kube-api-access-f2p47\") pod \"limitador-operator-controller-manager-859d7b78bd-rxbxz\" (UID: \"d948c6cb-6dc9-46d2-8651-8b6b0b2ef03a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxbxz"
Jul 09 16:58:29.143265 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.143230    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgn7"
Jul 09 16:58:29.144425 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.144395    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-68ffb7c5f9-dbcm6" podUID="6ea525c8-73c1-4a82-8af4-e731e72d6bfe" containerName="console" containerID="cri-o://e06dc555331a05fc231e26a5a842512d019d29b71275f91153a45144e3090be2" gracePeriod=15
Jul 09 16:58:29.146028 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:58:29.146003    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wwzsh\" is forbidden: User \"system:node:ip-10-0-140-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-229.ec2.internal' and this object" podUID="c969c794-7d09-4b0b-900f-0ba55ed1b60c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"
Jul 09 16:58:29.178951 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:58:29.178845    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2k8zw\" is forbidden: User \"system:node:ip-10-0-140-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-229.ec2.internal' and this object" podUID="99a13dc2-dfa4-48e8-a158-65a071ad5da3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw"
Jul 09 16:58:29.195645 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.195540    2568 generic.go:356] "Generic (PLEG): container finished" podID="99a13dc2-dfa4-48e8-a158-65a071ad5da3" containerID="8211a293f3beb178bfa8260e58ce682c655d88bfd8c1f119359e210ded05ba0f" exitCode=0
Jul 09 16:58:29.197995 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.197909    2568 generic.go:356] "Generic (PLEG): container finished" podID="c969c794-7d09-4b0b-900f-0ba55ed1b60c" containerID="5389e1b2dfaecff98cc9f74a261cef2e88feed08916cc22489fc44d73fdf6caa" exitCode=0
Jul 09 16:58:29.212685 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.212651    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs5x5\" (UniqueName: \"kubernetes.io/projected/b23acdd9-500c-481a-a87d-da4fc054af56-kube-api-access-bs5x5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4m847\" (UID: \"b23acdd9-500c-481a-a87d-da4fc054af56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847"
Jul 09 16:58:29.212829 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.212756    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2p47\" (UniqueName: \"kubernetes.io/projected/d948c6cb-6dc9-46d2-8651-8b6b0b2ef03a-kube-api-access-f2p47\") pod \"limitador-operator-controller-manager-859d7b78bd-rxbxz\" (UID: \"d948c6cb-6dc9-46d2-8651-8b6b0b2ef03a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxbxz"
Jul 09 16:58:29.213328 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.212882    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b23acdd9-500c-481a-a87d-da4fc054af56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4m847\" (UID: \"b23acdd9-500c-481a-a87d-da4fc054af56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847"
Jul 09 16:58:29.213328 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.213300    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b23acdd9-500c-481a-a87d-da4fc054af56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4m847\" (UID: \"b23acdd9-500c-481a-a87d-da4fc054af56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847"
Jul 09 16:58:29.225717 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.225677    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs5x5\" (UniqueName: \"kubernetes.io/projected/b23acdd9-500c-481a-a87d-da4fc054af56-kube-api-access-bs5x5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4m847\" (UID: \"b23acdd9-500c-481a-a87d-da4fc054af56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847"
Jul 09 16:58:29.227118 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.227091    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2p47\" (UniqueName: \"kubernetes.io/projected/d948c6cb-6dc9-46d2-8651-8b6b0b2ef03a-kube-api-access-f2p47\") pod \"limitador-operator-controller-manager-859d7b78bd-rxbxz\" (UID: \"d948c6cb-6dc9-46d2-8651-8b6b0b2ef03a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxbxz"
Jul 09 16:58:29.258328 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.258292    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw"
Jul 09 16:58:29.260873 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.260844    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"
Jul 09 16:58:29.261005 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:58:29.260985    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wwzsh\" is forbidden: User \"system:node:ip-10-0-140-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-229.ec2.internal' and this object" podUID="c969c794-7d09-4b0b-900f-0ba55ed1b60c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"
Jul 09 16:58:29.263166 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:58:29.263139    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2k8zw\" is forbidden: User \"system:node:ip-10-0-140-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-229.ec2.internal' and this object" podUID="99a13dc2-dfa4-48e8-a158-65a071ad5da3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw"
Jul 09 16:58:29.265556 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:58:29.265528    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wwzsh\" is forbidden: User \"system:node:ip-10-0-140-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-229.ec2.internal' and this object" podUID="c969c794-7d09-4b0b-900f-0ba55ed1b60c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"
Jul 09 16:58:29.267489 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:58:29.267465    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2k8zw\" is forbidden: User \"system:node:ip-10-0-140-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-229.ec2.internal' and this object" podUID="99a13dc2-dfa4-48e8-a158-65a071ad5da3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw"
Jul 09 16:58:29.313883 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.313851    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c969c794-7d09-4b0b-900f-0ba55ed1b60c-extensions-socket-volume\") pod \"c969c794-7d09-4b0b-900f-0ba55ed1b60c\" (UID: \"c969c794-7d09-4b0b-900f-0ba55ed1b60c\") "
Jul 09 16:58:29.314062 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.313971    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mx4j7\" (UniqueName: \"kubernetes.io/projected/c969c794-7d09-4b0b-900f-0ba55ed1b60c-kube-api-access-mx4j7\") pod \"c969c794-7d09-4b0b-900f-0ba55ed1b60c\" (UID: \"c969c794-7d09-4b0b-900f-0ba55ed1b60c\") "
Jul 09 16:58:29.314062 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.314005    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghdw9\" (UniqueName: \"kubernetes.io/projected/99a13dc2-dfa4-48e8-a158-65a071ad5da3-kube-api-access-ghdw9\") pod \"99a13dc2-dfa4-48e8-a158-65a071ad5da3\" (UID: \"99a13dc2-dfa4-48e8-a158-65a071ad5da3\") "
Jul 09 16:58:29.314483 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.314451    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c969c794-7d09-4b0b-900f-0ba55ed1b60c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c969c794-7d09-4b0b-900f-0ba55ed1b60c" (UID: "c969c794-7d09-4b0b-900f-0ba55ed1b60c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 16:58:29.317924 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.317897    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c969c794-7d09-4b0b-900f-0ba55ed1b60c-kube-api-access-mx4j7" (OuterVolumeSpecName: "kube-api-access-mx4j7") pod "c969c794-7d09-4b0b-900f-0ba55ed1b60c" (UID: "c969c794-7d09-4b0b-900f-0ba55ed1b60c"). InnerVolumeSpecName "kube-api-access-mx4j7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:58:29.319336 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.319309    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99a13dc2-dfa4-48e8-a158-65a071ad5da3-kube-api-access-ghdw9" (OuterVolumeSpecName: "kube-api-access-ghdw9") pod "99a13dc2-dfa4-48e8-a158-65a071ad5da3" (UID: "99a13dc2-dfa4-48e8-a158-65a071ad5da3"). InnerVolumeSpecName "kube-api-access-ghdw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:58:29.391804 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.391778    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:58:29.394311 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:58:29.394282    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wwzsh\" is forbidden: User \"system:node:ip-10-0-140-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-229.ec2.internal' and this object" podUID="c969c794-7d09-4b0b-900f-0ba55ed1b60c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"
Jul 09 16:58:29.402803 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.402784    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847"
Jul 09 16:58:29.409447 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.409432    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxbxz"
Jul 09 16:58:29.415635 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.415604    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c969c794-7d09-4b0b-900f-0ba55ed1b60c-extensions-socket-volume\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:58:29.415635 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.415632    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx4j7\" (UniqueName: \"kubernetes.io/projected/c969c794-7d09-4b0b-900f-0ba55ed1b60c-kube-api-access-mx4j7\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:58:29.415855 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.415646    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghdw9\" (UniqueName: \"kubernetes.io/projected/99a13dc2-dfa4-48e8-a158-65a071ad5da3-kube-api-access-ghdw9\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:58:29.419437 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:58:29.419410    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2k8zw\" is forbidden: User \"system:node:ip-10-0-140-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-229.ec2.internal' and this object" podUID="99a13dc2-dfa4-48e8-a158-65a071ad5da3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw"
Jul 09 16:58:29.516895 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.516747    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-console-config\") pod \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") "
Jul 09 16:58:29.516895 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.516802    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-oauth-serving-cert\") pod \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") "
Jul 09 16:58:29.516895 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.516834    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-console-serving-cert\") pod \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") "
Jul 09 16:58:29.517240 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.516919    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-service-ca\") pod \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") "
Jul 09 16:58:29.517240 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.516960    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-trusted-ca-bundle\") pod \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") "
Jul 09 16:58:29.517240 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.517002    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-console-oauth-config\") pod \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") "
Jul 09 16:58:29.517240 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.517031    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6t5z\" (UniqueName: \"kubernetes.io/projected/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-kube-api-access-d6t5z\") pod \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\" (UID: \"6ea525c8-73c1-4a82-8af4-e731e72d6bfe\") "
Jul 09 16:58:29.517976 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.517810    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6ea525c8-73c1-4a82-8af4-e731e72d6bfe" (UID: "6ea525c8-73c1-4a82-8af4-e731e72d6bfe"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:58:29.517976 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.517841    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6ea525c8-73c1-4a82-8af4-e731e72d6bfe" (UID: "6ea525c8-73c1-4a82-8af4-e731e72d6bfe"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:58:29.517976 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.517929    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-console-config" (OuterVolumeSpecName: "console-config") pod "6ea525c8-73c1-4a82-8af4-e731e72d6bfe" (UID: "6ea525c8-73c1-4a82-8af4-e731e72d6bfe"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:58:29.518217 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.518044    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-service-ca" (OuterVolumeSpecName: "service-ca") pod "6ea525c8-73c1-4a82-8af4-e731e72d6bfe" (UID: "6ea525c8-73c1-4a82-8af4-e731e72d6bfe"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:58:29.520336 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.520299    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6ea525c8-73c1-4a82-8af4-e731e72d6bfe" (UID: "6ea525c8-73c1-4a82-8af4-e731e72d6bfe"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 16:58:29.520447 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.520376    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-kube-api-access-d6t5z" (OuterVolumeSpecName: "kube-api-access-d6t5z") pod "6ea525c8-73c1-4a82-8af4-e731e72d6bfe" (UID: "6ea525c8-73c1-4a82-8af4-e731e72d6bfe"). InnerVolumeSpecName "kube-api-access-d6t5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:58:29.520736 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.520719    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6ea525c8-73c1-4a82-8af4-e731e72d6bfe" (UID: "6ea525c8-73c1-4a82-8af4-e731e72d6bfe"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 16:58:29.567032 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.567009    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847"]
Jul 09 16:58:29.569958 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:58:29.569924    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb23acdd9_500c_481a_a87d_da4fc054af56.slice/crio-c0152a287fdba5062e33e9d2b3717b29d8c99d66bdfcb7dc5c66729cffdd9a73 WatchSource:0}: Error finding container c0152a287fdba5062e33e9d2b3717b29d8c99d66bdfcb7dc5c66729cffdd9a73: Status 404 returned error can't find the container with id c0152a287fdba5062e33e9d2b3717b29d8c99d66bdfcb7dc5c66729cffdd9a73
Jul 09 16:58:29.599861 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.599830    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxbxz"]
Jul 09 16:58:29.606554 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:58:29.606529    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd948c6cb_6dc9_46d2_8651_8b6b0b2ef03a.slice/crio-5588f45b44946d0832232dc6ba1ac277228684fc62a9fd672c36ef2d088d96f7 WatchSource:0}: Error finding container 5588f45b44946d0832232dc6ba1ac277228684fc62a9fd672c36ef2d088d96f7: Status 404 returned error can't find the container with id 5588f45b44946d0832232dc6ba1ac277228684fc62a9fd672c36ef2d088d96f7
Jul 09 16:58:29.618822 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.618800    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-trusted-ca-bundle\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:58:29.618822 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.618822    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-console-oauth-config\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:58:29.618947 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.618833    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6t5z\" (UniqueName: \"kubernetes.io/projected/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-kube-api-access-d6t5z\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:58:29.618947 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.618841    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-console-config\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:58:29.618947 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.618850    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-oauth-serving-cert\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:58:29.618947 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.618858    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-console-serving-cert\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:58:29.618947 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.618866    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ea525c8-73c1-4a82-8af4-e731e72d6bfe-service-ca\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:58:29.939465 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.939430    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99a13dc2-dfa4-48e8-a158-65a071ad5da3" path="/var/lib/kubelet/pods/99a13dc2-dfa4-48e8-a158-65a071ad5da3/volumes"
Jul 09 16:58:29.939827 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:29.939813    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c969c794-7d09-4b0b-900f-0ba55ed1b60c" path="/var/lib/kubelet/pods/c969c794-7d09-4b0b-900f-0ba55ed1b60c/volumes"
Jul 09 16:58:30.205284 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.205179    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxbxz" event={"ID":"d948c6cb-6dc9-46d2-8651-8b6b0b2ef03a","Type":"ContainerStarted","Data":"ac2c9a60ed0aeafad7b2d4eef98aabb25ef5ccf38cfb95757327a5a5a70269a1"}
Jul 09 16:58:30.205284 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.205243    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxbxz"
Jul 09 16:58:30.205284 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.205270    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxbxz" event={"ID":"d948c6cb-6dc9-46d2-8651-8b6b0b2ef03a","Type":"ContainerStarted","Data":"5588f45b44946d0832232dc6ba1ac277228684fc62a9fd672c36ef2d088d96f7"}
Jul 09 16:58:30.206550 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.206526    2568 generic.go:356] "Generic (PLEG): container finished" podID="6ea525c8-73c1-4a82-8af4-e731e72d6bfe" containerID="e06dc555331a05fc231e26a5a842512d019d29b71275f91153a45144e3090be2" exitCode=0
Jul 09 16:58:30.206668 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.206565    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68ffb7c5f9-dbcm6"
Jul 09 16:58:30.206668 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.206612    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68ffb7c5f9-dbcm6" event={"ID":"6ea525c8-73c1-4a82-8af4-e731e72d6bfe","Type":"ContainerDied","Data":"e06dc555331a05fc231e26a5a842512d019d29b71275f91153a45144e3090be2"}
Jul 09 16:58:30.206668 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.206655    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68ffb7c5f9-dbcm6" event={"ID":"6ea525c8-73c1-4a82-8af4-e731e72d6bfe","Type":"ContainerDied","Data":"696dd23c70365f65f06e6c895721b6f4af2dbca1f0b9e014595388e81d62d683"}
Jul 09 16:58:30.206783 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.206682    2568 scope.go:117] "RemoveContainer" containerID="e06dc555331a05fc231e26a5a842512d019d29b71275f91153a45144e3090be2"
Jul 09 16:58:30.208136 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.208116    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2k8zw"
Jul 09 16:58:30.210071 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.210053    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847" event={"ID":"b23acdd9-500c-481a-a87d-da4fc054af56","Type":"ContainerStarted","Data":"6885ab05e2f3faa61ce66a36ce5701ac863f99aea2060b17b8100bb18943d374"}
Jul 09 16:58:30.210162 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.210096    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847" event={"ID":"b23acdd9-500c-481a-a87d-da4fc054af56","Type":"ContainerStarted","Data":"c0152a287fdba5062e33e9d2b3717b29d8c99d66bdfcb7dc5c66729cffdd9a73"}
Jul 09 16:58:30.210162 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.210124    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847"
Jul 09 16:58:30.211716 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.211698    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwzsh"
Jul 09 16:58:30.216315 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.216292    2568 scope.go:117] "RemoveContainer" containerID="e06dc555331a05fc231e26a5a842512d019d29b71275f91153a45144e3090be2"
Jul 09 16:58:30.216585 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:58:30.216568    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e06dc555331a05fc231e26a5a842512d019d29b71275f91153a45144e3090be2\": container with ID starting with e06dc555331a05fc231e26a5a842512d019d29b71275f91153a45144e3090be2 not found: ID does not exist" containerID="e06dc555331a05fc231e26a5a842512d019d29b71275f91153a45144e3090be2"
Jul 09 16:58:30.216626 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.216593    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e06dc555331a05fc231e26a5a842512d019d29b71275f91153a45144e3090be2"} err="failed to get container status \"e06dc555331a05fc231e26a5a842512d019d29b71275f91153a45144e3090be2\": rpc error: code = NotFound desc = could not find container \"e06dc555331a05fc231e26a5a842512d019d29b71275f91153a45144e3090be2\": container with ID starting with e06dc555331a05fc231e26a5a842512d019d29b71275f91153a45144e3090be2 not found: ID does not exist"
Jul 09 16:58:30.216626 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.216610    2568 scope.go:117] "RemoveContainer" containerID="8211a293f3beb178bfa8260e58ce682c655d88bfd8c1f119359e210ded05ba0f"
Jul 09 16:58:30.224676 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.224658    2568 scope.go:117] "RemoveContainer" containerID="5389e1b2dfaecff98cc9f74a261cef2e88feed08916cc22489fc44d73fdf6caa"
Jul 09 16:58:30.227623 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.227584    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxbxz" podStartSLOduration=1.227571043 podStartE2EDuration="1.227571043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:58:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:58:30.225309204 +0000 UTC m=+447.905725114" watchObservedRunningTime="2026-07-09 16:58:30.227571043 +0000 UTC m=+447.907986951"
Jul 09 16:58:30.254103 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.254050    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847" podStartSLOduration=2.254032192 podStartE2EDuration="2.254032192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:58:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:58:30.252241769 +0000 UTC m=+447.932657677" watchObservedRunningTime="2026-07-09 16:58:30.254032192 +0000 UTC m=+447.934448099"
Jul 09 16:58:30.278229 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.278198    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68ffb7c5f9-dbcm6"]
Jul 09 16:58:30.285266 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:30.285238    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68ffb7c5f9-dbcm6"]
Jul 09 16:58:31.938932 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:31.938897    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ea525c8-73c1-4a82-8af4-e731e72d6bfe" path="/var/lib/kubelet/pods/6ea525c8-73c1-4a82-8af4-e731e72d6bfe/volumes"
Jul 09 16:58:41.221433 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:41.221403    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rxbxz"
Jul 09 16:58:41.221957 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:41.221480    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847"
Jul 09 16:58:45.479170 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:45.479132    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847"]
Jul 09 16:58:45.479567 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:45.479365    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847" podUID="b23acdd9-500c-481a-a87d-da4fc054af56" containerName="manager" containerID="cri-o://6885ab05e2f3faa61ce66a36ce5701ac863f99aea2060b17b8100bb18943d374" gracePeriod=10
Jul 09 16:58:45.738381 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:45.738307    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847"
Jul 09 16:58:45.774665 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:45.774634    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b23acdd9-500c-481a-a87d-da4fc054af56-extensions-socket-volume\") pod \"b23acdd9-500c-481a-a87d-da4fc054af56\" (UID: \"b23acdd9-500c-481a-a87d-da4fc054af56\") "
Jul 09 16:58:45.774823 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:45.774725    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bs5x5\" (UniqueName: \"kubernetes.io/projected/b23acdd9-500c-481a-a87d-da4fc054af56-kube-api-access-bs5x5\") pod \"b23acdd9-500c-481a-a87d-da4fc054af56\" (UID: \"b23acdd9-500c-481a-a87d-da4fc054af56\") "
Jul 09 16:58:45.775059 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:45.775031    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b23acdd9-500c-481a-a87d-da4fc054af56-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b23acdd9-500c-481a-a87d-da4fc054af56" (UID: "b23acdd9-500c-481a-a87d-da4fc054af56"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 16:58:45.776905 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:45.776873    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b23acdd9-500c-481a-a87d-da4fc054af56-kube-api-access-bs5x5" (OuterVolumeSpecName: "kube-api-access-bs5x5") pod "b23acdd9-500c-481a-a87d-da4fc054af56" (UID: "b23acdd9-500c-481a-a87d-da4fc054af56"). InnerVolumeSpecName "kube-api-access-bs5x5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:58:45.876342 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:45.876304    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b23acdd9-500c-481a-a87d-da4fc054af56-extensions-socket-volume\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:58:45.876342 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:45.876334    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bs5x5\" (UniqueName: \"kubernetes.io/projected/b23acdd9-500c-481a-a87d-da4fc054af56-kube-api-access-bs5x5\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:58:46.307553 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:46.307516    2568 generic.go:356] "Generic (PLEG): container finished" podID="b23acdd9-500c-481a-a87d-da4fc054af56" containerID="6885ab05e2f3faa61ce66a36ce5701ac863f99aea2060b17b8100bb18943d374" exitCode=0
Jul 09 16:58:46.307729 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:46.307561    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847"
Jul 09 16:58:46.307729 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:46.307594    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847" event={"ID":"b23acdd9-500c-481a-a87d-da4fc054af56","Type":"ContainerDied","Data":"6885ab05e2f3faa61ce66a36ce5701ac863f99aea2060b17b8100bb18943d374"}
Jul 09 16:58:46.307729 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:46.307645    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847" event={"ID":"b23acdd9-500c-481a-a87d-da4fc054af56","Type":"ContainerDied","Data":"c0152a287fdba5062e33e9d2b3717b29d8c99d66bdfcb7dc5c66729cffdd9a73"}
Jul 09 16:58:46.307729 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:46.307668    2568 scope.go:117] "RemoveContainer" containerID="6885ab05e2f3faa61ce66a36ce5701ac863f99aea2060b17b8100bb18943d374"
Jul 09 16:58:46.317427 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:46.317408    2568 scope.go:117] "RemoveContainer" containerID="6885ab05e2f3faa61ce66a36ce5701ac863f99aea2060b17b8100bb18943d374"
Jul 09 16:58:46.317719 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:58:46.317700    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6885ab05e2f3faa61ce66a36ce5701ac863f99aea2060b17b8100bb18943d374\": container with ID starting with 6885ab05e2f3faa61ce66a36ce5701ac863f99aea2060b17b8100bb18943d374 not found: ID does not exist" containerID="6885ab05e2f3faa61ce66a36ce5701ac863f99aea2060b17b8100bb18943d374"
Jul 09 16:58:46.317781 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:46.317727    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6885ab05e2f3faa61ce66a36ce5701ac863f99aea2060b17b8100bb18943d374"} err="failed to get container status \"6885ab05e2f3faa61ce66a36ce5701ac863f99aea2060b17b8100bb18943d374\": rpc error: code = NotFound desc = could not find container \"6885ab05e2f3faa61ce66a36ce5701ac863f99aea2060b17b8100bb18943d374\": container with ID starting with 6885ab05e2f3faa61ce66a36ce5701ac863f99aea2060b17b8100bb18943d374 not found: ID does not exist"
Jul 09 16:58:46.327770 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:46.327745    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847"]
Jul 09 16:58:46.332035 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:46.332010    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4m847"]
Jul 09 16:58:47.939310 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:58:47.939272    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b23acdd9-500c-481a-a87d-da4fc054af56" path="/var/lib/kubelet/pods/b23acdd9-500c-481a-a87d-da4fc054af56/volumes"
Jul 09 16:59:01.812083 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.812045    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"]
Jul 09 16:59:01.812549 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.812533    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ea525c8-73c1-4a82-8af4-e731e72d6bfe" containerName="console"
Jul 09 16:59:01.812605 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.812551    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ea525c8-73c1-4a82-8af4-e731e72d6bfe" containerName="console"
Jul 09 16:59:01.812605 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.812559    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b23acdd9-500c-481a-a87d-da4fc054af56" containerName="manager"
Jul 09 16:59:01.812605 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.812564    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b23acdd9-500c-481a-a87d-da4fc054af56" containerName="manager"
Jul 09 16:59:01.812717 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.812628    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ea525c8-73c1-4a82-8af4-e731e72d6bfe" containerName="console"
Jul 09 16:59:01.812717 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.812643    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b23acdd9-500c-481a-a87d-da4fc054af56" containerName="manager"
Jul 09 16:59:01.815768 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.815753    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:01.818488 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.818457    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 16:59:01.818710 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.818696    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 16:59:01.818710 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.818706    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 16:59:01.818866 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.818744    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2ltjl\""
Jul 09 16:59:01.826684 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.826661    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"]
Jul 09 16:59:01.930788 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.930752    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5fad100-e600-490c-93b5-f051ac0391b9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:01.930965 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.930811    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5fad100-e600-490c-93b5-f051ac0391b9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:01.930965 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.930850    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5fad100-e600-490c-93b5-f051ac0391b9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:01.930965 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.930909    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6krz2\" (UniqueName: \"kubernetes.io/projected/d5fad100-e600-490c-93b5-f051ac0391b9-kube-api-access-6krz2\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:01.930965 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.930943    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5fad100-e600-490c-93b5-f051ac0391b9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:01.930965 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.930960    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5fad100-e600-490c-93b5-f051ac0391b9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:01.931176 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.930986    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5fad100-e600-490c-93b5-f051ac0391b9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:01.931176 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.931014    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5fad100-e600-490c-93b5-f051ac0391b9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:01.931176 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:01.931073    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5fad100-e600-490c-93b5-f051ac0391b9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:02.031773 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.031739    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5fad100-e600-490c-93b5-f051ac0391b9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:02.031773 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.031775    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5fad100-e600-490c-93b5-f051ac0391b9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:02.032010 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.031974    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6krz2\" (UniqueName: \"kubernetes.io/projected/d5fad100-e600-490c-93b5-f051ac0391b9-kube-api-access-6krz2\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:02.032144 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.032124    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5fad100-e600-490c-93b5-f051ac0391b9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:02.032242 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.032163    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5fad100-e600-490c-93b5-f051ac0391b9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:02.032242 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.032192    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5fad100-e600-490c-93b5-f051ac0391b9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:02.032382 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.032256    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5fad100-e600-490c-93b5-f051ac0391b9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:02.032492 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.032446    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5fad100-e600-490c-93b5-f051ac0391b9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:02.032554 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.032490    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5fad100-e600-490c-93b5-f051ac0391b9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:02.032554 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.032515    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5fad100-e600-490c-93b5-f051ac0391b9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:02.032660 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.032577    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5fad100-e600-490c-93b5-f051ac0391b9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:02.032660 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.032600    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5fad100-e600-490c-93b5-f051ac0391b9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:02.032763 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.032679    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5fad100-e600-490c-93b5-f051ac0391b9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:02.032814 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.032772    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5fad100-e600-490c-93b5-f051ac0391b9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:02.034850 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.034826    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5fad100-e600-490c-93b5-f051ac0391b9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:02.035199 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.035177    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5fad100-e600-490c-93b5-f051ac0391b9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:02.047712 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.047687    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5fad100-e600-490c-93b5-f051ac0391b9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:02.047824 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.047809    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6krz2\" (UniqueName: \"kubernetes.io/projected/d5fad100-e600-490c-93b5-f051ac0391b9-kube-api-access-6krz2\") pod \"maas-default-gateway-openshift-default-56654dcf7-4mtjl\" (UID: \"d5fad100-e600-490c-93b5-f051ac0391b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:02.126576 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.126540    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:02.264047 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.264019    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"]
Jul 09 16:59:02.265765 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:59:02.265732    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5fad100_e600_490c_93b5_f051ac0391b9.slice/crio-ac18bc829a918b07438f4c24ceeaa95b1e5090ca411a50e07e73c9c05baac210 WatchSource:0}: Error finding container ac18bc829a918b07438f4c24ceeaa95b1e5090ca411a50e07e73c9c05baac210: Status 404 returned error can't find the container with id ac18bc829a918b07438f4c24ceeaa95b1e5090ca411a50e07e73c9c05baac210
Jul 09 16:59:02.387664 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:02.387578    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl" event={"ID":"d5fad100-e600-490c-93b5-f051ac0391b9","Type":"ContainerStarted","Data":"ac18bc829a918b07438f4c24ceeaa95b1e5090ca411a50e07e73c9c05baac210"}
Jul 09 16:59:05.076658 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:05.076608    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 16:59:05.077073 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:05.076718    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 16:59:05.077073 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:05.076787    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 16:59:05.407235 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:05.407141    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl" event={"ID":"d5fad100-e600-490c-93b5-f051ac0391b9","Type":"ContainerStarted","Data":"92baf9bf5f479e8933be81a6fad4fabb4982a9ae05b8e1c3b766c13745d950a1"}
Jul 09 16:59:05.428001 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:05.427954    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl" podStartSLOduration=1.619235802 podStartE2EDuration="4.427939506s" totalImagesPullingTime="2.808703704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:59:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:59:05.426306828 +0000 UTC m=+483.106722736" watchObservedRunningTime="2026-07-09 16:59:05.427939506 +0000 UTC m=+483.108355413"
Jul 09 16:59:06.127211 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:06.127174    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:06.131858 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:06.131829    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:06.376844 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:06.376807    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6tkf6"]
Jul 09 16:59:06.380493 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:06.380445    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6tkf6"
Jul 09 16:59:06.383057 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:06.383035    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-47zsg\""
Jul 09 16:59:06.383162 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:06.383074    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 09 16:59:06.389613 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:06.389592    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6tkf6"]
Jul 09 16:59:06.412320 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:06.412283    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:06.413321 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:06.413301    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 16:59:06.473747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:06.473712    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6tkf6"]
Jul 09 16:59:06.474305 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:06.474278    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57f71144-93b2-44a8-b8c3-8a87c05a180e-config-file\") pod \"limitador-limitador-64c94fd64f-6tkf6\" (UID: \"57f71144-93b2-44a8-b8c3-8a87c05a180e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6tkf6"
Jul 09 16:59:06.474472 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:06.474447    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc87q\" (UniqueName: \"kubernetes.io/projected/57f71144-93b2-44a8-b8c3-8a87c05a180e-kube-api-access-rc87q\") pod \"limitador-limitador-64c94fd64f-6tkf6\" (UID: \"57f71144-93b2-44a8-b8c3-8a87c05a180e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6tkf6"
Jul 09 16:59:06.576085 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:06.576052    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57f71144-93b2-44a8-b8c3-8a87c05a180e-config-file\") pod \"limitador-limitador-64c94fd64f-6tkf6\" (UID: \"57f71144-93b2-44a8-b8c3-8a87c05a180e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6tkf6"
Jul 09 16:59:06.576280 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:06.576100    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc87q\" (UniqueName: \"kubernetes.io/projected/57f71144-93b2-44a8-b8c3-8a87c05a180e-kube-api-access-rc87q\") pod \"limitador-limitador-64c94fd64f-6tkf6\" (UID: \"57f71144-93b2-44a8-b8c3-8a87c05a180e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6tkf6"
Jul 09 16:59:06.576760 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:06.576733    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57f71144-93b2-44a8-b8c3-8a87c05a180e-config-file\") pod \"limitador-limitador-64c94fd64f-6tkf6\" (UID: \"57f71144-93b2-44a8-b8c3-8a87c05a180e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6tkf6"
Jul 09 16:59:06.584571 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:06.584547    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc87q\" (UniqueName: \"kubernetes.io/projected/57f71144-93b2-44a8-b8c3-8a87c05a180e-kube-api-access-rc87q\") pod \"limitador-limitador-64c94fd64f-6tkf6\" (UID: \"57f71144-93b2-44a8-b8c3-8a87c05a180e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6tkf6"
Jul 09 16:59:06.691645 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:06.691546    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6tkf6"
Jul 09 16:59:06.827501 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:06.827472    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6tkf6"]
Jul 09 16:59:06.829524 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:59:06.829498    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57f71144_93b2_44a8_b8c3_8a87c05a180e.slice/crio-9c63cdd26aa89cfd692453a1b9a0e7dd7b351c1db183483902a1be146bd5d5a3 WatchSource:0}: Error finding container 9c63cdd26aa89cfd692453a1b9a0e7dd7b351c1db183483902a1be146bd5d5a3: Status 404 returned error can't find the container with id 9c63cdd26aa89cfd692453a1b9a0e7dd7b351c1db183483902a1be146bd5d5a3
Jul 09 16:59:07.420815 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:07.420761    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6tkf6" event={"ID":"57f71144-93b2-44a8-b8c3-8a87c05a180e","Type":"ContainerStarted","Data":"9c63cdd26aa89cfd692453a1b9a0e7dd7b351c1db183483902a1be146bd5d5a3"}
Jul 09 16:59:09.434144 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:09.434105    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6tkf6" event={"ID":"57f71144-93b2-44a8-b8c3-8a87c05a180e","Type":"ContainerStarted","Data":"16a2898e0424d8d3da974ceac6fda94c1ea0445ada873250d36bb4928957f2ad"}
Jul 09 16:59:09.434551 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:09.434173    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-6tkf6"
Jul 09 16:59:09.456911 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:09.456841    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-6tkf6" podStartSLOduration=0.963295043 podStartE2EDuration="3.456819823s" totalImagesPullingTime="2.49352478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:59:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:59:09.452561156 +0000 UTC m=+487.132977058" watchObservedRunningTime="2026-07-09 16:59:09.456819823 +0000 UTC m=+487.137235731"
Jul 09 16:59:20.441302 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:20.441268    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-6tkf6"
Jul 09 16:59:20.658634 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:20.658599    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6tkf6"]
Jul 09 16:59:20.658863 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:20.658831    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-6tkf6" podUID="57f71144-93b2-44a8-b8c3-8a87c05a180e" containerName="limitador" containerID="cri-o://16a2898e0424d8d3da974ceac6fda94c1ea0445ada873250d36bb4928957f2ad" gracePeriod=30
Jul 09 16:59:21.219899 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:21.219830    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6tkf6"
Jul 09 16:59:21.223137 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:21.223118    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rc87q\" (UniqueName: \"kubernetes.io/projected/57f71144-93b2-44a8-b8c3-8a87c05a180e-kube-api-access-rc87q\") pod \"57f71144-93b2-44a8-b8c3-8a87c05a180e\" (UID: \"57f71144-93b2-44a8-b8c3-8a87c05a180e\") "
Jul 09 16:59:21.223250 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:21.223233    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57f71144-93b2-44a8-b8c3-8a87c05a180e-config-file\") pod \"57f71144-93b2-44a8-b8c3-8a87c05a180e\" (UID: \"57f71144-93b2-44a8-b8c3-8a87c05a180e\") "
Jul 09 16:59:21.225462 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:21.223991    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57f71144-93b2-44a8-b8c3-8a87c05a180e-config-file" (OuterVolumeSpecName: "config-file") pod "57f71144-93b2-44a8-b8c3-8a87c05a180e" (UID: "57f71144-93b2-44a8-b8c3-8a87c05a180e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:59:21.231094 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:21.231061    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57f71144-93b2-44a8-b8c3-8a87c05a180e-kube-api-access-rc87q" (OuterVolumeSpecName: "kube-api-access-rc87q") pod "57f71144-93b2-44a8-b8c3-8a87c05a180e" (UID: "57f71144-93b2-44a8-b8c3-8a87c05a180e"). InnerVolumeSpecName "kube-api-access-rc87q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:59:21.325650 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:21.325615    2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57f71144-93b2-44a8-b8c3-8a87c05a180e-config-file\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:59:21.325650 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:21.325645    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rc87q\" (UniqueName: \"kubernetes.io/projected/57f71144-93b2-44a8-b8c3-8a87c05a180e-kube-api-access-rc87q\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:59:21.494389 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:21.494281    2568 generic.go:356] "Generic (PLEG): container finished" podID="57f71144-93b2-44a8-b8c3-8a87c05a180e" containerID="16a2898e0424d8d3da974ceac6fda94c1ea0445ada873250d36bb4928957f2ad" exitCode=0
Jul 09 16:59:21.494389 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:21.494352    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6tkf6"
Jul 09 16:59:21.494892 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:21.494401    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6tkf6" event={"ID":"57f71144-93b2-44a8-b8c3-8a87c05a180e","Type":"ContainerDied","Data":"16a2898e0424d8d3da974ceac6fda94c1ea0445ada873250d36bb4928957f2ad"}
Jul 09 16:59:21.494892 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:21.494485    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6tkf6" event={"ID":"57f71144-93b2-44a8-b8c3-8a87c05a180e","Type":"ContainerDied","Data":"9c63cdd26aa89cfd692453a1b9a0e7dd7b351c1db183483902a1be146bd5d5a3"}
Jul 09 16:59:21.494892 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:21.494512    2568 scope.go:117] "RemoveContainer" containerID="16a2898e0424d8d3da974ceac6fda94c1ea0445ada873250d36bb4928957f2ad"
Jul 09 16:59:21.503747 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:21.503727    2568 scope.go:117] "RemoveContainer" containerID="16a2898e0424d8d3da974ceac6fda94c1ea0445ada873250d36bb4928957f2ad"
Jul 09 16:59:21.504064 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:59:21.504041    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16a2898e0424d8d3da974ceac6fda94c1ea0445ada873250d36bb4928957f2ad\": container with ID starting with 16a2898e0424d8d3da974ceac6fda94c1ea0445ada873250d36bb4928957f2ad not found: ID does not exist" containerID="16a2898e0424d8d3da974ceac6fda94c1ea0445ada873250d36bb4928957f2ad"
Jul 09 16:59:21.504151 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:21.504074    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16a2898e0424d8d3da974ceac6fda94c1ea0445ada873250d36bb4928957f2ad"} err="failed to get container status \"16a2898e0424d8d3da974ceac6fda94c1ea0445ada873250d36bb4928957f2ad\": rpc error: code = NotFound desc = could not find container \"16a2898e0424d8d3da974ceac6fda94c1ea0445ada873250d36bb4928957f2ad\": container with ID starting with 16a2898e0424d8d3da974ceac6fda94c1ea0445ada873250d36bb4928957f2ad not found: ID does not exist"
Jul 09 16:59:21.516070 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:21.516046    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6tkf6"]
Jul 09 16:59:21.519994 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:21.519969    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6tkf6"]
Jul 09 16:59:21.939108 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:21.939066    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57f71144-93b2-44a8-b8c3-8a87c05a180e" path="/var/lib/kubelet/pods/57f71144-93b2-44a8-b8c3-8a87c05a180e/volumes"
Jul 09 16:59:22.990692 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:22.990658    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-c5qcs"]
Jul 09 16:59:22.991272 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:22.991248    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57f71144-93b2-44a8-b8c3-8a87c05a180e" containerName="limitador"
Jul 09 16:59:22.991272 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:22.991272    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="57f71144-93b2-44a8-b8c3-8a87c05a180e" containerName="limitador"
Jul 09 16:59:22.991452 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:22.991384    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="57f71144-93b2-44a8-b8c3-8a87c05a180e" containerName="limitador"
Jul 09 16:59:22.995850 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:22.995826    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c5qcs"
Jul 09 16:59:22.998651 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:22.998631    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 09 16:59:22.998757 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:22.998718    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 16:59:22.999628 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:22.999612    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-vc89g\""
Jul 09 16:59:22.999715 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:22.999657    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 16:59:23.004804 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:23.004393    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-c5qcs"]
Jul 09 16:59:23.040274 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:23.040235    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/85598aea-4b1f-40d6-bd74-02aa03fdaa40-data\") pod \"postgres-69fb4594cf-c5qcs\" (UID: \"85598aea-4b1f-40d6-bd74-02aa03fdaa40\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c5qcs"
Jul 09 16:59:23.040475 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:23.040295    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2qsv\" (UniqueName: \"kubernetes.io/projected/85598aea-4b1f-40d6-bd74-02aa03fdaa40-kube-api-access-g2qsv\") pod \"postgres-69fb4594cf-c5qcs\" (UID: \"85598aea-4b1f-40d6-bd74-02aa03fdaa40\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c5qcs"
Jul 09 16:59:23.141307 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:23.141268    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/85598aea-4b1f-40d6-bd74-02aa03fdaa40-data\") pod \"postgres-69fb4594cf-c5qcs\" (UID: \"85598aea-4b1f-40d6-bd74-02aa03fdaa40\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c5qcs"
Jul 09 16:59:23.141515 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:23.141329    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2qsv\" (UniqueName: \"kubernetes.io/projected/85598aea-4b1f-40d6-bd74-02aa03fdaa40-kube-api-access-g2qsv\") pod \"postgres-69fb4594cf-c5qcs\" (UID: \"85598aea-4b1f-40d6-bd74-02aa03fdaa40\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c5qcs"
Jul 09 16:59:23.141740 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:23.141719    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/85598aea-4b1f-40d6-bd74-02aa03fdaa40-data\") pod \"postgres-69fb4594cf-c5qcs\" (UID: \"85598aea-4b1f-40d6-bd74-02aa03fdaa40\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c5qcs"
Jul 09 16:59:23.149801 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:23.149770    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2qsv\" (UniqueName: \"kubernetes.io/projected/85598aea-4b1f-40d6-bd74-02aa03fdaa40-kube-api-access-g2qsv\") pod \"postgres-69fb4594cf-c5qcs\" (UID: \"85598aea-4b1f-40d6-bd74-02aa03fdaa40\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c5qcs"
Jul 09 16:59:23.307814 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:23.307728    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c5qcs"
Jul 09 16:59:23.440467 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:23.440443    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-c5qcs"]
Jul 09 16:59:23.442950 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:59:23.442910    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85598aea_4b1f_40d6_bd74_02aa03fdaa40.slice/crio-bb9ba1965c041b76f85d793157c9c8c7c0cb749b0e97f7def7745e01a3e5515a WatchSource:0}: Error finding container bb9ba1965c041b76f85d793157c9c8c7c0cb749b0e97f7def7745e01a3e5515a: Status 404 returned error can't find the container with id bb9ba1965c041b76f85d793157c9c8c7c0cb749b0e97f7def7745e01a3e5515a
Jul 09 16:59:23.506692 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:23.506655    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c5qcs" event={"ID":"85598aea-4b1f-40d6-bd74-02aa03fdaa40","Type":"ContainerStarted","Data":"bb9ba1965c041b76f85d793157c9c8c7c0cb749b0e97f7def7745e01a3e5515a"}
Jul 09 16:59:29.547497 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:29.547459    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c5qcs" event={"ID":"85598aea-4b1f-40d6-bd74-02aa03fdaa40","Type":"ContainerStarted","Data":"2e107124592c3a7e83cf50addf2441a230b2377261357ea33b84ec9750a87ea5"}
Jul 09 16:59:29.547889 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:29.547548    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c5qcs"
Jul 09 16:59:29.563321 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:29.563253    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c5qcs" podStartSLOduration=2.461688074 podStartE2EDuration="7.563232673s" totalImagesPullingTime="5.101544599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:59:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:59:29.563129256 +0000 UTC m=+507.243545165" watchObservedRunningTime="2026-07-09 16:59:29.563232673 +0000 UTC m=+507.243648584"
Jul 09 16:59:35.582383 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:35.582337    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c5qcs"
Jul 09 16:59:41.650220 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:41.650183    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f549c4c55-c228s"]
Jul 09 16:59:41.748828 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:41.748792    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f549c4c55-c228s"]
Jul 09 16:59:41.748972 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:41.748896    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f549c4c55-c228s"
Jul 09 16:59:41.751763 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:41.751740    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 09 16:59:41.751872 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:41.751793    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 09 16:59:41.751872 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:41.751831    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-j698n\""
Jul 09 16:59:41.809994 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:41.809959    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-774b7d6bb6-rk2jd"]
Jul 09 16:59:41.812873 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:41.812851    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774b7d6bb6-rk2jd"
Jul 09 16:59:41.824460 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:41.824419    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-774b7d6bb6-rk2jd"]
Jul 09 16:59:41.825376 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:41.825341    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-557gn\" (UniqueName: \"kubernetes.io/projected/d3b5e1db-7897-4105-b82d-2ef256821d48-kube-api-access-557gn\") pod \"maas-controller-f549c4c55-c228s\" (UID: \"d3b5e1db-7897-4105-b82d-2ef256821d48\") " pod="opendatahub/maas-controller-f549c4c55-c228s"
Jul 09 16:59:41.825471 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:41.825416    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3b5e1db-7897-4105-b82d-2ef256821d48-webhook-cert\") pod \"maas-controller-f549c4c55-c228s\" (UID: \"d3b5e1db-7897-4105-b82d-2ef256821d48\") " pod="opendatahub/maas-controller-f549c4c55-c228s"
Jul 09 16:59:41.926072 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:41.925968    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3b5e1db-7897-4105-b82d-2ef256821d48-webhook-cert\") pod \"maas-controller-f549c4c55-c228s\" (UID: \"d3b5e1db-7897-4105-b82d-2ef256821d48\") " pod="opendatahub/maas-controller-f549c4c55-c228s"
Jul 09 16:59:41.926072 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:41.926017    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqkqg\" (UniqueName: \"kubernetes.io/projected/74f22b4b-f223-4e4f-915f-d11d21968578-kube-api-access-nqkqg\") pod \"maas-controller-774b7d6bb6-rk2jd\" (UID: \"74f22b4b-f223-4e4f-915f-d11d21968578\") " pod="opendatahub/maas-controller-774b7d6bb6-rk2jd"
Jul 09 16:59:41.926072 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:41.926071    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74f22b4b-f223-4e4f-915f-d11d21968578-webhook-cert\") pod \"maas-controller-774b7d6bb6-rk2jd\" (UID: \"74f22b4b-f223-4e4f-915f-d11d21968578\") " pod="opendatahub/maas-controller-774b7d6bb6-rk2jd"
Jul 09 16:59:41.926391 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:41.926101    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-557gn\" (UniqueName: \"kubernetes.io/projected/d3b5e1db-7897-4105-b82d-2ef256821d48-kube-api-access-557gn\") pod \"maas-controller-f549c4c55-c228s\" (UID: \"d3b5e1db-7897-4105-b82d-2ef256821d48\") " pod="opendatahub/maas-controller-f549c4c55-c228s"
Jul 09 16:59:41.926391 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:59:41.926143    2568 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 09 16:59:41.926391 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:59:41.926251    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b5e1db-7897-4105-b82d-2ef256821d48-webhook-cert podName:d3b5e1db-7897-4105-b82d-2ef256821d48 nodeName:}" failed. No retries permitted until 2026-07-09 16:59:42.42622834 +0000 UTC m=+520.106644231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/d3b5e1db-7897-4105-b82d-2ef256821d48-webhook-cert") pod "maas-controller-f549c4c55-c228s" (UID: "d3b5e1db-7897-4105-b82d-2ef256821d48") : secret "maas-controller-webhook-cert" not found
Jul 09 16:59:41.934773 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:41.934746    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-557gn\" (UniqueName: \"kubernetes.io/projected/d3b5e1db-7897-4105-b82d-2ef256821d48-kube-api-access-557gn\") pod \"maas-controller-f549c4c55-c228s\" (UID: \"d3b5e1db-7897-4105-b82d-2ef256821d48\") " pod="opendatahub/maas-controller-f549c4c55-c228s"
Jul 09 16:59:42.027429 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:42.027387    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74f22b4b-f223-4e4f-915f-d11d21968578-webhook-cert\") pod \"maas-controller-774b7d6bb6-rk2jd\" (UID: \"74f22b4b-f223-4e4f-915f-d11d21968578\") " pod="opendatahub/maas-controller-774b7d6bb6-rk2jd"
Jul 09 16:59:42.027599 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:59:42.027470    2568 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 09 16:59:42.027599 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:42.027498    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqkqg\" (UniqueName: \"kubernetes.io/projected/74f22b4b-f223-4e4f-915f-d11d21968578-kube-api-access-nqkqg\") pod \"maas-controller-774b7d6bb6-rk2jd\" (UID: \"74f22b4b-f223-4e4f-915f-d11d21968578\") " pod="opendatahub/maas-controller-774b7d6bb6-rk2jd"
Jul 09 16:59:42.027599 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:59:42.027531    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f22b4b-f223-4e4f-915f-d11d21968578-webhook-cert podName:74f22b4b-f223-4e4f-915f-d11d21968578 nodeName:}" failed. No retries permitted until 2026-07-09 16:59:42.527515882 +0000 UTC m=+520.207931768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/74f22b4b-f223-4e4f-915f-d11d21968578-webhook-cert") pod "maas-controller-774b7d6bb6-rk2jd" (UID: "74f22b4b-f223-4e4f-915f-d11d21968578") : secret "maas-controller-webhook-cert" not found
Jul 09 16:59:42.036509 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:42.036478    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqkqg\" (UniqueName: \"kubernetes.io/projected/74f22b4b-f223-4e4f-915f-d11d21968578-kube-api-access-nqkqg\") pod \"maas-controller-774b7d6bb6-rk2jd\" (UID: \"74f22b4b-f223-4e4f-915f-d11d21968578\") " pod="opendatahub/maas-controller-774b7d6bb6-rk2jd"
Jul 09 16:59:42.431423 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:42.431382    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3b5e1db-7897-4105-b82d-2ef256821d48-webhook-cert\") pod \"maas-controller-f549c4c55-c228s\" (UID: \"d3b5e1db-7897-4105-b82d-2ef256821d48\") " pod="opendatahub/maas-controller-f549c4c55-c228s"
Jul 09 16:59:42.433864 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:42.433836    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3b5e1db-7897-4105-b82d-2ef256821d48-webhook-cert\") pod \"maas-controller-f549c4c55-c228s\" (UID: \"d3b5e1db-7897-4105-b82d-2ef256821d48\") " pod="opendatahub/maas-controller-f549c4c55-c228s"
Jul 09 16:59:42.532613 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:42.532569    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74f22b4b-f223-4e4f-915f-d11d21968578-webhook-cert\") pod \"maas-controller-774b7d6bb6-rk2jd\" (UID: \"74f22b4b-f223-4e4f-915f-d11d21968578\") " pod="opendatahub/maas-controller-774b7d6bb6-rk2jd"
Jul 09 16:59:42.534998 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:42.534976    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74f22b4b-f223-4e4f-915f-d11d21968578-webhook-cert\") pod \"maas-controller-774b7d6bb6-rk2jd\" (UID: \"74f22b4b-f223-4e4f-915f-d11d21968578\") " pod="opendatahub/maas-controller-774b7d6bb6-rk2jd"
Jul 09 16:59:42.660078 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:42.660046    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f549c4c55-c228s"
Jul 09 16:59:42.723328 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:42.723286    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774b7d6bb6-rk2jd"
Jul 09 16:59:42.802037 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:42.802001    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f549c4c55-c228s"]
Jul 09 16:59:42.802953 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:59:42.802922    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b5e1db_7897_4105_b82d_2ef256821d48.slice/crio-7a177531faf29f6cfd7e1c481ebbf4810eb09f9e8fd49795d0e8ba058976136b WatchSource:0}: Error finding container 7a177531faf29f6cfd7e1c481ebbf4810eb09f9e8fd49795d0e8ba058976136b: Status 404 returned error can't find the container with id 7a177531faf29f6cfd7e1c481ebbf4810eb09f9e8fd49795d0e8ba058976136b
Jul 09 16:59:42.864863 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:42.864830    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-774b7d6bb6-rk2jd"]
Jul 09 16:59:42.881797 ip-10-0-140-229 kubenswrapper[2568]: W0709 16:59:42.881771    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74f22b4b_f223_4e4f_915f_d11d21968578.slice/crio-aeb52291ad8b17583efb7b500d112ed149d4a39fc49837c83eb74f87561330bc WatchSource:0}: Error finding container aeb52291ad8b17583efb7b500d112ed149d4a39fc49837c83eb74f87561330bc: Status 404 returned error can't find the container with id aeb52291ad8b17583efb7b500d112ed149d4a39fc49837c83eb74f87561330bc
Jul 09 16:59:43.621244 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:43.621211    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774b7d6bb6-rk2jd" event={"ID":"74f22b4b-f223-4e4f-915f-d11d21968578","Type":"ContainerStarted","Data":"aeb52291ad8b17583efb7b500d112ed149d4a39fc49837c83eb74f87561330bc"}
Jul 09 16:59:43.622542 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:43.622519    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f549c4c55-c228s" event={"ID":"d3b5e1db-7897-4105-b82d-2ef256821d48","Type":"ContainerStarted","Data":"7a177531faf29f6cfd7e1c481ebbf4810eb09f9e8fd49795d0e8ba058976136b"}
Jul 09 16:59:45.635826 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:45.635786    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774b7d6bb6-rk2jd" event={"ID":"74f22b4b-f223-4e4f-915f-d11d21968578","Type":"ContainerStarted","Data":"2d30de0c37bfbfca356da68269c217e2e8a65b24f583a4a01e90c1a806cc7d1b"}
Jul 09 16:59:45.636278 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:45.635855    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-774b7d6bb6-rk2jd"
Jul 09 16:59:45.637331 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:45.637308    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f549c4c55-c228s" event={"ID":"d3b5e1db-7897-4105-b82d-2ef256821d48","Type":"ContainerStarted","Data":"cb8e3ca6bd9ef82313c3018f36aeae1af236f0616d9ab9b16a2e7555e028c37e"}
Jul 09 16:59:45.637481 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:45.637463    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f549c4c55-c228s"
Jul 09 16:59:45.654695 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:45.654644    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-774b7d6bb6-rk2jd" podStartSLOduration=2.396615977 podStartE2EDuration="4.654627547s" totalImagesPullingTime="2.25801157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:59:45.653084645 +0000 UTC m=+523.333500556" watchObservedRunningTime="2026-07-09 16:59:45.654627547 +0000 UTC m=+523.335043454"
Jul 09 16:59:45.672369 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:45.672319    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f549c4c55-c228s" podStartSLOduration=2.329959621 podStartE2EDuration="4.672303969s" totalImagesPullingTime="2.342344348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:59:45.670804963 +0000 UTC m=+523.351220872" watchObservedRunningTime="2026-07-09 16:59:45.672303969 +0000 UTC m=+523.352719877"
Jul 09 16:59:56.648182 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:56.648137    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f549c4c55-c228s"
Jul 09 16:59:56.648584 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:56.648277    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-774b7d6bb6-rk2jd"
Jul 09 16:59:56.712911 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:56.712874    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f549c4c55-c228s"]
Jul 09 16:59:56.713134 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:56.713086    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-f549c4c55-c228s" podUID="d3b5e1db-7897-4105-b82d-2ef256821d48" containerName="manager" containerID="cri-o://cb8e3ca6bd9ef82313c3018f36aeae1af236f0616d9ab9b16a2e7555e028c37e" gracePeriod=30
Jul 09 16:59:56.961834 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:56.961808    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f549c4c55-c228s"
Jul 09 16:59:56.984753 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:56.984690    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-557gn\" (UniqueName: \"kubernetes.io/projected/d3b5e1db-7897-4105-b82d-2ef256821d48-kube-api-access-557gn\") pod \"d3b5e1db-7897-4105-b82d-2ef256821d48\" (UID: \"d3b5e1db-7897-4105-b82d-2ef256821d48\") "
Jul 09 16:59:56.985080 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:56.985044    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3b5e1db-7897-4105-b82d-2ef256821d48-webhook-cert\") pod \"d3b5e1db-7897-4105-b82d-2ef256821d48\" (UID: \"d3b5e1db-7897-4105-b82d-2ef256821d48\") "
Jul 09 16:59:56.987579 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:56.987542    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3b5e1db-7897-4105-b82d-2ef256821d48-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d3b5e1db-7897-4105-b82d-2ef256821d48" (UID: "d3b5e1db-7897-4105-b82d-2ef256821d48"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 16:59:56.987707 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:56.987684    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3b5e1db-7897-4105-b82d-2ef256821d48-kube-api-access-557gn" (OuterVolumeSpecName: "kube-api-access-557gn") pod "d3b5e1db-7897-4105-b82d-2ef256821d48" (UID: "d3b5e1db-7897-4105-b82d-2ef256821d48"). InnerVolumeSpecName "kube-api-access-557gn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:59:57.086451 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:57.086416    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3b5e1db-7897-4105-b82d-2ef256821d48-webhook-cert\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:59:57.086451 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:57.086450    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-557gn\" (UniqueName: \"kubernetes.io/projected/d3b5e1db-7897-4105-b82d-2ef256821d48-kube-api-access-557gn\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 16:59:57.701390 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:57.701321    2568 generic.go:356] "Generic (PLEG): container finished" podID="d3b5e1db-7897-4105-b82d-2ef256821d48" containerID="cb8e3ca6bd9ef82313c3018f36aeae1af236f0616d9ab9b16a2e7555e028c37e" exitCode=0
Jul 09 16:59:57.701843 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:57.701407    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f549c4c55-c228s"
Jul 09 16:59:57.701843 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:57.701408    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f549c4c55-c228s" event={"ID":"d3b5e1db-7897-4105-b82d-2ef256821d48","Type":"ContainerDied","Data":"cb8e3ca6bd9ef82313c3018f36aeae1af236f0616d9ab9b16a2e7555e028c37e"}
Jul 09 16:59:57.701843 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:57.701485    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f549c4c55-c228s" event={"ID":"d3b5e1db-7897-4105-b82d-2ef256821d48","Type":"ContainerDied","Data":"7a177531faf29f6cfd7e1c481ebbf4810eb09f9e8fd49795d0e8ba058976136b"}
Jul 09 16:59:57.701843 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:57.701510    2568 scope.go:117] "RemoveContainer" containerID="cb8e3ca6bd9ef82313c3018f36aeae1af236f0616d9ab9b16a2e7555e028c37e"
Jul 09 16:59:57.710753 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:57.710736    2568 scope.go:117] "RemoveContainer" containerID="cb8e3ca6bd9ef82313c3018f36aeae1af236f0616d9ab9b16a2e7555e028c37e"
Jul 09 16:59:57.711056 ip-10-0-140-229 kubenswrapper[2568]: E0709 16:59:57.711038    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb8e3ca6bd9ef82313c3018f36aeae1af236f0616d9ab9b16a2e7555e028c37e\": container with ID starting with cb8e3ca6bd9ef82313c3018f36aeae1af236f0616d9ab9b16a2e7555e028c37e not found: ID does not exist" containerID="cb8e3ca6bd9ef82313c3018f36aeae1af236f0616d9ab9b16a2e7555e028c37e"
Jul 09 16:59:57.711100 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:57.711068    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb8e3ca6bd9ef82313c3018f36aeae1af236f0616d9ab9b16a2e7555e028c37e"} err="failed to get container status \"cb8e3ca6bd9ef82313c3018f36aeae1af236f0616d9ab9b16a2e7555e028c37e\": rpc error: code = NotFound desc = could not find container \"cb8e3ca6bd9ef82313c3018f36aeae1af236f0616d9ab9b16a2e7555e028c37e\": container with ID starting with cb8e3ca6bd9ef82313c3018f36aeae1af236f0616d9ab9b16a2e7555e028c37e not found: ID does not exist"
Jul 09 16:59:57.723426 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:57.723397    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f549c4c55-c228s"]
Jul 09 16:59:57.727760 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:57.727737    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f549c4c55-c228s"]
Jul 09 16:59:57.939623 ip-10-0-140-229 kubenswrapper[2568]: I0709 16:59:57.939590    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3b5e1db-7897-4105-b82d-2ef256821d48" path="/var/lib/kubelet/pods/d3b5e1db-7897-4105-b82d-2ef256821d48/volumes"
Jul 09 17:00:17.384111 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.384076    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-56d696876f-5vslf"]
Jul 09 17:00:17.384621 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.384587    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3b5e1db-7897-4105-b82d-2ef256821d48" containerName="manager"
Jul 09 17:00:17.384621 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.384601    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3b5e1db-7897-4105-b82d-2ef256821d48" containerName="manager"
Jul 09 17:00:17.384694 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.384659    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3b5e1db-7897-4105-b82d-2ef256821d48" containerName="manager"
Jul 09 17:00:17.389232 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.389211    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-56d696876f-5vslf"
Jul 09 17:00:17.393525 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.393497    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mpbsc\""
Jul 09 17:00:17.393660 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.393511    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 09 17:00:17.399226 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.399201    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-56d696876f-5vslf"]
Jul 09 17:00:17.481283 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.481234    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce9bf29b-1d42-473e-8f47-4d718efe2f72-maas-api-tls\") pod \"maas-api-56d696876f-5vslf\" (UID: \"ce9bf29b-1d42-473e-8f47-4d718efe2f72\") " pod="odh-ai-gateway-infra/maas-api-56d696876f-5vslf"
Jul 09 17:00:17.481526 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.481387    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn2zn\" (UniqueName: \"kubernetes.io/projected/ce9bf29b-1d42-473e-8f47-4d718efe2f72-kube-api-access-qn2zn\") pod \"maas-api-56d696876f-5vslf\" (UID: \"ce9bf29b-1d42-473e-8f47-4d718efe2f72\") " pod="odh-ai-gateway-infra/maas-api-56d696876f-5vslf"
Jul 09 17:00:17.481526 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.481457    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce9bf29b-1d42-473e-8f47-4d718efe2f72-openshift-service-ca\") pod \"maas-api-56d696876f-5vslf\" (UID: \"ce9bf29b-1d42-473e-8f47-4d718efe2f72\") " pod="odh-ai-gateway-infra/maas-api-56d696876f-5vslf"
Jul 09 17:00:17.582979 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.582939    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce9bf29b-1d42-473e-8f47-4d718efe2f72-maas-api-tls\") pod \"maas-api-56d696876f-5vslf\" (UID: \"ce9bf29b-1d42-473e-8f47-4d718efe2f72\") " pod="odh-ai-gateway-infra/maas-api-56d696876f-5vslf"
Jul 09 17:00:17.583147 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.583101    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn2zn\" (UniqueName: \"kubernetes.io/projected/ce9bf29b-1d42-473e-8f47-4d718efe2f72-kube-api-access-qn2zn\") pod \"maas-api-56d696876f-5vslf\" (UID: \"ce9bf29b-1d42-473e-8f47-4d718efe2f72\") " pod="odh-ai-gateway-infra/maas-api-56d696876f-5vslf"
Jul 09 17:00:17.583193 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.583149    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce9bf29b-1d42-473e-8f47-4d718efe2f72-openshift-service-ca\") pod \"maas-api-56d696876f-5vslf\" (UID: \"ce9bf29b-1d42-473e-8f47-4d718efe2f72\") " pod="odh-ai-gateway-infra/maas-api-56d696876f-5vslf"
Jul 09 17:00:17.583854 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.583823    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce9bf29b-1d42-473e-8f47-4d718efe2f72-openshift-service-ca\") pod \"maas-api-56d696876f-5vslf\" (UID: \"ce9bf29b-1d42-473e-8f47-4d718efe2f72\") " pod="odh-ai-gateway-infra/maas-api-56d696876f-5vslf"
Jul 09 17:00:17.585417 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.585394    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce9bf29b-1d42-473e-8f47-4d718efe2f72-maas-api-tls\") pod \"maas-api-56d696876f-5vslf\" (UID: \"ce9bf29b-1d42-473e-8f47-4d718efe2f72\") " pod="odh-ai-gateway-infra/maas-api-56d696876f-5vslf"
Jul 09 17:00:17.593001 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.592970    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn2zn\" (UniqueName: \"kubernetes.io/projected/ce9bf29b-1d42-473e-8f47-4d718efe2f72-kube-api-access-qn2zn\") pod \"maas-api-56d696876f-5vslf\" (UID: \"ce9bf29b-1d42-473e-8f47-4d718efe2f72\") " pod="odh-ai-gateway-infra/maas-api-56d696876f-5vslf"
Jul 09 17:00:17.702140 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.702043    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-56d696876f-5vslf"
Jul 09 17:00:17.845530 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.845483    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rwfvj"]
Jul 09 17:00:17.851233 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.851210    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-56d696876f-5vslf"]
Jul 09 17:00:17.851337 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.851325    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-rwfvj"
Jul 09 17:00:17.853480 ip-10-0-140-229 kubenswrapper[2568]: W0709 17:00:17.853454    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9bf29b_1d42_473e_8f47_4d718efe2f72.slice/crio-8b0872da45df04479990313d5f8cb1324b2a1c7fb6caa498a79dfde1f14844e4 WatchSource:0}: Error finding container 8b0872da45df04479990313d5f8cb1324b2a1c7fb6caa498a79dfde1f14844e4: Status 404 returned error can't find the container with id 8b0872da45df04479990313d5f8cb1324b2a1c7fb6caa498a79dfde1f14844e4
Jul 09 17:00:17.853928 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.853910    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 09 17:00:17.860273 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.860252    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rwfvj"]
Jul 09 17:00:17.877737 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.877703    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-wcnf5"]
Jul 09 17:00:17.881550 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.881527    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-wcnf5"
Jul 09 17:00:17.884779 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.884757    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6b6cx\""
Jul 09 17:00:17.893814 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.893793    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-wcnf5"]
Jul 09 17:00:17.987920 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.987836    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppxvg\" (UniqueName: \"kubernetes.io/projected/819a9a12-3966-454e-b046-6cebf91e21db-kube-api-access-ppxvg\") pod \"payload-pre-processing-7964457696-rwfvj\" (UID: \"819a9a12-3966-454e-b046-6cebf91e21db\") " pod="openshift-ingress/payload-pre-processing-7964457696-rwfvj"
Jul 09 17:00:17.987920 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.987880    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2w2x\" (UniqueName: \"kubernetes.io/projected/502f3629-6c44-41a9-b231-392cbb1141a8-kube-api-access-f2w2x\") pod \"payload-processing-58f86c7798-wcnf5\" (UID: \"502f3629-6c44-41a9-b231-392cbb1141a8\") " pod="openshift-ingress/payload-processing-58f86c7798-wcnf5"
Jul 09 17:00:17.987920 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.987912    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/502f3629-6c44-41a9-b231-392cbb1141a8-plugins-config-volume\") pod \"payload-processing-58f86c7798-wcnf5\" (UID: \"502f3629-6c44-41a9-b231-392cbb1141a8\") " pod="openshift-ingress/payload-processing-58f86c7798-wcnf5"
Jul 09 17:00:17.988156 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:17.988018    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/819a9a12-3966-454e-b046-6cebf91e21db-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rwfvj\" (UID: \"819a9a12-3966-454e-b046-6cebf91e21db\") " pod="openshift-ingress/payload-pre-processing-7964457696-rwfvj"
Jul 09 17:00:18.089093 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:18.089045    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/502f3629-6c44-41a9-b231-392cbb1141a8-plugins-config-volume\") pod \"payload-processing-58f86c7798-wcnf5\" (UID: \"502f3629-6c44-41a9-b231-392cbb1141a8\") " pod="openshift-ingress/payload-processing-58f86c7798-wcnf5"
Jul 09 17:00:18.089290 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:18.089130    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/819a9a12-3966-454e-b046-6cebf91e21db-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rwfvj\" (UID: \"819a9a12-3966-454e-b046-6cebf91e21db\") " pod="openshift-ingress/payload-pre-processing-7964457696-rwfvj"
Jul 09 17:00:18.089290 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:18.089236    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppxvg\" (UniqueName: \"kubernetes.io/projected/819a9a12-3966-454e-b046-6cebf91e21db-kube-api-access-ppxvg\") pod \"payload-pre-processing-7964457696-rwfvj\" (UID: \"819a9a12-3966-454e-b046-6cebf91e21db\") " pod="openshift-ingress/payload-pre-processing-7964457696-rwfvj"
Jul 09 17:00:18.089290 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:18.089284    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2w2x\" (UniqueName: \"kubernetes.io/projected/502f3629-6c44-41a9-b231-392cbb1141a8-kube-api-access-f2w2x\") pod \"payload-processing-58f86c7798-wcnf5\" (UID: \"502f3629-6c44-41a9-b231-392cbb1141a8\") " pod="openshift-ingress/payload-processing-58f86c7798-wcnf5"
Jul 09 17:00:18.089900 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:18.089880    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/502f3629-6c44-41a9-b231-392cbb1141a8-plugins-config-volume\") pod \"payload-processing-58f86c7798-wcnf5\" (UID: \"502f3629-6c44-41a9-b231-392cbb1141a8\") " pod="openshift-ingress/payload-processing-58f86c7798-wcnf5"
Jul 09 17:00:18.089981 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:18.089969    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/819a9a12-3966-454e-b046-6cebf91e21db-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rwfvj\" (UID: \"819a9a12-3966-454e-b046-6cebf91e21db\") " pod="openshift-ingress/payload-pre-processing-7964457696-rwfvj"
Jul 09 17:00:18.098340 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:18.098311    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppxvg\" (UniqueName: \"kubernetes.io/projected/819a9a12-3966-454e-b046-6cebf91e21db-kube-api-access-ppxvg\") pod \"payload-pre-processing-7964457696-rwfvj\" (UID: \"819a9a12-3966-454e-b046-6cebf91e21db\") " pod="openshift-ingress/payload-pre-processing-7964457696-rwfvj"
Jul 09 17:00:18.098467 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:18.098452    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2w2x\" (UniqueName: \"kubernetes.io/projected/502f3629-6c44-41a9-b231-392cbb1141a8-kube-api-access-f2w2x\") pod \"payload-processing-58f86c7798-wcnf5\" (UID: \"502f3629-6c44-41a9-b231-392cbb1141a8\") " pod="openshift-ingress/payload-processing-58f86c7798-wcnf5"
Jul 09 17:00:18.174178 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:18.174140    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-rwfvj"
Jul 09 17:00:18.192657 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:18.192630    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-wcnf5"
Jul 09 17:00:18.328542 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:18.328514    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rwfvj"]
Jul 09 17:00:18.331432 ip-10-0-140-229 kubenswrapper[2568]: W0709 17:00:18.331401    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod819a9a12_3966_454e_b046_6cebf91e21db.slice/crio-cd06af6bb160b5600e357351f9994a61c12a8ac8f283cbb021fe6c7be4b13e12 WatchSource:0}: Error finding container cd06af6bb160b5600e357351f9994a61c12a8ac8f283cbb021fe6c7be4b13e12: Status 404 returned error can't find the container with id cd06af6bb160b5600e357351f9994a61c12a8ac8f283cbb021fe6c7be4b13e12
Jul 09 17:00:18.352880 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:18.352856    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-wcnf5"]
Jul 09 17:00:18.355194 ip-10-0-140-229 kubenswrapper[2568]: W0709 17:00:18.355167    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod502f3629_6c44_41a9_b231_392cbb1141a8.slice/crio-bf28ef579c1c152b9995a18c62ef416329a98666889fb14567576ced7cf35035 WatchSource:0}: Error finding container bf28ef579c1c152b9995a18c62ef416329a98666889fb14567576ced7cf35035: Status 404 returned error can't find the container with id bf28ef579c1c152b9995a18c62ef416329a98666889fb14567576ced7cf35035
Jul 09 17:00:18.817865 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:18.817821    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-wcnf5" event={"ID":"502f3629-6c44-41a9-b231-392cbb1141a8","Type":"ContainerStarted","Data":"bf28ef579c1c152b9995a18c62ef416329a98666889fb14567576ced7cf35035"}
Jul 09 17:00:18.819160 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:18.819132    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-56d696876f-5vslf" event={"ID":"ce9bf29b-1d42-473e-8f47-4d718efe2f72","Type":"ContainerStarted","Data":"8b0872da45df04479990313d5f8cb1324b2a1c7fb6caa498a79dfde1f14844e4"}
Jul 09 17:00:18.820469 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:18.820444    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-rwfvj" event={"ID":"819a9a12-3966-454e-b046-6cebf91e21db","Type":"ContainerStarted","Data":"cd06af6bb160b5600e357351f9994a61c12a8ac8f283cbb021fe6c7be4b13e12"}
Jul 09 17:00:20.836424 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:20.836228    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-rwfvj" event={"ID":"819a9a12-3966-454e-b046-6cebf91e21db","Type":"ContainerStarted","Data":"7f5d0a964573fc7c02ec39796ece0e4aadad2d315dcbd12b49042c127c06d17f"}
Jul 09 17:00:20.836856 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:20.836516    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-rwfvj"
Jul 09 17:00:20.838170 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:20.838144    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-wcnf5" event={"ID":"502f3629-6c44-41a9-b231-392cbb1141a8","Type":"ContainerStarted","Data":"66ddd2d2086085d7aa35e2ecb2388135f0de1584a9776a1962d9aa270c302594"}
Jul 09 17:00:20.838324 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:20.838303    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-wcnf5"
Jul 09 17:00:20.890034 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:20.889972    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-rwfvj" podStartSLOduration=2.211843101 podStartE2EDuration="3.889951735s" totalImagesPullingTime="1.678108634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:00:20.869177827 +0000 UTC m=+558.549593737" watchObservedRunningTime="2026-07-09 17:00:20.889951735 +0000 UTC m=+558.570367644"
Jul 09 17:00:20.891166 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:20.891113    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-wcnf5" podStartSLOduration=2.234022311 podStartE2EDuration="3.891098885s" totalImagesPullingTime="1.657076574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:00:20.887999518 +0000 UTC m=+558.568415427" watchObservedRunningTime="2026-07-09 17:00:20.891098885 +0000 UTC m=+558.571514794"
Jul 09 17:00:21.849453 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:21.849405    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-56d696876f-5vslf" event={"ID":"ce9bf29b-1d42-473e-8f47-4d718efe2f72","Type":"ContainerStarted","Data":"ddc8b33d460c7aa0cc91cb072b214ee1dcc690140e4adabb26488098621561ff"}
Jul 09 17:00:21.849945 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:21.849643    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-56d696876f-5vslf"
Jul 09 17:00:21.866080 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:21.866012    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-56d696876f-5vslf" podStartSLOduration=1.424793195 podStartE2EDuration="4.865992369s" totalImagesPullingTime="3.441199174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:00:21.865588988 +0000 UTC m=+559.546004908" watchObservedRunningTime="2026-07-09 17:00:21.865992369 +0000 UTC m=+559.546408280"
Jul 09 17:00:26.881833 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:26.881798    2568 generic.go:356] "Generic (PLEG): container finished" podID="d5fad100-e600-490c-93b5-f051ac0391b9" containerID="92baf9bf5f479e8933be81a6fad4fabb4982a9ae05b8e1c3b766c13745d950a1" exitCode=0
Jul 09 17:00:26.882245 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:26.881866    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl" event={"ID":"d5fad100-e600-490c-93b5-f051ac0391b9","Type":"ContainerDied","Data":"92baf9bf5f479e8933be81a6fad4fabb4982a9ae05b8e1c3b766c13745d950a1"}
Jul 09 17:00:26.882288 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:26.882269    2568 scope.go:117] "RemoveContainer" containerID="92baf9bf5f479e8933be81a6fad4fabb4982a9ae05b8e1c3b766c13745d950a1"
Jul 09 17:00:26.883393 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:26.883347    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 17:00:26.883469 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:26.883435    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 17:00:26.883507 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:26.883482    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 17:00:27.888260 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:27.888226    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl" event={"ID":"d5fad100-e600-490c-93b5-f051ac0391b9","Type":"ContainerStarted","Data":"41ea7207669a2b5643c5a5230a3bcaea0df40da867ea2cff12c375730e6652eb"}
Jul 09 17:00:28.127536 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:28.127501    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 17:00:28.127718 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:28.127698    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-4mtjl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 09 17:00:28.127768 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:28.127742    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl" podUID="d5fad100-e600-490c-93b5-f051ac0391b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 09 17:00:28.869986 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:28.869957    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-56d696876f-5vslf"
Jul 09 17:00:29.127019 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:29.126934    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-4mtjl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 09 17:00:29.127019 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:29.127005    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl" podUID="d5fad100-e600-490c-93b5-f051ac0391b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 09 17:00:30.127419 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:30.127350    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-4mtjl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 09 17:00:30.127818 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:30.127447    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl" podUID="d5fad100-e600-490c-93b5-f051ac0391b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 09 17:00:31.127406 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:31.127349    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-4mtjl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 09 17:00:31.127579 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:31.127429    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl" podUID="d5fad100-e600-490c-93b5-f051ac0391b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 09 17:00:31.850956 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:31.850928    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-wcnf5"
Jul 09 17:00:31.851854 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:31.851831    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-rwfvj"
Jul 09 17:00:32.130750 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:32.130673    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 17:00:32.131162 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:32.131069    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 17:00:32.131629 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:32.131613    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4mtjl"
Jul 09 17:00:49.888938 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:49.888897    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"]
Jul 09 17:00:49.895640 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:49.895616    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:00:49.898691 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:49.898667    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 09 17:00:49.898793 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:49.898735    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 17:00:49.899467 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:49.899449    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ccqbg\""
Jul 09 17:00:49.899549 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:49.899473    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 17:00:49.904487 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:49.904459    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"]
Jul 09 17:00:49.995902 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:49.995870    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e171c6db-461b-436c-97fa-b1a90515eb07-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vkts\" (UID: \"e171c6db-461b-436c-97fa-b1a90515eb07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:00:49.996077 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:49.995914    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxjxp\" (UniqueName: \"kubernetes.io/projected/e171c6db-461b-436c-97fa-b1a90515eb07-kube-api-access-kxjxp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vkts\" (UID: \"e171c6db-461b-436c-97fa-b1a90515eb07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:00:49.996077 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:49.995956    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e171c6db-461b-436c-97fa-b1a90515eb07-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vkts\" (UID: \"e171c6db-461b-436c-97fa-b1a90515eb07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:00:49.996077 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:49.996019    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e171c6db-461b-436c-97fa-b1a90515eb07-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vkts\" (UID: \"e171c6db-461b-436c-97fa-b1a90515eb07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:00:49.996077 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:49.996065    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e171c6db-461b-436c-97fa-b1a90515eb07-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vkts\" (UID: \"e171c6db-461b-436c-97fa-b1a90515eb07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:00:49.996246 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:49.996098    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e171c6db-461b-436c-97fa-b1a90515eb07-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vkts\" (UID: \"e171c6db-461b-436c-97fa-b1a90515eb07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:00:50.097492 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:50.097459    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e171c6db-461b-436c-97fa-b1a90515eb07-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vkts\" (UID: \"e171c6db-461b-436c-97fa-b1a90515eb07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:00:50.097683 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:50.097524    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e171c6db-461b-436c-97fa-b1a90515eb07-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vkts\" (UID: \"e171c6db-461b-436c-97fa-b1a90515eb07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:00:50.097683 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:50.097569    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxjxp\" (UniqueName: \"kubernetes.io/projected/e171c6db-461b-436c-97fa-b1a90515eb07-kube-api-access-kxjxp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vkts\" (UID: \"e171c6db-461b-436c-97fa-b1a90515eb07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:00:50.097683 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:50.097626    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e171c6db-461b-436c-97fa-b1a90515eb07-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vkts\" (UID: \"e171c6db-461b-436c-97fa-b1a90515eb07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:00:50.097683 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:50.097661    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e171c6db-461b-436c-97fa-b1a90515eb07-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vkts\" (UID: \"e171c6db-461b-436c-97fa-b1a90515eb07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:00:50.098236 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:50.097701    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e171c6db-461b-436c-97fa-b1a90515eb07-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vkts\" (UID: \"e171c6db-461b-436c-97fa-b1a90515eb07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:00:50.098236 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:50.097905    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e171c6db-461b-436c-97fa-b1a90515eb07-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vkts\" (UID: \"e171c6db-461b-436c-97fa-b1a90515eb07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:00:50.098236 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:50.097938    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e171c6db-461b-436c-97fa-b1a90515eb07-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vkts\" (UID: \"e171c6db-461b-436c-97fa-b1a90515eb07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:00:50.098236 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:50.098001    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e171c6db-461b-436c-97fa-b1a90515eb07-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vkts\" (UID: \"e171c6db-461b-436c-97fa-b1a90515eb07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:00:50.099901 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:50.099879    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e171c6db-461b-436c-97fa-b1a90515eb07-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vkts\" (UID: \"e171c6db-461b-436c-97fa-b1a90515eb07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:00:50.100148 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:50.100121    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e171c6db-461b-436c-97fa-b1a90515eb07-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vkts\" (UID: \"e171c6db-461b-436c-97fa-b1a90515eb07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:00:50.105894 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:50.105870    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxjxp\" (UniqueName: \"kubernetes.io/projected/e171c6db-461b-436c-97fa-b1a90515eb07-kube-api-access-kxjxp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vkts\" (UID: \"e171c6db-461b-436c-97fa-b1a90515eb07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:00:50.208560 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:50.208477    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:00:50.344042 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:50.344016    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"]
Jul 09 17:00:50.345984 ip-10-0-140-229 kubenswrapper[2568]: W0709 17:00:50.345954    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode171c6db_461b_436c_97fa_b1a90515eb07.slice/crio-5208e0b1ab308947211e9dbb634e8aebebd5c83e4778d7da40ecdf2e5329a5df WatchSource:0}: Error finding container 5208e0b1ab308947211e9dbb634e8aebebd5c83e4778d7da40ecdf2e5329a5df: Status 404 returned error can't find the container with id 5208e0b1ab308947211e9dbb634e8aebebd5c83e4778d7da40ecdf2e5329a5df
Jul 09 17:00:51.010530 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:51.010490    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts" event={"ID":"e171c6db-461b-436c-97fa-b1a90515eb07","Type":"ContainerStarted","Data":"5208e0b1ab308947211e9dbb634e8aebebd5c83e4778d7da40ecdf2e5329a5df"}
Jul 09 17:00:59.054693 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:59.054656    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts" event={"ID":"e171c6db-461b-436c-97fa-b1a90515eb07","Type":"ContainerStarted","Data":"6ddecf1d9f22c38dbc136351b41152316a041c8a179324285eaee5aeede47ba6"}
Jul 09 17:00:59.074627 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:00:59.074580    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts" podStartSLOduration=1.6068458589999999 podStartE2EDuration="10.074566681s" totalImagesPullingTime="8.467720822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:00:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:00:59.071952065 +0000 UTC m=+596.752367973" watchObservedRunningTime="2026-07-09 17:00:59.074566681 +0000 UTC m=+596.754982588"
Jul 09 17:01:00.208983 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:00.208947    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:01:00.209407 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:00.209022    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:01:00.221322 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:00.221301    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:01:01.075906 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:01.075877    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vkts"
Jul 09 17:01:02.750546 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:02.750520    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ng88_54ed8699-4487-4246-9e22-3d15bd9908ca/ovn-acl-logging/0.log"
Jul 09 17:01:02.755324 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:02.755300    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ng88_54ed8699-4487-4246-9e22-3d15bd9908ca/ovn-acl-logging/0.log"
Jul 09 17:01:03.180575 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.180539    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"]
Jul 09 17:01:03.184878 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.184855    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:03.187509 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.187491    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 09 17:01:03.194265 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.194231    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"]
Jul 09 17:01:03.223528 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.223499    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3adc08e1-910b-4550-a0cf-14438d0cd53d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5lgck\" (UID: \"3adc08e1-910b-4550-a0cf-14438d0cd53d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:03.223686 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.223548    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3adc08e1-910b-4550-a0cf-14438d0cd53d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5lgck\" (UID: \"3adc08e1-910b-4550-a0cf-14438d0cd53d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:03.223686 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.223573    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3adc08e1-910b-4550-a0cf-14438d0cd53d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5lgck\" (UID: \"3adc08e1-910b-4550-a0cf-14438d0cd53d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:03.223803 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.223715    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjpmp\" (UniqueName: \"kubernetes.io/projected/3adc08e1-910b-4550-a0cf-14438d0cd53d-kube-api-access-hjpmp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5lgck\" (UID: \"3adc08e1-910b-4550-a0cf-14438d0cd53d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:03.223803 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.223779    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3adc08e1-910b-4550-a0cf-14438d0cd53d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5lgck\" (UID: \"3adc08e1-910b-4550-a0cf-14438d0cd53d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:03.223946 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.223806    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3adc08e1-910b-4550-a0cf-14438d0cd53d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5lgck\" (UID: \"3adc08e1-910b-4550-a0cf-14438d0cd53d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:03.324499 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.324470    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjpmp\" (UniqueName: \"kubernetes.io/projected/3adc08e1-910b-4550-a0cf-14438d0cd53d-kube-api-access-hjpmp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5lgck\" (UID: \"3adc08e1-910b-4550-a0cf-14438d0cd53d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:03.324692 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.324514    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3adc08e1-910b-4550-a0cf-14438d0cd53d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5lgck\" (UID: \"3adc08e1-910b-4550-a0cf-14438d0cd53d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:03.324692 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.324530    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3adc08e1-910b-4550-a0cf-14438d0cd53d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5lgck\" (UID: \"3adc08e1-910b-4550-a0cf-14438d0cd53d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:03.324692 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.324565    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3adc08e1-910b-4550-a0cf-14438d0cd53d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5lgck\" (UID: \"3adc08e1-910b-4550-a0cf-14438d0cd53d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:03.324692 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.324609    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3adc08e1-910b-4550-a0cf-14438d0cd53d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5lgck\" (UID: \"3adc08e1-910b-4550-a0cf-14438d0cd53d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:03.324692 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.324641    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3adc08e1-910b-4550-a0cf-14438d0cd53d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5lgck\" (UID: \"3adc08e1-910b-4550-a0cf-14438d0cd53d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:03.324947 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.324922    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3adc08e1-910b-4550-a0cf-14438d0cd53d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5lgck\" (UID: \"3adc08e1-910b-4550-a0cf-14438d0cd53d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:03.325037 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.324970    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3adc08e1-910b-4550-a0cf-14438d0cd53d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5lgck\" (UID: \"3adc08e1-910b-4550-a0cf-14438d0cd53d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:03.325110 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.325086    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3adc08e1-910b-4550-a0cf-14438d0cd53d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5lgck\" (UID: \"3adc08e1-910b-4550-a0cf-14438d0cd53d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:03.326947 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.326922    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3adc08e1-910b-4550-a0cf-14438d0cd53d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5lgck\" (UID: \"3adc08e1-910b-4550-a0cf-14438d0cd53d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:03.327240 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.327220    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3adc08e1-910b-4550-a0cf-14438d0cd53d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5lgck\" (UID: \"3adc08e1-910b-4550-a0cf-14438d0cd53d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:03.332896 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.332870    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjpmp\" (UniqueName: \"kubernetes.io/projected/3adc08e1-910b-4550-a0cf-14438d0cd53d-kube-api-access-hjpmp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5lgck\" (UID: \"3adc08e1-910b-4550-a0cf-14438d0cd53d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:03.496173 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.496080    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:03.633094 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:03.633070    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"]
Jul 09 17:01:03.635045 ip-10-0-140-229 kubenswrapper[2568]: W0709 17:01:03.635012    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3adc08e1_910b_4550_a0cf_14438d0cd53d.slice/crio-2c8620b09e815ec57306dad5b14ee0478208f603810a554acc25d5bd0006ef39 WatchSource:0}: Error finding container 2c8620b09e815ec57306dad5b14ee0478208f603810a554acc25d5bd0006ef39: Status 404 returned error can't find the container with id 2c8620b09e815ec57306dad5b14ee0478208f603810a554acc25d5bd0006ef39
Jul 09 17:01:04.083534 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:04.083498    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck" event={"ID":"3adc08e1-910b-4550-a0cf-14438d0cd53d","Type":"ContainerStarted","Data":"2c8620b09e815ec57306dad5b14ee0478208f603810a554acc25d5bd0006ef39"}
Jul 09 17:01:05.090702 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:05.090613    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck" event={"ID":"3adc08e1-910b-4550-a0cf-14438d0cd53d","Type":"ContainerStarted","Data":"1189e29cbe21997aaaca87f76a911a9c1cc673c33d37fc436dd8e2625b4852b3"}
Jul 09 17:01:05.116621 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:05.111797    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck" podStartSLOduration=0.921069734 podStartE2EDuration="2.111776727s" totalImagesPullingTime="1.190706993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:01:05.108498892 +0000 UTC m=+602.788914802" watchObservedRunningTime="2026-07-09 17:01:05.111776727 +0000 UTC m=+602.792192636"
Jul 09 17:01:13.496766 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:13.496729    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:13.497174 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:13.497023    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:13.509630 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:13.509600    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:01:14.154185 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:01:14.154154    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5lgck"
Jul 09 17:03:48.378827 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:48.378785    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-774b7d6bb6-rk2jd"]
Jul 09 17:03:48.379897 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:48.378989    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-774b7d6bb6-rk2jd" podUID="74f22b4b-f223-4e4f-915f-d11d21968578" containerName="manager" containerID="cri-o://2d30de0c37bfbfca356da68269c217e2e8a65b24f583a4a01e90c1a806cc7d1b" gracePeriod=30
Jul 09 17:03:48.634560 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:48.634509    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774b7d6bb6-rk2jd"
Jul 09 17:03:48.742945 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:48.742916    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqkqg\" (UniqueName: \"kubernetes.io/projected/74f22b4b-f223-4e4f-915f-d11d21968578-kube-api-access-nqkqg\") pod \"74f22b4b-f223-4e4f-915f-d11d21968578\" (UID: \"74f22b4b-f223-4e4f-915f-d11d21968578\") "
Jul 09 17:03:48.742945 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:48.742957    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74f22b4b-f223-4e4f-915f-d11d21968578-webhook-cert\") pod \"74f22b4b-f223-4e4f-915f-d11d21968578\" (UID: \"74f22b4b-f223-4e4f-915f-d11d21968578\") "
Jul 09 17:03:48.744887 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:48.744856    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74f22b4b-f223-4e4f-915f-d11d21968578-kube-api-access-nqkqg" (OuterVolumeSpecName: "kube-api-access-nqkqg") pod "74f22b4b-f223-4e4f-915f-d11d21968578" (UID: "74f22b4b-f223-4e4f-915f-d11d21968578"). InnerVolumeSpecName "kube-api-access-nqkqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:03:48.745006 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:48.744934    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74f22b4b-f223-4e4f-915f-d11d21968578-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "74f22b4b-f223-4e4f-915f-d11d21968578" (UID: "74f22b4b-f223-4e4f-915f-d11d21968578"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:03:48.844057 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:48.844022    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqkqg\" (UniqueName: \"kubernetes.io/projected/74f22b4b-f223-4e4f-915f-d11d21968578-kube-api-access-nqkqg\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:03:48.844057 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:48.844052    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74f22b4b-f223-4e4f-915f-d11d21968578-webhook-cert\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:03:48.976016 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:48.975929    2568 generic.go:356] "Generic (PLEG): container finished" podID="74f22b4b-f223-4e4f-915f-d11d21968578" containerID="2d30de0c37bfbfca356da68269c217e2e8a65b24f583a4a01e90c1a806cc7d1b" exitCode=0
Jul 09 17:03:48.976016 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:48.975969    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774b7d6bb6-rk2jd"
Jul 09 17:03:48.976266 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:48.976018    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774b7d6bb6-rk2jd" event={"ID":"74f22b4b-f223-4e4f-915f-d11d21968578","Type":"ContainerDied","Data":"2d30de0c37bfbfca356da68269c217e2e8a65b24f583a4a01e90c1a806cc7d1b"}
Jul 09 17:03:48.976266 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:48.976074    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774b7d6bb6-rk2jd" event={"ID":"74f22b4b-f223-4e4f-915f-d11d21968578","Type":"ContainerDied","Data":"aeb52291ad8b17583efb7b500d112ed149d4a39fc49837c83eb74f87561330bc"}
Jul 09 17:03:48.976266 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:48.976103    2568 scope.go:117] "RemoveContainer" containerID="2d30de0c37bfbfca356da68269c217e2e8a65b24f583a4a01e90c1a806cc7d1b"
Jul 09 17:03:48.985496 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:48.985477    2568 scope.go:117] "RemoveContainer" containerID="2d30de0c37bfbfca356da68269c217e2e8a65b24f583a4a01e90c1a806cc7d1b"
Jul 09 17:03:48.985749 ip-10-0-140-229 kubenswrapper[2568]: E0709 17:03:48.985732    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d30de0c37bfbfca356da68269c217e2e8a65b24f583a4a01e90c1a806cc7d1b\": container with ID starting with 2d30de0c37bfbfca356da68269c217e2e8a65b24f583a4a01e90c1a806cc7d1b not found: ID does not exist" containerID="2d30de0c37bfbfca356da68269c217e2e8a65b24f583a4a01e90c1a806cc7d1b"
Jul 09 17:03:48.985817 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:48.985763    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d30de0c37bfbfca356da68269c217e2e8a65b24f583a4a01e90c1a806cc7d1b"} err="failed to get container status \"2d30de0c37bfbfca356da68269c217e2e8a65b24f583a4a01e90c1a806cc7d1b\": rpc error: code = NotFound desc = could not find container \"2d30de0c37bfbfca356da68269c217e2e8a65b24f583a4a01e90c1a806cc7d1b\": container with ID starting with 2d30de0c37bfbfca356da68269c217e2e8a65b24f583a4a01e90c1a806cc7d1b not found: ID does not exist"
Jul 09 17:03:48.998109 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:48.998079    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-774b7d6bb6-rk2jd"]
Jul 09 17:03:49.002310 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:49.002290    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-774b7d6bb6-rk2jd"]
Jul 09 17:03:49.768491 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:49.768454    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-774b7d6bb6-xpz22"]
Jul 09 17:03:49.768913 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:49.768901    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74f22b4b-f223-4e4f-915f-d11d21968578" containerName="manager"
Jul 09 17:03:49.768913 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:49.768915    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="74f22b4b-f223-4e4f-915f-d11d21968578" containerName="manager"
Jul 09 17:03:49.768992 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:49.768977    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="74f22b4b-f223-4e4f-915f-d11d21968578" containerName="manager"
Jul 09 17:03:49.771925 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:49.771909    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774b7d6bb6-xpz22"
Jul 09 17:03:49.775609 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:49.775585    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-j698n\""
Jul 09 17:03:49.777542 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:49.777520    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 09 17:03:49.777542 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:49.777538    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 09 17:03:49.780857 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:49.780836    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-774b7d6bb6-xpz22"]
Jul 09 17:03:49.939269 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:49.939239    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74f22b4b-f223-4e4f-915f-d11d21968578" path="/var/lib/kubelet/pods/74f22b4b-f223-4e4f-915f-d11d21968578/volumes"
Jul 09 17:03:49.953138 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:49.953112    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/39ded06a-bd3d-4d51-bdbf-c3abf34ad17b-webhook-cert\") pod \"maas-controller-774b7d6bb6-xpz22\" (UID: \"39ded06a-bd3d-4d51-bdbf-c3abf34ad17b\") " pod="opendatahub/maas-controller-774b7d6bb6-xpz22"
Jul 09 17:03:49.953265 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:49.953233    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmqz8\" (UniqueName: \"kubernetes.io/projected/39ded06a-bd3d-4d51-bdbf-c3abf34ad17b-kube-api-access-pmqz8\") pod \"maas-controller-774b7d6bb6-xpz22\" (UID: \"39ded06a-bd3d-4d51-bdbf-c3abf34ad17b\") " pod="opendatahub/maas-controller-774b7d6bb6-xpz22"
Jul 09 17:03:50.054514 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:50.054421    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmqz8\" (UniqueName: \"kubernetes.io/projected/39ded06a-bd3d-4d51-bdbf-c3abf34ad17b-kube-api-access-pmqz8\") pod \"maas-controller-774b7d6bb6-xpz22\" (UID: \"39ded06a-bd3d-4d51-bdbf-c3abf34ad17b\") " pod="opendatahub/maas-controller-774b7d6bb6-xpz22"
Jul 09 17:03:50.054693 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:50.054516    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/39ded06a-bd3d-4d51-bdbf-c3abf34ad17b-webhook-cert\") pod \"maas-controller-774b7d6bb6-xpz22\" (UID: \"39ded06a-bd3d-4d51-bdbf-c3abf34ad17b\") " pod="opendatahub/maas-controller-774b7d6bb6-xpz22"
Jul 09 17:03:50.056971 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:50.056949    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/39ded06a-bd3d-4d51-bdbf-c3abf34ad17b-webhook-cert\") pod \"maas-controller-774b7d6bb6-xpz22\" (UID: \"39ded06a-bd3d-4d51-bdbf-c3abf34ad17b\") " pod="opendatahub/maas-controller-774b7d6bb6-xpz22"
Jul 09 17:03:50.062542 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:50.062523    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmqz8\" (UniqueName: \"kubernetes.io/projected/39ded06a-bd3d-4d51-bdbf-c3abf34ad17b-kube-api-access-pmqz8\") pod \"maas-controller-774b7d6bb6-xpz22\" (UID: \"39ded06a-bd3d-4d51-bdbf-c3abf34ad17b\") " pod="opendatahub/maas-controller-774b7d6bb6-xpz22"
Jul 09 17:03:50.083511 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:50.083490    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774b7d6bb6-xpz22"
Jul 09 17:03:50.217801 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:50.217775    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-774b7d6bb6-xpz22"]
Jul 09 17:03:50.220951 ip-10-0-140-229 kubenswrapper[2568]: W0709 17:03:50.220918    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39ded06a_bd3d_4d51_bdbf_c3abf34ad17b.slice/crio-dba63d858784493324613159d434571fe760db96df8ab2147e77d51b9c22bb70 WatchSource:0}: Error finding container dba63d858784493324613159d434571fe760db96df8ab2147e77d51b9c22bb70: Status 404 returned error can't find the container with id dba63d858784493324613159d434571fe760db96df8ab2147e77d51b9c22bb70
Jul 09 17:03:50.222490 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:50.222470    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 17:03:50.988788 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:50.988752    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774b7d6bb6-xpz22" event={"ID":"39ded06a-bd3d-4d51-bdbf-c3abf34ad17b","Type":"ContainerStarted","Data":"dba63d858784493324613159d434571fe760db96df8ab2147e77d51b9c22bb70"}
Jul 09 17:03:51.994979 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:51.994939    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774b7d6bb6-xpz22" event={"ID":"39ded06a-bd3d-4d51-bdbf-c3abf34ad17b","Type":"ContainerStarted","Data":"609d4757fd5143e0b63cfca3ab2dce51293c7ef8f318c54b38267e5587cd19aa"}
Jul 09 17:03:51.995350 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:51.995006    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-774b7d6bb6-xpz22"
Jul 09 17:03:52.011917 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:03:52.011869    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-774b7d6bb6-xpz22" podStartSLOduration=1.363979519 podStartE2EDuration="3.011854051s" totalImagesPullingTime="1.647874532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:03:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:03:52.010782572 +0000 UTC m=+769.691198481" watchObservedRunningTime="2026-07-09 17:03:52.011854051 +0000 UTC m=+769.692269959"
Jul 09 17:04:03.006873 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:04:03.006839    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-774b7d6bb6-xpz22"
Jul 09 17:06:02.796297 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:06:02.796262    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ng88_54ed8699-4487-4246-9e22-3d15bd9908ca/ovn-acl-logging/0.log"
Jul 09 17:06:02.798042 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:06:02.798014    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ng88_54ed8699-4487-4246-9e22-3d15bd9908ca/ovn-acl-logging/0.log"
Jul 09 17:11:02.838783 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:11:02.838754    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ng88_54ed8699-4487-4246-9e22-3d15bd9908ca/ovn-acl-logging/0.log"
Jul 09 17:11:02.838783 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:11:02.838772    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ng88_54ed8699-4487-4246-9e22-3d15bd9908ca/ovn-acl-logging/0.log"
Jul 09 17:15:00.143527 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:15:00.143494    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726955-ppj5n"]
Jul 09 17:15:00.147230 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:15:00.147207    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-ppj5n"
Jul 09 17:15:00.162474 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:15:00.162449    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726955-ppj5n"]
Jul 09 17:15:00.276732 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:15:00.276699    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wgh6\" (UniqueName: \"kubernetes.io/projected/a375f3d2-5460-4ab2-aaaf-572806c45d3a-kube-api-access-9wgh6\") pod \"maas-api-key-cleanup-29726955-ppj5n\" (UID: \"a375f3d2-5460-4ab2-aaaf-572806c45d3a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-ppj5n"
Jul 09 17:15:00.377694 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:15:00.377659    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wgh6\" (UniqueName: \"kubernetes.io/projected/a375f3d2-5460-4ab2-aaaf-572806c45d3a-kube-api-access-9wgh6\") pod \"maas-api-key-cleanup-29726955-ppj5n\" (UID: \"a375f3d2-5460-4ab2-aaaf-572806c45d3a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-ppj5n"
Jul 09 17:15:00.385319 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:15:00.385292    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wgh6\" (UniqueName: \"kubernetes.io/projected/a375f3d2-5460-4ab2-aaaf-572806c45d3a-kube-api-access-9wgh6\") pod \"maas-api-key-cleanup-29726955-ppj5n\" (UID: \"a375f3d2-5460-4ab2-aaaf-572806c45d3a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-ppj5n"
Jul 09 17:15:00.458311 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:15:00.458230    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-ppj5n"
Jul 09 17:15:00.808308 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:15:00.808285    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 17:15:00.812420 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:15:00.812395    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726955-ppj5n"]
Jul 09 17:15:01.611444 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:15:01.611406    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-ppj5n" event={"ID":"a375f3d2-5460-4ab2-aaaf-572806c45d3a","Type":"ContainerStarted","Data":"8d3bd413bdbde8534d512b38a67a0c7f3292cf217a9ccba78deeaf0ca46e6ebd"}
Jul 09 17:15:03.624130 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:15:03.624042    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-ppj5n" event={"ID":"a375f3d2-5460-4ab2-aaaf-572806c45d3a","Type":"ContainerStarted","Data":"85d92eee6d1832d6eac6f8bd5900c891d17f47aef1fa39908245af7b127d83a2"}
Jul 09 17:15:03.638973 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:15:03.638922    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-ppj5n" podStartSLOduration=1.3533746039999999 podStartE2EDuration="3.638902074s" totalImagesPullingTime="2.28552747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:15:03.63809094 +0000 UTC m=+1441.318506848" watchObservedRunningTime="2026-07-09 17:15:03.638902074 +0000 UTC m=+1441.319317985"
Jul 09 17:16:00.012770 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:00.012737    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726955-ppj5n"]
Jul 09 17:16:00.013322 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:00.012951    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-ppj5n" podUID="a375f3d2-5460-4ab2-aaaf-572806c45d3a" containerName="cleanup" containerID="cri-o://85d92eee6d1832d6eac6f8bd5900c891d17f47aef1fa39908245af7b127d83a2" gracePeriod=30
Jul 09 17:16:02.882802 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:02.882674    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ng88_54ed8699-4487-4246-9e22-3d15bd9908ca/ovn-acl-logging/0.log"
Jul 09 17:16:02.887016 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:02.884253    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ng88_54ed8699-4487-4246-9e22-3d15bd9908ca/ovn-acl-logging/0.log"
Jul 09 17:16:03.955637 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:03.955598    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"]
Jul 09 17:16:03.959221 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:03.959201    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"
Jul 09 17:16:03.961840 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:03.961817    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b36b5c42-serving-cert\""
Jul 09 17:16:03.969641 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:03.969615    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"]
Jul 09 17:16:04.004656 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:04.004614    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9thvn\" (UniqueName: \"kubernetes.io/projected/13544f98-2fb0-4389-95fb-a3c449537cd2-kube-api-access-9thvn\") pod \"maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78\" (UID: \"13544f98-2fb0-4389-95fb-a3c449537cd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"
Jul 09 17:16:04.004656 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:04.004661    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13544f98-2fb0-4389-95fb-a3c449537cd2-openshift-service-ca\") pod \"maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78\" (UID: \"13544f98-2fb0-4389-95fb-a3c449537cd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"
Jul 09 17:16:04.004863 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:04.004680    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13544f98-2fb0-4389-95fb-a3c449537cd2-maas-api-tls\") pod \"maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78\" (UID: \"13544f98-2fb0-4389-95fb-a3c449537cd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"
Jul 09 17:16:04.105260 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:04.105231    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9thvn\" (UniqueName: \"kubernetes.io/projected/13544f98-2fb0-4389-95fb-a3c449537cd2-kube-api-access-9thvn\") pod \"maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78\" (UID: \"13544f98-2fb0-4389-95fb-a3c449537cd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"
Jul 09 17:16:04.105516 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:04.105269    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13544f98-2fb0-4389-95fb-a3c449537cd2-openshift-service-ca\") pod \"maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78\" (UID: \"13544f98-2fb0-4389-95fb-a3c449537cd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"
Jul 09 17:16:04.105516 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:04.105296    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13544f98-2fb0-4389-95fb-a3c449537cd2-maas-api-tls\") pod \"maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78\" (UID: \"13544f98-2fb0-4389-95fb-a3c449537cd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"
Jul 09 17:16:04.105516 ip-10-0-140-229 kubenswrapper[2568]: E0709 17:16:04.105464    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-serving-cert: secret "maas-api-e2e-ait-b36b5c42-serving-cert" not found
Jul 09 17:16:04.105710 ip-10-0-140-229 kubenswrapper[2568]: E0709 17:16:04.105554    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13544f98-2fb0-4389-95fb-a3c449537cd2-maas-api-tls podName:13544f98-2fb0-4389-95fb-a3c449537cd2 nodeName:}" failed. No retries permitted until 2026-07-09 17:16:04.60551976 +0000 UTC m=+1502.285935653 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/13544f98-2fb0-4389-95fb-a3c449537cd2-maas-api-tls") pod "maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78" (UID: "13544f98-2fb0-4389-95fb-a3c449537cd2") : secret "maas-api-e2e-ait-b36b5c42-serving-cert" not found
Jul 09 17:16:04.105962 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:04.105944    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13544f98-2fb0-4389-95fb-a3c449537cd2-openshift-service-ca\") pod \"maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78\" (UID: \"13544f98-2fb0-4389-95fb-a3c449537cd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"
Jul 09 17:16:04.120540 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:04.120515    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9thvn\" (UniqueName: \"kubernetes.io/projected/13544f98-2fb0-4389-95fb-a3c449537cd2-kube-api-access-9thvn\") pod \"maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78\" (UID: \"13544f98-2fb0-4389-95fb-a3c449537cd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"
Jul 09 17:16:04.610153 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:04.610114    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13544f98-2fb0-4389-95fb-a3c449537cd2-maas-api-tls\") pod \"maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78\" (UID: \"13544f98-2fb0-4389-95fb-a3c449537cd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"
Jul 09 17:16:04.612670 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:04.612642    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13544f98-2fb0-4389-95fb-a3c449537cd2-maas-api-tls\") pod \"maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78\" (UID: \"13544f98-2fb0-4389-95fb-a3c449537cd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"
Jul 09 17:16:04.872364 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:04.872270    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"
Jul 09 17:16:05.019961 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:05.019936    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"]
Jul 09 17:16:05.021916 ip-10-0-140-229 kubenswrapper[2568]: W0709 17:16:05.021884    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13544f98_2fb0_4389_95fb_a3c449537cd2.slice/crio-2e017c3c5e079bd66149782bdfa0a9a819077ed1e2bac17d5c194cfb29f600bf WatchSource:0}: Error finding container 2e017c3c5e079bd66149782bdfa0a9a819077ed1e2bac17d5c194cfb29f600bf: Status 404 returned error can't find the container with id 2e017c3c5e079bd66149782bdfa0a9a819077ed1e2bac17d5c194cfb29f600bf
Jul 09 17:16:05.962608 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:05.962574    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78" event={"ID":"13544f98-2fb0-4389-95fb-a3c449537cd2","Type":"ContainerStarted","Data":"59e847d88ce5b91aa29a6596440b6f039842f9698462039ba489256cf0887f50"}
Jul 09 17:16:05.962813 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:05.962629    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78" event={"ID":"13544f98-2fb0-4389-95fb-a3c449537cd2","Type":"ContainerStarted","Data":"2e017c3c5e079bd66149782bdfa0a9a819077ed1e2bac17d5c194cfb29f600bf"}
Jul 09 17:16:05.962813 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:05.962656    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"
Jul 09 17:16:05.982065 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:05.982009    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78" podStartSLOduration=2.570391863 podStartE2EDuration="2.981990184s" totalImagesPullingTime="411.598321ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:16:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:16:05.979877437 +0000 UTC m=+1503.660293357" watchObservedRunningTime="2026-07-09 17:16:05.981990184 +0000 UTC m=+1503.662406091"
Jul 09 17:16:09.255865 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:09.255833    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"]
Jul 09 17:16:09.256373 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:09.256072    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78" podUID="13544f98-2fb0-4389-95fb-a3c449537cd2" containerName="maas-api" containerID="cri-o://59e847d88ce5b91aa29a6596440b6f039842f9698462039ba489256cf0887f50" gracePeriod=30
Jul 09 17:16:09.520448 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:09.520377    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"
Jul 09 17:16:09.663153 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:09.663120    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9thvn\" (UniqueName: \"kubernetes.io/projected/13544f98-2fb0-4389-95fb-a3c449537cd2-kube-api-access-9thvn\") pod \"13544f98-2fb0-4389-95fb-a3c449537cd2\" (UID: \"13544f98-2fb0-4389-95fb-a3c449537cd2\") "
Jul 09 17:16:09.663342 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:09.663167    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13544f98-2fb0-4389-95fb-a3c449537cd2-maas-api-tls\") pod \"13544f98-2fb0-4389-95fb-a3c449537cd2\" (UID: \"13544f98-2fb0-4389-95fb-a3c449537cd2\") "
Jul 09 17:16:09.663342 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:09.663265    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13544f98-2fb0-4389-95fb-a3c449537cd2-openshift-service-ca\") pod \"13544f98-2fb0-4389-95fb-a3c449537cd2\" (UID: \"13544f98-2fb0-4389-95fb-a3c449537cd2\") "
Jul 09 17:16:09.663621 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:09.663597    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13544f98-2fb0-4389-95fb-a3c449537cd2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "13544f98-2fb0-4389-95fb-a3c449537cd2" (UID: "13544f98-2fb0-4389-95fb-a3c449537cd2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:16:09.665520 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:09.665497    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13544f98-2fb0-4389-95fb-a3c449537cd2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "13544f98-2fb0-4389-95fb-a3c449537cd2" (UID: "13544f98-2fb0-4389-95fb-a3c449537cd2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:16:09.665596 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:09.665526    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13544f98-2fb0-4389-95fb-a3c449537cd2-kube-api-access-9thvn" (OuterVolumeSpecName: "kube-api-access-9thvn") pod "13544f98-2fb0-4389-95fb-a3c449537cd2" (UID: "13544f98-2fb0-4389-95fb-a3c449537cd2"). InnerVolumeSpecName "kube-api-access-9thvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:16:09.765043 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:09.765003    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13544f98-2fb0-4389-95fb-a3c449537cd2-openshift-service-ca\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:16:09.765043 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:09.765035    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9thvn\" (UniqueName: \"kubernetes.io/projected/13544f98-2fb0-4389-95fb-a3c449537cd2-kube-api-access-9thvn\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:16:09.765043 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:09.765045    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13544f98-2fb0-4389-95fb-a3c449537cd2-maas-api-tls\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:16:09.991630 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:09.991598    2568 generic.go:356] "Generic (PLEG): container finished" podID="13544f98-2fb0-4389-95fb-a3c449537cd2" containerID="59e847d88ce5b91aa29a6596440b6f039842f9698462039ba489256cf0887f50" exitCode=0
Jul 09 17:16:09.991776 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:09.991643    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"
Jul 09 17:16:09.991776 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:09.991676    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78" event={"ID":"13544f98-2fb0-4389-95fb-a3c449537cd2","Type":"ContainerDied","Data":"59e847d88ce5b91aa29a6596440b6f039842f9698462039ba489256cf0887f50"}
Jul 09 17:16:09.991776 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:09.991723    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78" event={"ID":"13544f98-2fb0-4389-95fb-a3c449537cd2","Type":"ContainerDied","Data":"2e017c3c5e079bd66149782bdfa0a9a819077ed1e2bac17d5c194cfb29f600bf"}
Jul 09 17:16:09.991776 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:09.991746    2568 scope.go:117] "RemoveContainer" containerID="59e847d88ce5b91aa29a6596440b6f039842f9698462039ba489256cf0887f50"
Jul 09 17:16:10.001591 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:10.001576    2568 scope.go:117] "RemoveContainer" containerID="59e847d88ce5b91aa29a6596440b6f039842f9698462039ba489256cf0887f50"
Jul 09 17:16:10.001887 ip-10-0-140-229 kubenswrapper[2568]: E0709 17:16:10.001865    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59e847d88ce5b91aa29a6596440b6f039842f9698462039ba489256cf0887f50\": container with ID starting with 59e847d88ce5b91aa29a6596440b6f039842f9698462039ba489256cf0887f50 not found: ID does not exist" containerID="59e847d88ce5b91aa29a6596440b6f039842f9698462039ba489256cf0887f50"
Jul 09 17:16:10.001945 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:10.001896    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59e847d88ce5b91aa29a6596440b6f039842f9698462039ba489256cf0887f50"} err="failed to get container status \"59e847d88ce5b91aa29a6596440b6f039842f9698462039ba489256cf0887f50\": rpc error: code = NotFound desc = could not find container \"59e847d88ce5b91aa29a6596440b6f039842f9698462039ba489256cf0887f50\": container with ID starting with 59e847d88ce5b91aa29a6596440b6f039842f9698462039ba489256cf0887f50 not found: ID does not exist"
Jul 09 17:16:10.010177 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:10.010154    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"]
Jul 09 17:16:10.014401 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:10.014374    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b36b5c42-5f59bbd675-cvg78"]
Jul 09 17:16:11.940014 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:11.939984    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13544f98-2fb0-4389-95fb-a3c449537cd2" path="/var/lib/kubelet/pods/13544f98-2fb0-4389-95fb-a3c449537cd2/volumes"
Jul 09 17:16:16.271180 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:16.271142    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml"]
Jul 09 17:16:16.271725 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:16.271679    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13544f98-2fb0-4389-95fb-a3c449537cd2" containerName="maas-api"
Jul 09 17:16:16.271725 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:16.271693    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="13544f98-2fb0-4389-95fb-a3c449537cd2" containerName="maas-api"
Jul 09 17:16:16.271864 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:16.271782    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="13544f98-2fb0-4389-95fb-a3c449537cd2" containerName="maas-api"
Jul 09 17:16:16.276702 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:16.276678    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml"
Jul 09 17:16:16.279310 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:16.279290    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-95b1a2a3-serving-cert\""
Jul 09 17:16:16.292409 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:16.292383    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml"]
Jul 09 17:16:16.429159 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:16.429109    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ea8bcad-d243-4caf-be27-05b28e538085-maas-api-tls\") pod \"maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml\" (UID: \"4ea8bcad-d243-4caf-be27-05b28e538085\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml"
Jul 09 17:16:16.429390 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:16.429227    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea8bcad-d243-4caf-be27-05b28e538085-openshift-service-ca\") pod \"maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml\" (UID: \"4ea8bcad-d243-4caf-be27-05b28e538085\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml"
Jul 09 17:16:16.429390 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:16.429314    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s22k\" (UniqueName: \"kubernetes.io/projected/4ea8bcad-d243-4caf-be27-05b28e538085-kube-api-access-4s22k\") pod \"maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml\" (UID: \"4ea8bcad-d243-4caf-be27-05b28e538085\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml"
Jul 09 17:16:16.530274 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:16.530186    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ea8bcad-d243-4caf-be27-05b28e538085-maas-api-tls\") pod \"maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml\" (UID: \"4ea8bcad-d243-4caf-be27-05b28e538085\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml"
Jul 09 17:16:16.530274 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:16.530237    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea8bcad-d243-4caf-be27-05b28e538085-openshift-service-ca\") pod \"maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml\" (UID: \"4ea8bcad-d243-4caf-be27-05b28e538085\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml"
Jul 09 17:16:16.530274 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:16.530268    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s22k\" (UniqueName: \"kubernetes.io/projected/4ea8bcad-d243-4caf-be27-05b28e538085-kube-api-access-4s22k\") pod \"maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml\" (UID: \"4ea8bcad-d243-4caf-be27-05b28e538085\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml"
Jul 09 17:16:16.530941 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:16.530918    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea8bcad-d243-4caf-be27-05b28e538085-openshift-service-ca\") pod \"maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml\" (UID: \"4ea8bcad-d243-4caf-be27-05b28e538085\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml"
Jul 09 17:16:16.532677 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:16.532653    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ea8bcad-d243-4caf-be27-05b28e538085-maas-api-tls\") pod \"maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml\" (UID: \"4ea8bcad-d243-4caf-be27-05b28e538085\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml"
Jul 09 17:16:16.538331 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:16.538311    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s22k\" (UniqueName: \"kubernetes.io/projected/4ea8bcad-d243-4caf-be27-05b28e538085-kube-api-access-4s22k\") pod \"maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml\" (UID: \"4ea8bcad-d243-4caf-be27-05b28e538085\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml"
Jul 09 17:16:16.588623 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:16.588591    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml"
Jul 09 17:16:16.729946 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:16.729920    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml"]
Jul 09 17:16:16.731661 ip-10-0-140-229 kubenswrapper[2568]: W0709 17:16:16.731638    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea8bcad_d243_4caf_be27_05b28e538085.slice/crio-5211d1c529e878be7e93404daf7ddab73439b3d6c2d93ce2ad35f04e128287e9 WatchSource:0}: Error finding container 5211d1c529e878be7e93404daf7ddab73439b3d6c2d93ce2ad35f04e128287e9: Status 404 returned error can't find the container with id 5211d1c529e878be7e93404daf7ddab73439b3d6c2d93ce2ad35f04e128287e9
Jul 09 17:16:17.032327 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:17.032285    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml" event={"ID":"4ea8bcad-d243-4caf-be27-05b28e538085","Type":"ContainerStarted","Data":"5211d1c529e878be7e93404daf7ddab73439b3d6c2d93ce2ad35f04e128287e9"}
Jul 09 17:16:18.046329 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:18.046281    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml" event={"ID":"4ea8bcad-d243-4caf-be27-05b28e538085","Type":"ContainerStarted","Data":"5d018d3fa6156e100577f5c7a9986bc26137bad606655960e21adf784fc1c70c"}
Jul 09 17:16:18.046829 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:18.046401    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml"
Jul 09 17:16:18.063437 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:18.063297    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml" podStartSLOduration=1.636065418 podStartE2EDuration="2.06327905s" totalImagesPullingTime="427.213632ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:16:18.062748885 +0000 UTC m=+1515.743164794" watchObservedRunningTime="2026-07-09 17:16:18.06327905 +0000 UTC m=+1515.743694959"
Jul 09 17:16:21.593707 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:21.593670    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml"]
Jul 09 17:16:21.594203 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:21.593898    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml" podUID="4ea8bcad-d243-4caf-be27-05b28e538085" containerName="maas-api" containerID="cri-o://5d018d3fa6156e100577f5c7a9986bc26137bad606655960e21adf784fc1c70c" gracePeriod=30
Jul 09 17:16:21.850681 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:21.850615    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml"
Jul 09 17:16:21.983157 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:21.983119    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ea8bcad-d243-4caf-be27-05b28e538085-maas-api-tls\") pod \"4ea8bcad-d243-4caf-be27-05b28e538085\" (UID: \"4ea8bcad-d243-4caf-be27-05b28e538085\") "
Jul 09 17:16:21.983335 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:21.983172    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4s22k\" (UniqueName: \"kubernetes.io/projected/4ea8bcad-d243-4caf-be27-05b28e538085-kube-api-access-4s22k\") pod \"4ea8bcad-d243-4caf-be27-05b28e538085\" (UID: \"4ea8bcad-d243-4caf-be27-05b28e538085\") "
Jul 09 17:16:21.983335 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:21.983230    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea8bcad-d243-4caf-be27-05b28e538085-openshift-service-ca\") pod \"4ea8bcad-d243-4caf-be27-05b28e538085\" (UID: \"4ea8bcad-d243-4caf-be27-05b28e538085\") "
Jul 09 17:16:21.983694 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:21.983664    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ea8bcad-d243-4caf-be27-05b28e538085-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4ea8bcad-d243-4caf-be27-05b28e538085" (UID: "4ea8bcad-d243-4caf-be27-05b28e538085"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:16:21.985266 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:21.985237    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ea8bcad-d243-4caf-be27-05b28e538085-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4ea8bcad-d243-4caf-be27-05b28e538085" (UID: "4ea8bcad-d243-4caf-be27-05b28e538085"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:16:21.985472 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:21.985449    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ea8bcad-d243-4caf-be27-05b28e538085-kube-api-access-4s22k" (OuterVolumeSpecName: "kube-api-access-4s22k") pod "4ea8bcad-d243-4caf-be27-05b28e538085" (UID: "4ea8bcad-d243-4caf-be27-05b28e538085"). InnerVolumeSpecName "kube-api-access-4s22k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:16:22.071456 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:22.071414    2568 generic.go:356] "Generic (PLEG): container finished" podID="4ea8bcad-d243-4caf-be27-05b28e538085" containerID="5d018d3fa6156e100577f5c7a9986bc26137bad606655960e21adf784fc1c70c" exitCode=0
Jul 09 17:16:22.071633 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:22.071464    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml"
Jul 09 17:16:22.071633 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:22.071520    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml" event={"ID":"4ea8bcad-d243-4caf-be27-05b28e538085","Type":"ContainerDied","Data":"5d018d3fa6156e100577f5c7a9986bc26137bad606655960e21adf784fc1c70c"}
Jul 09 17:16:22.071633 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:22.071575    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml" event={"ID":"4ea8bcad-d243-4caf-be27-05b28e538085","Type":"ContainerDied","Data":"5211d1c529e878be7e93404daf7ddab73439b3d6c2d93ce2ad35f04e128287e9"}
Jul 09 17:16:22.071633 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:22.071597    2568 scope.go:117] "RemoveContainer" containerID="5d018d3fa6156e100577f5c7a9986bc26137bad606655960e21adf784fc1c70c"
Jul 09 17:16:22.081777 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:22.081758    2568 scope.go:117] "RemoveContainer" containerID="5d018d3fa6156e100577f5c7a9986bc26137bad606655960e21adf784fc1c70c"
Jul 09 17:16:22.082055 ip-10-0-140-229 kubenswrapper[2568]: E0709 17:16:22.082036    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d018d3fa6156e100577f5c7a9986bc26137bad606655960e21adf784fc1c70c\": container with ID starting with 5d018d3fa6156e100577f5c7a9986bc26137bad606655960e21adf784fc1c70c not found: ID does not exist" containerID="5d018d3fa6156e100577f5c7a9986bc26137bad606655960e21adf784fc1c70c"
Jul 09 17:16:22.082116 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:22.082064    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d018d3fa6156e100577f5c7a9986bc26137bad606655960e21adf784fc1c70c"} err="failed to get container status \"5d018d3fa6156e100577f5c7a9986bc26137bad606655960e21adf784fc1c70c\": rpc error: code = NotFound desc = could not find container \"5d018d3fa6156e100577f5c7a9986bc26137bad606655960e21adf784fc1c70c\": container with ID starting with 5d018d3fa6156e100577f5c7a9986bc26137bad606655960e21adf784fc1c70c not found: ID does not exist"
Jul 09 17:16:22.084756 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:22.084739    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea8bcad-d243-4caf-be27-05b28e538085-openshift-service-ca\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:16:22.084818 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:22.084762    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ea8bcad-d243-4caf-be27-05b28e538085-maas-api-tls\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:16:22.084818 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:22.084775    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4s22k\" (UniqueName: \"kubernetes.io/projected/4ea8bcad-d243-4caf-be27-05b28e538085-kube-api-access-4s22k\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:16:22.097919 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:22.097887    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml"]
Jul 09 17:16:22.106729 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:22.106665    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-95b1a2a3-7df69cfb-bvwml"]
Jul 09 17:16:23.945474 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:23.945434    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ea8bcad-d243-4caf-be27-05b28e538085" path="/var/lib/kubelet/pods/4ea8bcad-d243-4caf-be27-05b28e538085/volumes"
Jul 09 17:16:30.130568 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:30.130528    2568 generic.go:356] "Generic (PLEG): container finished" podID="a375f3d2-5460-4ab2-aaaf-572806c45d3a" containerID="85d92eee6d1832d6eac6f8bd5900c891d17f47aef1fa39908245af7b127d83a2" exitCode=137
Jul 09 17:16:30.130992 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:30.130567    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-ppj5n" event={"ID":"a375f3d2-5460-4ab2-aaaf-572806c45d3a","Type":"ContainerDied","Data":"85d92eee6d1832d6eac6f8bd5900c891d17f47aef1fa39908245af7b127d83a2"}
Jul 09 17:16:30.195927 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:30.195902    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-ppj5n"
Jul 09 17:16:30.262808 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:30.262765    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wgh6\" (UniqueName: \"kubernetes.io/projected/a375f3d2-5460-4ab2-aaaf-572806c45d3a-kube-api-access-9wgh6\") pod \"a375f3d2-5460-4ab2-aaaf-572806c45d3a\" (UID: \"a375f3d2-5460-4ab2-aaaf-572806c45d3a\") "
Jul 09 17:16:30.264761 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:30.264728    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a375f3d2-5460-4ab2-aaaf-572806c45d3a-kube-api-access-9wgh6" (OuterVolumeSpecName: "kube-api-access-9wgh6") pod "a375f3d2-5460-4ab2-aaaf-572806c45d3a" (UID: "a375f3d2-5460-4ab2-aaaf-572806c45d3a"). InnerVolumeSpecName "kube-api-access-9wgh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:16:30.364035 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:30.363997    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wgh6\" (UniqueName: \"kubernetes.io/projected/a375f3d2-5460-4ab2-aaaf-572806c45d3a-kube-api-access-9wgh6\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:16:31.137604 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:31.137578    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-ppj5n"
Jul 09 17:16:31.138037 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:31.137625    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-ppj5n" event={"ID":"a375f3d2-5460-4ab2-aaaf-572806c45d3a","Type":"ContainerDied","Data":"8d3bd413bdbde8534d512b38a67a0c7f3292cf217a9ccba78deeaf0ca46e6ebd"}
Jul 09 17:16:31.138037 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:31.137676    2568 scope.go:117] "RemoveContainer" containerID="85d92eee6d1832d6eac6f8bd5900c891d17f47aef1fa39908245af7b127d83a2"
Jul 09 17:16:31.162225 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:31.162193    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726955-ppj5n"]
Jul 09 17:16:31.168216 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:31.168175    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726955-ppj5n"]
Jul 09 17:16:31.939346 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:31.939311    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a375f3d2-5460-4ab2-aaaf-572806c45d3a" path="/var/lib/kubelet/pods/a375f3d2-5460-4ab2-aaaf-572806c45d3a/volumes"
Jul 09 17:16:34.441076 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:34.441041    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"]
Jul 09 17:16:34.441717 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:34.441696    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a375f3d2-5460-4ab2-aaaf-572806c45d3a" containerName="cleanup"
Jul 09 17:16:34.441808 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:34.441720    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a375f3d2-5460-4ab2-aaaf-572806c45d3a" containerName="cleanup"
Jul 09 17:16:34.441808 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:34.441741    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ea8bcad-d243-4caf-be27-05b28e538085" containerName="maas-api"
Jul 09 17:16:34.441808 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:34.441751    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ea8bcad-d243-4caf-be27-05b28e538085" containerName="maas-api"
Jul 09 17:16:34.441956 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:34.441883    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a375f3d2-5460-4ab2-aaaf-572806c45d3a" containerName="cleanup"
Jul 09 17:16:34.441956 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:34.441900    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ea8bcad-d243-4caf-be27-05b28e538085" containerName="maas-api"
Jul 09 17:16:34.444934 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:34.444912    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"
Jul 09 17:16:34.448231 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:34.448207    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-65c0e4ad-serving-cert\""
Jul 09 17:16:34.465702 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:34.465670    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"]
Jul 09 17:16:34.502224 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:34.502185    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t5mr\" (UniqueName: \"kubernetes.io/projected/7d5b6b5a-a876-4308-84eb-649b9afaaee6-kube-api-access-2t5mr\") pod \"maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr\" (UID: \"7d5b6b5a-a876-4308-84eb-649b9afaaee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"
Jul 09 17:16:34.502432 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:34.502229    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d5b6b5a-a876-4308-84eb-649b9afaaee6-maas-api-tls\") pod \"maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr\" (UID: \"7d5b6b5a-a876-4308-84eb-649b9afaaee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"
Jul 09 17:16:34.502432 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:34.502399    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d5b6b5a-a876-4308-84eb-649b9afaaee6-openshift-service-ca\") pod \"maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr\" (UID: \"7d5b6b5a-a876-4308-84eb-649b9afaaee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"
Jul 09 17:16:34.603235 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:34.603196    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d5b6b5a-a876-4308-84eb-649b9afaaee6-openshift-service-ca\") pod \"maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr\" (UID: \"7d5b6b5a-a876-4308-84eb-649b9afaaee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"
Jul 09 17:16:34.603461 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:34.603275    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t5mr\" (UniqueName: \"kubernetes.io/projected/7d5b6b5a-a876-4308-84eb-649b9afaaee6-kube-api-access-2t5mr\") pod \"maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr\" (UID: \"7d5b6b5a-a876-4308-84eb-649b9afaaee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"
Jul 09 17:16:34.603461 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:34.603309    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d5b6b5a-a876-4308-84eb-649b9afaaee6-maas-api-tls\") pod \"maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr\" (UID: \"7d5b6b5a-a876-4308-84eb-649b9afaaee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"
Jul 09 17:16:34.603545 ip-10-0-140-229 kubenswrapper[2568]: E0709 17:16:34.603477    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-serving-cert: secret "maas-api-e2e-derive-65c0e4ad-serving-cert" not found
Jul 09 17:16:34.603580 ip-10-0-140-229 kubenswrapper[2568]: E0709 17:16:34.603555    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d5b6b5a-a876-4308-84eb-649b9afaaee6-maas-api-tls podName:7d5b6b5a-a876-4308-84eb-649b9afaaee6 nodeName:}" failed. No retries permitted until 2026-07-09 17:16:35.103532632 +0000 UTC m=+1532.783948519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7d5b6b5a-a876-4308-84eb-649b9afaaee6-maas-api-tls") pod "maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr" (UID: "7d5b6b5a-a876-4308-84eb-649b9afaaee6") : secret "maas-api-e2e-derive-65c0e4ad-serving-cert" not found
Jul 09 17:16:34.603999 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:34.603981    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d5b6b5a-a876-4308-84eb-649b9afaaee6-openshift-service-ca\") pod \"maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr\" (UID: \"7d5b6b5a-a876-4308-84eb-649b9afaaee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"
Jul 09 17:16:34.614395 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:34.614344    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t5mr\" (UniqueName: \"kubernetes.io/projected/7d5b6b5a-a876-4308-84eb-649b9afaaee6-kube-api-access-2t5mr\") pod \"maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr\" (UID: \"7d5b6b5a-a876-4308-84eb-649b9afaaee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"
Jul 09 17:16:35.107868 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:35.107834    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d5b6b5a-a876-4308-84eb-649b9afaaee6-maas-api-tls\") pod \"maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr\" (UID: \"7d5b6b5a-a876-4308-84eb-649b9afaaee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"
Jul 09 17:16:35.110369 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:35.110323    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d5b6b5a-a876-4308-84eb-649b9afaaee6-maas-api-tls\") pod \"maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr\" (UID: \"7d5b6b5a-a876-4308-84eb-649b9afaaee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"
Jul 09 17:16:35.355769 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:35.355731    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"
Jul 09 17:16:35.500634 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:35.500608    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"]
Jul 09 17:16:35.502684 ip-10-0-140-229 kubenswrapper[2568]: W0709 17:16:35.502659    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5b6b5a_a876_4308_84eb_649b9afaaee6.slice/crio-c09ab1404cc45658352ea6de2d40b0361348d9a3fc7f51cd562ab44ca7d36d88 WatchSource:0}: Error finding container c09ab1404cc45658352ea6de2d40b0361348d9a3fc7f51cd562ab44ca7d36d88: Status 404 returned error can't find the container with id c09ab1404cc45658352ea6de2d40b0361348d9a3fc7f51cd562ab44ca7d36d88
Jul 09 17:16:36.169607 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:36.169563    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr" event={"ID":"7d5b6b5a-a876-4308-84eb-649b9afaaee6","Type":"ContainerStarted","Data":"c09ab1404cc45658352ea6de2d40b0361348d9a3fc7f51cd562ab44ca7d36d88"}
Jul 09 17:16:37.177489 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:37.177450    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr" event={"ID":"7d5b6b5a-a876-4308-84eb-649b9afaaee6","Type":"ContainerStarted","Data":"35c665e5d6311b10faa1a649ad08cdb39a37980cd4a7fadc7a6f24b02ac2f50b"}
Jul 09 17:16:37.177940 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:37.177594    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"
Jul 09 17:16:37.196047 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:37.195995    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr" podStartSLOduration=2.174467222 podStartE2EDuration="3.195979433s" totalImagesPullingTime="1.021512211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:16:37.193776342 +0000 UTC m=+1534.874192252" watchObservedRunningTime="2026-07-09 17:16:37.195979433 +0000 UTC m=+1534.876395341"
Jul 09 17:16:39.195465 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:39.195429    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"]
Jul 09 17:16:39.195943 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:39.195691    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr" podUID="7d5b6b5a-a876-4308-84eb-649b9afaaee6" containerName="maas-api" containerID="cri-o://35c665e5d6311b10faa1a649ad08cdb39a37980cd4a7fadc7a6f24b02ac2f50b" gracePeriod=30
Jul 09 17:16:39.461756 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:39.461689    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"
Jul 09 17:16:39.551848 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:39.551815    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d5b6b5a-a876-4308-84eb-649b9afaaee6-openshift-service-ca\") pod \"7d5b6b5a-a876-4308-84eb-649b9afaaee6\" (UID: \"7d5b6b5a-a876-4308-84eb-649b9afaaee6\") "
Jul 09 17:16:39.552003 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:39.551907    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d5b6b5a-a876-4308-84eb-649b9afaaee6-maas-api-tls\") pod \"7d5b6b5a-a876-4308-84eb-649b9afaaee6\" (UID: \"7d5b6b5a-a876-4308-84eb-649b9afaaee6\") "
Jul 09 17:16:39.552003 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:39.551961    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2t5mr\" (UniqueName: \"kubernetes.io/projected/7d5b6b5a-a876-4308-84eb-649b9afaaee6-kube-api-access-2t5mr\") pod \"7d5b6b5a-a876-4308-84eb-649b9afaaee6\" (UID: \"7d5b6b5a-a876-4308-84eb-649b9afaaee6\") "
Jul 09 17:16:39.552227 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:39.552203    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d5b6b5a-a876-4308-84eb-649b9afaaee6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7d5b6b5a-a876-4308-84eb-649b9afaaee6" (UID: "7d5b6b5a-a876-4308-84eb-649b9afaaee6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:16:39.554028 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:39.553998    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d5b6b5a-a876-4308-84eb-649b9afaaee6-kube-api-access-2t5mr" (OuterVolumeSpecName: "kube-api-access-2t5mr") pod "7d5b6b5a-a876-4308-84eb-649b9afaaee6" (UID: "7d5b6b5a-a876-4308-84eb-649b9afaaee6"). InnerVolumeSpecName "kube-api-access-2t5mr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:16:39.554028 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:39.554023    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d5b6b5a-a876-4308-84eb-649b9afaaee6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7d5b6b5a-a876-4308-84eb-649b9afaaee6" (UID: "7d5b6b5a-a876-4308-84eb-649b9afaaee6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:16:39.652704 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:39.652670    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2t5mr\" (UniqueName: \"kubernetes.io/projected/7d5b6b5a-a876-4308-84eb-649b9afaaee6-kube-api-access-2t5mr\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:16:39.652704 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:39.652699    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d5b6b5a-a876-4308-84eb-649b9afaaee6-openshift-service-ca\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:16:39.652704 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:39.652710    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d5b6b5a-a876-4308-84eb-649b9afaaee6-maas-api-tls\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:16:40.197071 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:40.197037    2568 generic.go:356] "Generic (PLEG): container finished" podID="7d5b6b5a-a876-4308-84eb-649b9afaaee6" containerID="35c665e5d6311b10faa1a649ad08cdb39a37980cd4a7fadc7a6f24b02ac2f50b" exitCode=0
Jul 09 17:16:40.197622 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:40.197089    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"
Jul 09 17:16:40.197622 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:40.197122    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr" event={"ID":"7d5b6b5a-a876-4308-84eb-649b9afaaee6","Type":"ContainerDied","Data":"35c665e5d6311b10faa1a649ad08cdb39a37980cd4a7fadc7a6f24b02ac2f50b"}
Jul 09 17:16:40.197622 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:40.197189    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr" event={"ID":"7d5b6b5a-a876-4308-84eb-649b9afaaee6","Type":"ContainerDied","Data":"c09ab1404cc45658352ea6de2d40b0361348d9a3fc7f51cd562ab44ca7d36d88"}
Jul 09 17:16:40.197622 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:40.197218    2568 scope.go:117] "RemoveContainer" containerID="35c665e5d6311b10faa1a649ad08cdb39a37980cd4a7fadc7a6f24b02ac2f50b"
Jul 09 17:16:40.206539 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:40.206516    2568 scope.go:117] "RemoveContainer" containerID="35c665e5d6311b10faa1a649ad08cdb39a37980cd4a7fadc7a6f24b02ac2f50b"
Jul 09 17:16:40.206806 ip-10-0-140-229 kubenswrapper[2568]: E0709 17:16:40.206787    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35c665e5d6311b10faa1a649ad08cdb39a37980cd4a7fadc7a6f24b02ac2f50b\": container with ID starting with 35c665e5d6311b10faa1a649ad08cdb39a37980cd4a7fadc7a6f24b02ac2f50b not found: ID does not exist" containerID="35c665e5d6311b10faa1a649ad08cdb39a37980cd4a7fadc7a6f24b02ac2f50b"
Jul 09 17:16:40.206856 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:40.206815    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35c665e5d6311b10faa1a649ad08cdb39a37980cd4a7fadc7a6f24b02ac2f50b"} err="failed to get container status \"35c665e5d6311b10faa1a649ad08cdb39a37980cd4a7fadc7a6f24b02ac2f50b\": rpc error: code = NotFound desc = could not find container \"35c665e5d6311b10faa1a649ad08cdb39a37980cd4a7fadc7a6f24b02ac2f50b\": container with ID starting with 35c665e5d6311b10faa1a649ad08cdb39a37980cd4a7fadc7a6f24b02ac2f50b not found: ID does not exist"
Jul 09 17:16:40.215597 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:40.215572    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"]
Jul 09 17:16:40.219254 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:40.219226    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-65c0e4ad-58b979b8df-9h5pr"]
Jul 09 17:16:41.939985 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:16:41.939948    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d5b6b5a-a876-4308-84eb-649b9afaaee6" path="/var/lib/kubelet/pods/7d5b6b5a-a876-4308-84eb-649b9afaaee6/volumes"
Jul 09 17:18:23.586810 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:23.586777    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"]
Jul 09 17:18:23.587269 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:23.587256    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d5b6b5a-a876-4308-84eb-649b9afaaee6" containerName="maas-api"
Jul 09 17:18:23.587313 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:23.587270    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d5b6b5a-a876-4308-84eb-649b9afaaee6" containerName="maas-api"
Jul 09 17:18:23.587349 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:23.587344    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d5b6b5a-a876-4308-84eb-649b9afaaee6" containerName="maas-api"
Jul 09 17:18:23.590544 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:23.590524    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"
Jul 09 17:18:23.594151 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:23.594128    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-895137fa-serving-cert\""
Jul 09 17:18:23.602427 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:23.602401    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"]
Jul 09 17:18:23.681770 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:23.681735    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b935d5f9-6586-4f34-b86c-da138038bafd-maas-api-tls\") pod \"maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc\" (UID: \"b935d5f9-6586-4f34-b86c-da138038bafd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"
Jul 09 17:18:23.681949 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:23.681881    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw8p2\" (UniqueName: \"kubernetes.io/projected/b935d5f9-6586-4f34-b86c-da138038bafd-kube-api-access-tw8p2\") pod \"maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc\" (UID: \"b935d5f9-6586-4f34-b86c-da138038bafd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"
Jul 09 17:18:23.681997 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:23.681952    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b935d5f9-6586-4f34-b86c-da138038bafd-openshift-service-ca\") pod \"maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc\" (UID: \"b935d5f9-6586-4f34-b86c-da138038bafd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"
Jul 09 17:18:23.783147 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:23.783112    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw8p2\" (UniqueName: \"kubernetes.io/projected/b935d5f9-6586-4f34-b86c-da138038bafd-kube-api-access-tw8p2\") pod \"maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc\" (UID: \"b935d5f9-6586-4f34-b86c-da138038bafd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"
Jul 09 17:18:23.783399 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:23.783211    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b935d5f9-6586-4f34-b86c-da138038bafd-openshift-service-ca\") pod \"maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc\" (UID: \"b935d5f9-6586-4f34-b86c-da138038bafd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"
Jul 09 17:18:23.783399 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:23.783257    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b935d5f9-6586-4f34-b86c-da138038bafd-maas-api-tls\") pod \"maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc\" (UID: \"b935d5f9-6586-4f34-b86c-da138038bafd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"
Jul 09 17:18:23.783501 ip-10-0-140-229 kubenswrapper[2568]: E0709 17:18:23.783450    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-serving-cert: secret "maas-api-e2e-mt-895137fa-serving-cert" not found
Jul 09 17:18:23.783553 ip-10-0-140-229 kubenswrapper[2568]: E0709 17:18:23.783541    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b935d5f9-6586-4f34-b86c-da138038bafd-maas-api-tls podName:b935d5f9-6586-4f34-b86c-da138038bafd nodeName:}" failed. No retries permitted until 2026-07-09 17:18:24.283520614 +0000 UTC m=+1641.963936500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b935d5f9-6586-4f34-b86c-da138038bafd-maas-api-tls") pod "maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc" (UID: "b935d5f9-6586-4f34-b86c-da138038bafd") : secret "maas-api-e2e-mt-895137fa-serving-cert" not found
Jul 09 17:18:23.783853 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:23.783832    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b935d5f9-6586-4f34-b86c-da138038bafd-openshift-service-ca\") pod \"maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc\" (UID: \"b935d5f9-6586-4f34-b86c-da138038bafd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"
Jul 09 17:18:23.811554 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:23.811516    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw8p2\" (UniqueName: \"kubernetes.io/projected/b935d5f9-6586-4f34-b86c-da138038bafd-kube-api-access-tw8p2\") pod \"maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc\" (UID: \"b935d5f9-6586-4f34-b86c-da138038bafd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"
Jul 09 17:18:24.289790 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:24.289756    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b935d5f9-6586-4f34-b86c-da138038bafd-maas-api-tls\") pod \"maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc\" (UID: \"b935d5f9-6586-4f34-b86c-da138038bafd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"
Jul 09 17:18:24.292411 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:24.292383    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b935d5f9-6586-4f34-b86c-da138038bafd-maas-api-tls\") pod \"maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc\" (UID: \"b935d5f9-6586-4f34-b86c-da138038bafd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"
Jul 09 17:18:24.503121 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:24.503082    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"
Jul 09 17:18:24.655997 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:24.653160    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"]
Jul 09 17:18:24.661477 ip-10-0-140-229 kubenswrapper[2568]: W0709 17:18:24.661442    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb935d5f9_6586_4f34_b86c_da138038bafd.slice/crio-5cdfd14b89107d9e0f8d909402bb6fa68472786c997d92ae41b89a034fa532af WatchSource:0}: Error finding container 5cdfd14b89107d9e0f8d909402bb6fa68472786c997d92ae41b89a034fa532af: Status 404 returned error can't find the container with id 5cdfd14b89107d9e0f8d909402bb6fa68472786c997d92ae41b89a034fa532af
Jul 09 17:18:24.786653 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:24.786616    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc" event={"ID":"b935d5f9-6586-4f34-b86c-da138038bafd","Type":"ContainerStarted","Data":"5cdfd14b89107d9e0f8d909402bb6fa68472786c997d92ae41b89a034fa532af"}
Jul 09 17:18:25.793651 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:25.793603    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc" event={"ID":"b935d5f9-6586-4f34-b86c-da138038bafd","Type":"ContainerStarted","Data":"2fbaf4721051edbb566f620b3c9e330f91372675a4b79003d37d4de1abcdd7e7"}
Jul 09 17:18:25.794138 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:25.793689    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"
Jul 09 17:18:25.812268 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:25.812218    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc" podStartSLOduration=2.290943844 podStartE2EDuration="2.812199893s" totalImagesPullingTime="521.256049ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:18:25.810821454 +0000 UTC m=+1643.491237362" watchObservedRunningTime="2026-07-09 17:18:25.812199893 +0000 UTC m=+1643.492615803"
Jul 09 17:18:31.805826 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:31.805792    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"
Jul 09 17:18:35.546570 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:35.546536    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"]
Jul 09 17:18:35.547108 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:35.546761    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc" podUID="b935d5f9-6586-4f34-b86c-da138038bafd" containerName="maas-api" containerID="cri-o://2fbaf4721051edbb566f620b3c9e330f91372675a4b79003d37d4de1abcdd7e7" gracePeriod=30
Jul 09 17:18:35.809504 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:35.809436    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"
Jul 09 17:18:35.852935 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:35.852897    2568 generic.go:356] "Generic (PLEG): container finished" podID="b935d5f9-6586-4f34-b86c-da138038bafd" containerID="2fbaf4721051edbb566f620b3c9e330f91372675a4b79003d37d4de1abcdd7e7" exitCode=0
Jul 09 17:18:35.853137 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:35.852945    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"
Jul 09 17:18:35.853137 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:35.852965    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc" event={"ID":"b935d5f9-6586-4f34-b86c-da138038bafd","Type":"ContainerDied","Data":"2fbaf4721051edbb566f620b3c9e330f91372675a4b79003d37d4de1abcdd7e7"}
Jul 09 17:18:35.853137 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:35.853019    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc" event={"ID":"b935d5f9-6586-4f34-b86c-da138038bafd","Type":"ContainerDied","Data":"5cdfd14b89107d9e0f8d909402bb6fa68472786c997d92ae41b89a034fa532af"}
Jul 09 17:18:35.853137 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:35.853050    2568 scope.go:117] "RemoveContainer" containerID="2fbaf4721051edbb566f620b3c9e330f91372675a4b79003d37d4de1abcdd7e7"
Jul 09 17:18:35.862103 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:35.862079    2568 scope.go:117] "RemoveContainer" containerID="2fbaf4721051edbb566f620b3c9e330f91372675a4b79003d37d4de1abcdd7e7"
Jul 09 17:18:35.862428 ip-10-0-140-229 kubenswrapper[2568]: E0709 17:18:35.862408    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fbaf4721051edbb566f620b3c9e330f91372675a4b79003d37d4de1abcdd7e7\": container with ID starting with 2fbaf4721051edbb566f620b3c9e330f91372675a4b79003d37d4de1abcdd7e7 not found: ID does not exist" containerID="2fbaf4721051edbb566f620b3c9e330f91372675a4b79003d37d4de1abcdd7e7"
Jul 09 17:18:35.862526 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:35.862435    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fbaf4721051edbb566f620b3c9e330f91372675a4b79003d37d4de1abcdd7e7"} err="failed to get container status \"2fbaf4721051edbb566f620b3c9e330f91372675a4b79003d37d4de1abcdd7e7\": rpc error: code = NotFound desc = could not find container \"2fbaf4721051edbb566f620b3c9e330f91372675a4b79003d37d4de1abcdd7e7\": container with ID starting with 2fbaf4721051edbb566f620b3c9e330f91372675a4b79003d37d4de1abcdd7e7 not found: ID does not exist"
Jul 09 17:18:35.902419 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:35.902382    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tw8p2\" (UniqueName: \"kubernetes.io/projected/b935d5f9-6586-4f34-b86c-da138038bafd-kube-api-access-tw8p2\") pod \"b935d5f9-6586-4f34-b86c-da138038bafd\" (UID: \"b935d5f9-6586-4f34-b86c-da138038bafd\") "
Jul 09 17:18:35.902419 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:35.902425    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b935d5f9-6586-4f34-b86c-da138038bafd-openshift-service-ca\") pod \"b935d5f9-6586-4f34-b86c-da138038bafd\" (UID: \"b935d5f9-6586-4f34-b86c-da138038bafd\") "
Jul 09 17:18:35.902623 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:35.902514    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b935d5f9-6586-4f34-b86c-da138038bafd-maas-api-tls\") pod \"b935d5f9-6586-4f34-b86c-da138038bafd\" (UID: \"b935d5f9-6586-4f34-b86c-da138038bafd\") "
Jul 09 17:18:35.902841 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:35.902816    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b935d5f9-6586-4f34-b86c-da138038bafd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b935d5f9-6586-4f34-b86c-da138038bafd" (UID: "b935d5f9-6586-4f34-b86c-da138038bafd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:18:35.904647 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:35.904618    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b935d5f9-6586-4f34-b86c-da138038bafd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b935d5f9-6586-4f34-b86c-da138038bafd" (UID: "b935d5f9-6586-4f34-b86c-da138038bafd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:18:35.904647 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:35.904629    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b935d5f9-6586-4f34-b86c-da138038bafd-kube-api-access-tw8p2" (OuterVolumeSpecName: "kube-api-access-tw8p2") pod "b935d5f9-6586-4f34-b86c-da138038bafd" (UID: "b935d5f9-6586-4f34-b86c-da138038bafd"). InnerVolumeSpecName "kube-api-access-tw8p2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:18:36.003713 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:36.003675    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b935d5f9-6586-4f34-b86c-da138038bafd-maas-api-tls\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:18:36.003713 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:36.003706    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tw8p2\" (UniqueName: \"kubernetes.io/projected/b935d5f9-6586-4f34-b86c-da138038bafd-kube-api-access-tw8p2\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:18:36.003713 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:36.003715    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b935d5f9-6586-4f34-b86c-da138038bafd-openshift-service-ca\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:18:36.168670 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:36.168638    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"]
Jul 09 17:18:36.176151 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:36.176122    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-895137fa-7f88cd6d7f-rcjmc"]
Jul 09 17:18:37.939291 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:18:37.939248    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b935d5f9-6586-4f34-b86c-da138038bafd" path="/var/lib/kubelet/pods/b935d5f9-6586-4f34-b86c-da138038bafd/volumes"
Jul 09 17:19:03.990893 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:03.990851    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"]
Jul 09 17:19:03.991334 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:03.991321    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b935d5f9-6586-4f34-b86c-da138038bafd" containerName="maas-api"
Jul 09 17:19:03.991399 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:03.991335    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b935d5f9-6586-4f34-b86c-da138038bafd" containerName="maas-api"
Jul 09 17:19:03.991435 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:03.991417    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b935d5f9-6586-4f34-b86c-da138038bafd" containerName="maas-api"
Jul 09 17:19:03.994461 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:03.994445    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"
Jul 09 17:19:04.000602 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:04.000576    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b9b28345-serving-cert\""
Jul 09 17:19:04.034181 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:04.034149    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"]
Jul 09 17:19:04.078686 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:04.078651    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qfj8\" (UniqueName: \"kubernetes.io/projected/af26b888-dd04-4397-a1bd-d4b402d67e17-kube-api-access-4qfj8\") pod \"maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr\" (UID: \"af26b888-dd04-4397-a1bd-d4b402d67e17\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"
Jul 09 17:19:04.078871 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:04.078700    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af26b888-dd04-4397-a1bd-d4b402d67e17-maas-api-tls\") pod \"maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr\" (UID: \"af26b888-dd04-4397-a1bd-d4b402d67e17\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"
Jul 09 17:19:04.078871 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:04.078725    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af26b888-dd04-4397-a1bd-d4b402d67e17-openshift-service-ca\") pod \"maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr\" (UID: \"af26b888-dd04-4397-a1bd-d4b402d67e17\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"
Jul 09 17:19:04.180029 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:04.179985    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qfj8\" (UniqueName: \"kubernetes.io/projected/af26b888-dd04-4397-a1bd-d4b402d67e17-kube-api-access-4qfj8\") pod \"maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr\" (UID: \"af26b888-dd04-4397-a1bd-d4b402d67e17\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"
Jul 09 17:19:04.180241 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:04.180050    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af26b888-dd04-4397-a1bd-d4b402d67e17-maas-api-tls\") pod \"maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr\" (UID: \"af26b888-dd04-4397-a1bd-d4b402d67e17\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"
Jul 09 17:19:04.180241 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:04.180086    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af26b888-dd04-4397-a1bd-d4b402d67e17-openshift-service-ca\") pod \"maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr\" (UID: \"af26b888-dd04-4397-a1bd-d4b402d67e17\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"
Jul 09 17:19:04.180870 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:04.180851    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af26b888-dd04-4397-a1bd-d4b402d67e17-openshift-service-ca\") pod \"maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr\" (UID: \"af26b888-dd04-4397-a1bd-d4b402d67e17\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"
Jul 09 17:19:04.182466 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:04.182449    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af26b888-dd04-4397-a1bd-d4b402d67e17-maas-api-tls\") pod \"maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr\" (UID: \"af26b888-dd04-4397-a1bd-d4b402d67e17\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"
Jul 09 17:19:04.189103 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:04.189078    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qfj8\" (UniqueName: \"kubernetes.io/projected/af26b888-dd04-4397-a1bd-d4b402d67e17-kube-api-access-4qfj8\") pod \"maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr\" (UID: \"af26b888-dd04-4397-a1bd-d4b402d67e17\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"
Jul 09 17:19:04.305441 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:04.305315    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"
Jul 09 17:19:04.452837 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:04.452807    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"]
Jul 09 17:19:04.453823 ip-10-0-140-229 kubenswrapper[2568]: W0709 17:19:04.453799    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf26b888_dd04_4397_a1bd_d4b402d67e17.slice/crio-1f937eabd62b97cdbe66809ffc6a589afec557513b8a985bdeea40927e80be55 WatchSource:0}: Error finding container 1f937eabd62b97cdbe66809ffc6a589afec557513b8a985bdeea40927e80be55: Status 404 returned error can't find the container with id 1f937eabd62b97cdbe66809ffc6a589afec557513b8a985bdeea40927e80be55
Jul 09 17:19:05.012119 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:05.012030    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr" event={"ID":"af26b888-dd04-4397-a1bd-d4b402d67e17","Type":"ContainerStarted","Data":"bc30625a3761de6b6e4d18b4c9416918ef74c3cb88e53a564cb04f123d78ffab"}
Jul 09 17:19:05.012119 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:05.012087    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr" event={"ID":"af26b888-dd04-4397-a1bd-d4b402d67e17","Type":"ContainerStarted","Data":"1f937eabd62b97cdbe66809ffc6a589afec557513b8a985bdeea40927e80be55"}
Jul 09 17:19:05.012577 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:05.012149    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"
Jul 09 17:19:05.028518 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:05.028466    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr" podStartSLOduration=1.730557744 podStartE2EDuration="2.028450321s" totalImagesPullingTime="297.892577ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:19:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:19:05.026974207 +0000 UTC m=+1682.707390115" watchObservedRunningTime="2026-07-09 17:19:05.028450321 +0000 UTC m=+1682.708866228"
Jul 09 17:19:11.024994 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:11.024963    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"
Jul 09 17:19:46.003075 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:46.002982    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"]
Jul 09 17:19:46.003667 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:46.003230    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr" podUID="af26b888-dd04-4397-a1bd-d4b402d67e17" containerName="maas-api" containerID="cri-o://bc30625a3761de6b6e4d18b4c9416918ef74c3cb88e53a564cb04f123d78ffab" gracePeriod=30
Jul 09 17:19:46.019331 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:46.019291    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr" podUID="af26b888-dd04-4397-a1bd-d4b402d67e17" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.55:8443/health\": dial tcp 10.134.0.55:8443: connect: connection refused"
Jul 09 17:19:46.244513 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:46.244484    2568 generic.go:356] "Generic (PLEG): container finished" podID="af26b888-dd04-4397-a1bd-d4b402d67e17" containerID="bc30625a3761de6b6e4d18b4c9416918ef74c3cb88e53a564cb04f123d78ffab" exitCode=0
Jul 09 17:19:46.244639 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:46.244564    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr" event={"ID":"af26b888-dd04-4397-a1bd-d4b402d67e17","Type":"ContainerDied","Data":"bc30625a3761de6b6e4d18b4c9416918ef74c3cb88e53a564cb04f123d78ffab"}
Jul 09 17:19:46.244639 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:46.244631    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr" event={"ID":"af26b888-dd04-4397-a1bd-d4b402d67e17","Type":"ContainerDied","Data":"1f937eabd62b97cdbe66809ffc6a589afec557513b8a985bdeea40927e80be55"}
Jul 09 17:19:46.244730 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:46.244659    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f937eabd62b97cdbe66809ffc6a589afec557513b8a985bdeea40927e80be55"
Jul 09 17:19:46.258203 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:46.258152    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"
Jul 09 17:19:46.314532 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:46.314499    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qfj8\" (UniqueName: \"kubernetes.io/projected/af26b888-dd04-4397-a1bd-d4b402d67e17-kube-api-access-4qfj8\") pod \"af26b888-dd04-4397-a1bd-d4b402d67e17\" (UID: \"af26b888-dd04-4397-a1bd-d4b402d67e17\") "
Jul 09 17:19:46.314702 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:46.314594    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af26b888-dd04-4397-a1bd-d4b402d67e17-openshift-service-ca\") pod \"af26b888-dd04-4397-a1bd-d4b402d67e17\" (UID: \"af26b888-dd04-4397-a1bd-d4b402d67e17\") "
Jul 09 17:19:46.314702 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:46.314627    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af26b888-dd04-4397-a1bd-d4b402d67e17-maas-api-tls\") pod \"af26b888-dd04-4397-a1bd-d4b402d67e17\" (UID: \"af26b888-dd04-4397-a1bd-d4b402d67e17\") "
Jul 09 17:19:46.315006 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:46.314974    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af26b888-dd04-4397-a1bd-d4b402d67e17-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "af26b888-dd04-4397-a1bd-d4b402d67e17" (UID: "af26b888-dd04-4397-a1bd-d4b402d67e17"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:19:46.316683 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:46.316651    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af26b888-dd04-4397-a1bd-d4b402d67e17-kube-api-access-4qfj8" (OuterVolumeSpecName: "kube-api-access-4qfj8") pod "af26b888-dd04-4397-a1bd-d4b402d67e17" (UID: "af26b888-dd04-4397-a1bd-d4b402d67e17"). InnerVolumeSpecName "kube-api-access-4qfj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:19:46.316777 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:46.316712    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af26b888-dd04-4397-a1bd-d4b402d67e17-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "af26b888-dd04-4397-a1bd-d4b402d67e17" (UID: "af26b888-dd04-4397-a1bd-d4b402d67e17"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:19:46.415882 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:46.415844    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af26b888-dd04-4397-a1bd-d4b402d67e17-openshift-service-ca\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:19:46.415882 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:46.415875    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af26b888-dd04-4397-a1bd-d4b402d67e17-maas-api-tls\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:19:46.415882 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:46.415888    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qfj8\" (UniqueName: \"kubernetes.io/projected/af26b888-dd04-4397-a1bd-d4b402d67e17-kube-api-access-4qfj8\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:19:47.250624 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:47.250590    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"
Jul 09 17:19:47.272395 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:47.272347    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"]
Jul 09 17:19:47.276273 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:47.276233    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b9b28345-77d458f7bd-xbwgr"]
Jul 09 17:19:47.941739 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:19:47.941705    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af26b888-dd04-4397-a1bd-d4b402d67e17" path="/var/lib/kubelet/pods/af26b888-dd04-4397-a1bd-d4b402d67e17/volumes"
Jul 09 17:21:02.918671 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:02.918535    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ng88_54ed8699-4487-4246-9e22-3d15bd9908ca/ovn-acl-logging/0.log"
Jul 09 17:21:02.925583 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:02.920834    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ng88_54ed8699-4487-4246-9e22-3d15bd9908ca/ovn-acl-logging/0.log"
Jul 09 17:21:36.703624 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:36.703580    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"]
Jul 09 17:21:36.704346 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:36.704326    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af26b888-dd04-4397-a1bd-d4b402d67e17" containerName="maas-api"
Jul 09 17:21:36.704455 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:36.704351    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="af26b888-dd04-4397-a1bd-d4b402d67e17" containerName="maas-api"
Jul 09 17:21:36.704561 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:36.704543    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="af26b888-dd04-4397-a1bd-d4b402d67e17" containerName="maas-api"
Jul 09 17:21:36.708297 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:36.708271    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"
Jul 09 17:21:36.711023 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:36.710995    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-034dd4-serving-cert\""
Jul 09 17:21:36.717285 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:36.717193    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"]
Jul 09 17:21:36.827932 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:36.827888    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3acfc615-741a-4c68-a989-75b2cb9ee3e3-maas-api-tls\") pod \"maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj\" (UID: \"3acfc615-741a-4c68-a989-75b2cb9ee3e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"
Jul 09 17:21:36.828132 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:36.827960    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3acfc615-741a-4c68-a989-75b2cb9ee3e3-openshift-service-ca\") pod \"maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj\" (UID: \"3acfc615-741a-4c68-a989-75b2cb9ee3e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"
Jul 09 17:21:36.828132 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:36.828023    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j24tm\" (UniqueName: \"kubernetes.io/projected/3acfc615-741a-4c68-a989-75b2cb9ee3e3-kube-api-access-j24tm\") pod \"maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj\" (UID: \"3acfc615-741a-4c68-a989-75b2cb9ee3e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"
Jul 09 17:21:36.928828 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:36.928788    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3acfc615-741a-4c68-a989-75b2cb9ee3e3-openshift-service-ca\") pod \"maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj\" (UID: \"3acfc615-741a-4c68-a989-75b2cb9ee3e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"
Jul 09 17:21:36.929033 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:36.928839    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j24tm\" (UniqueName: \"kubernetes.io/projected/3acfc615-741a-4c68-a989-75b2cb9ee3e3-kube-api-access-j24tm\") pod \"maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj\" (UID: \"3acfc615-741a-4c68-a989-75b2cb9ee3e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"
Jul 09 17:21:36.929033 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:36.928906    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3acfc615-741a-4c68-a989-75b2cb9ee3e3-maas-api-tls\") pod \"maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj\" (UID: \"3acfc615-741a-4c68-a989-75b2cb9ee3e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"
Jul 09 17:21:36.929458 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:36.929437    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3acfc615-741a-4c68-a989-75b2cb9ee3e3-openshift-service-ca\") pod \"maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj\" (UID: \"3acfc615-741a-4c68-a989-75b2cb9ee3e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"
Jul 09 17:21:36.931338 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:36.931320    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3acfc615-741a-4c68-a989-75b2cb9ee3e3-maas-api-tls\") pod \"maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj\" (UID: \"3acfc615-741a-4c68-a989-75b2cb9ee3e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"
Jul 09 17:21:36.936996 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:36.936970    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j24tm\" (UniqueName: \"kubernetes.io/projected/3acfc615-741a-4c68-a989-75b2cb9ee3e3-kube-api-access-j24tm\") pod \"maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj\" (UID: \"3acfc615-741a-4c68-a989-75b2cb9ee3e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"
Jul 09 17:21:37.021955 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:37.021850    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"
Jul 09 17:21:37.179399 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:37.179375    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"]
Jul 09 17:21:37.181785 ip-10-0-140-229 kubenswrapper[2568]: W0709 17:21:37.181749    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3acfc615_741a_4c68_a989_75b2cb9ee3e3.slice/crio-dd2f1f07dc45a81b6eda1630948f4afde18512717dd67a9bd934ae014ae18a41 WatchSource:0}: Error finding container dd2f1f07dc45a81b6eda1630948f4afde18512717dd67a9bd934ae014ae18a41: Status 404 returned error can't find the container with id dd2f1f07dc45a81b6eda1630948f4afde18512717dd67a9bd934ae014ae18a41
Jul 09 17:21:37.183238 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:37.183219    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 17:21:37.867373 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:37.867317    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj" event={"ID":"3acfc615-741a-4c68-a989-75b2cb9ee3e3","Type":"ContainerStarted","Data":"710384e841d857d86ef7cb4ac40eade791cf6276d49830550d1acc59d070f941"}
Jul 09 17:21:37.867783 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:37.867409    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj" event={"ID":"3acfc615-741a-4c68-a989-75b2cb9ee3e3","Type":"ContainerStarted","Data":"dd2f1f07dc45a81b6eda1630948f4afde18512717dd67a9bd934ae014ae18a41"}
Jul 09 17:21:37.867783 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:37.867534    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"
Jul 09 17:21:37.886880 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:37.886823    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj" podStartSLOduration=1.2729993290000001 podStartE2EDuration="1.886804373s" totalImagesPullingTime="613.805044ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:21:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:21:37.885028652 +0000 UTC m=+1835.565444561" watchObservedRunningTime="2026-07-09 17:21:37.886804373 +0000 UTC m=+1835.567220280"
Jul 09 17:21:43.878965 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:43.878928    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"
Jul 09 17:21:44.722977 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:44.722929    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"]
Jul 09 17:21:44.726926 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:44.726895    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"
Jul 09 17:21:44.729614 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:44.729583    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-90e561-serving-cert\""
Jul 09 17:21:44.742988 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:44.742953    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"]
Jul 09 17:21:44.813841 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:44.813805    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1e6dd62-e9a0-45c2-a725-ea4ca7b67279-maas-api-tls\") pod \"maas-api-e2e-inf-b-90e561-594857b68d-k4fmr\" (UID: \"a1e6dd62-e9a0-45c2-a725-ea4ca7b67279\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"
Jul 09 17:21:44.814028 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:44.813850    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkfcs\" (UniqueName: \"kubernetes.io/projected/a1e6dd62-e9a0-45c2-a725-ea4ca7b67279-kube-api-access-zkfcs\") pod \"maas-api-e2e-inf-b-90e561-594857b68d-k4fmr\" (UID: \"a1e6dd62-e9a0-45c2-a725-ea4ca7b67279\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"
Jul 09 17:21:44.814028 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:44.814000    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1e6dd62-e9a0-45c2-a725-ea4ca7b67279-openshift-service-ca\") pod \"maas-api-e2e-inf-b-90e561-594857b68d-k4fmr\" (UID: \"a1e6dd62-e9a0-45c2-a725-ea4ca7b67279\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"
Jul 09 17:21:44.915139 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:44.915108    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1e6dd62-e9a0-45c2-a725-ea4ca7b67279-maas-api-tls\") pod \"maas-api-e2e-inf-b-90e561-594857b68d-k4fmr\" (UID: \"a1e6dd62-e9a0-45c2-a725-ea4ca7b67279\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"
Jul 09 17:21:44.915580 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:44.915146    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkfcs\" (UniqueName: \"kubernetes.io/projected/a1e6dd62-e9a0-45c2-a725-ea4ca7b67279-kube-api-access-zkfcs\") pod \"maas-api-e2e-inf-b-90e561-594857b68d-k4fmr\" (UID: \"a1e6dd62-e9a0-45c2-a725-ea4ca7b67279\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"
Jul 09 17:21:44.915580 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:44.915219    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1e6dd62-e9a0-45c2-a725-ea4ca7b67279-openshift-service-ca\") pod \"maas-api-e2e-inf-b-90e561-594857b68d-k4fmr\" (UID: \"a1e6dd62-e9a0-45c2-a725-ea4ca7b67279\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"
Jul 09 17:21:44.916060 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:44.916034    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1e6dd62-e9a0-45c2-a725-ea4ca7b67279-openshift-service-ca\") pod \"maas-api-e2e-inf-b-90e561-594857b68d-k4fmr\" (UID: \"a1e6dd62-e9a0-45c2-a725-ea4ca7b67279\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"
Jul 09 17:21:44.917706 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:44.917687    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1e6dd62-e9a0-45c2-a725-ea4ca7b67279-maas-api-tls\") pod \"maas-api-e2e-inf-b-90e561-594857b68d-k4fmr\" (UID: \"a1e6dd62-e9a0-45c2-a725-ea4ca7b67279\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"
Jul 09 17:21:44.925949 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:44.925919    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkfcs\" (UniqueName: \"kubernetes.io/projected/a1e6dd62-e9a0-45c2-a725-ea4ca7b67279-kube-api-access-zkfcs\") pod \"maas-api-e2e-inf-b-90e561-594857b68d-k4fmr\" (UID: \"a1e6dd62-e9a0-45c2-a725-ea4ca7b67279\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"
Jul 09 17:21:45.042315 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:45.042222    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"
Jul 09 17:21:45.191191 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:45.191155    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"]
Jul 09 17:21:45.194330 ip-10-0-140-229 kubenswrapper[2568]: W0709 17:21:45.194302    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e6dd62_e9a0_45c2_a725_ea4ca7b67279.slice/crio-07f9930a9030e09dd2fd520e07add83f33d1fd510af5d975894b7842f4f58b95 WatchSource:0}: Error finding container 07f9930a9030e09dd2fd520e07add83f33d1fd510af5d975894b7842f4f58b95: Status 404 returned error can't find the container with id 07f9930a9030e09dd2fd520e07add83f33d1fd510af5d975894b7842f4f58b95
Jul 09 17:21:45.912369 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:45.912257    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr" event={"ID":"a1e6dd62-e9a0-45c2-a725-ea4ca7b67279","Type":"ContainerStarted","Data":"bd55565dcc30d37a7100f1cbd8f6a39496131a588b184cc7fc23f57b41e5d438"}
Jul 09 17:21:45.912369 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:45.912313    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr" event={"ID":"a1e6dd62-e9a0-45c2-a725-ea4ca7b67279","Type":"ContainerStarted","Data":"07f9930a9030e09dd2fd520e07add83f33d1fd510af5d975894b7842f4f58b95"}
Jul 09 17:21:45.912604 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:45.912405    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"
Jul 09 17:21:45.930456 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:45.930398    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr" podStartSLOduration=1.552708421 podStartE2EDuration="1.930348909s" totalImagesPullingTime="377.640488ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:21:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:21:45.929714493 +0000 UTC m=+1843.610130405" watchObservedRunningTime="2026-07-09 17:21:45.930348909 +0000 UTC m=+1843.610764816"
Jul 09 17:21:51.924421 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:21:51.924352    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"
Jul 09 17:22:44.164248 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:44.164142    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"]
Jul 09 17:22:44.164774 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:44.164431    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj" podUID="3acfc615-741a-4c68-a989-75b2cb9ee3e3" containerName="maas-api" containerID="cri-o://710384e841d857d86ef7cb4ac40eade791cf6276d49830550d1acc59d070f941" gracePeriod=30
Jul 09 17:22:44.434063 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:44.434036    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"
Jul 09 17:22:44.509708 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:44.509672    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3acfc615-741a-4c68-a989-75b2cb9ee3e3-maas-api-tls\") pod \"3acfc615-741a-4c68-a989-75b2cb9ee3e3\" (UID: \"3acfc615-741a-4c68-a989-75b2cb9ee3e3\") "
Jul 09 17:22:44.509912 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:44.509782    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j24tm\" (UniqueName: \"kubernetes.io/projected/3acfc615-741a-4c68-a989-75b2cb9ee3e3-kube-api-access-j24tm\") pod \"3acfc615-741a-4c68-a989-75b2cb9ee3e3\" (UID: \"3acfc615-741a-4c68-a989-75b2cb9ee3e3\") "
Jul 09 17:22:44.509912 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:44.509811    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3acfc615-741a-4c68-a989-75b2cb9ee3e3-openshift-service-ca\") pod \"3acfc615-741a-4c68-a989-75b2cb9ee3e3\" (UID: \"3acfc615-741a-4c68-a989-75b2cb9ee3e3\") "
Jul 09 17:22:44.510224 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:44.510200    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3acfc615-741a-4c68-a989-75b2cb9ee3e3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3acfc615-741a-4c68-a989-75b2cb9ee3e3" (UID: "3acfc615-741a-4c68-a989-75b2cb9ee3e3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:22:44.511854 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:44.511831    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3acfc615-741a-4c68-a989-75b2cb9ee3e3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3acfc615-741a-4c68-a989-75b2cb9ee3e3" (UID: "3acfc615-741a-4c68-a989-75b2cb9ee3e3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:22:44.511911 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:44.511884    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3acfc615-741a-4c68-a989-75b2cb9ee3e3-kube-api-access-j24tm" (OuterVolumeSpecName: "kube-api-access-j24tm") pod "3acfc615-741a-4c68-a989-75b2cb9ee3e3" (UID: "3acfc615-741a-4c68-a989-75b2cb9ee3e3"). InnerVolumeSpecName "kube-api-access-j24tm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:22:44.611311 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:44.611275    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3acfc615-741a-4c68-a989-75b2cb9ee3e3-maas-api-tls\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:22:44.611311 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:44.611306    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j24tm\" (UniqueName: \"kubernetes.io/projected/3acfc615-741a-4c68-a989-75b2cb9ee3e3-kube-api-access-j24tm\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:22:44.611311 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:44.611316    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3acfc615-741a-4c68-a989-75b2cb9ee3e3-openshift-service-ca\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:22:45.245658 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:45.245617    2568 generic.go:356] "Generic (PLEG): container finished" podID="3acfc615-741a-4c68-a989-75b2cb9ee3e3" containerID="710384e841d857d86ef7cb4ac40eade791cf6276d49830550d1acc59d070f941" exitCode=0
Jul 09 17:22:45.246121 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:45.245679    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"
Jul 09 17:22:45.246121 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:45.245702    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj" event={"ID":"3acfc615-741a-4c68-a989-75b2cb9ee3e3","Type":"ContainerDied","Data":"710384e841d857d86ef7cb4ac40eade791cf6276d49830550d1acc59d070f941"}
Jul 09 17:22:45.246121 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:45.245812    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj" event={"ID":"3acfc615-741a-4c68-a989-75b2cb9ee3e3","Type":"ContainerDied","Data":"dd2f1f07dc45a81b6eda1630948f4afde18512717dd67a9bd934ae014ae18a41"}
Jul 09 17:22:45.246121 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:45.245844    2568 scope.go:117] "RemoveContainer" containerID="710384e841d857d86ef7cb4ac40eade791cf6276d49830550d1acc59d070f941"
Jul 09 17:22:45.255641 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:45.255620    2568 scope.go:117] "RemoveContainer" containerID="710384e841d857d86ef7cb4ac40eade791cf6276d49830550d1acc59d070f941"
Jul 09 17:22:45.255918 ip-10-0-140-229 kubenswrapper[2568]: E0709 17:22:45.255897    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"710384e841d857d86ef7cb4ac40eade791cf6276d49830550d1acc59d070f941\": container with ID starting with 710384e841d857d86ef7cb4ac40eade791cf6276d49830550d1acc59d070f941 not found: ID does not exist" containerID="710384e841d857d86ef7cb4ac40eade791cf6276d49830550d1acc59d070f941"
Jul 09 17:22:45.255989 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:45.255929    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"710384e841d857d86ef7cb4ac40eade791cf6276d49830550d1acc59d070f941"} err="failed to get container status \"710384e841d857d86ef7cb4ac40eade791cf6276d49830550d1acc59d070f941\": rpc error: code = NotFound desc = could not find container \"710384e841d857d86ef7cb4ac40eade791cf6276d49830550d1acc59d070f941\": container with ID starting with 710384e841d857d86ef7cb4ac40eade791cf6276d49830550d1acc59d070f941 not found: ID does not exist"
Jul 09 17:22:45.267187 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:45.267161    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"]
Jul 09 17:22:45.269561 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:45.269538    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-034dd4-5cfb78f468-hwcsj"]
Jul 09 17:22:45.940297 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:22:45.940260    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3acfc615-741a-4c68-a989-75b2cb9ee3e3" path="/var/lib/kubelet/pods/3acfc615-741a-4c68-a989-75b2cb9ee3e3/volumes"
Jul 09 17:23:27.150728 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.150692    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"]
Jul 09 17:23:27.151260 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.150899    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr" podUID="a1e6dd62-e9a0-45c2-a725-ea4ca7b67279" containerName="maas-api" containerID="cri-o://bd55565dcc30d37a7100f1cbd8f6a39496131a588b184cc7fc23f57b41e5d438" gracePeriod=30
Jul 09 17:23:27.404574 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.404511    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"
Jul 09 17:23:27.435881 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.435848    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1e6dd62-e9a0-45c2-a725-ea4ca7b67279-openshift-service-ca\") pod \"a1e6dd62-e9a0-45c2-a725-ea4ca7b67279\" (UID: \"a1e6dd62-e9a0-45c2-a725-ea4ca7b67279\") "
Jul 09 17:23:27.436062 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.435959    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1e6dd62-e9a0-45c2-a725-ea4ca7b67279-maas-api-tls\") pod \"a1e6dd62-e9a0-45c2-a725-ea4ca7b67279\" (UID: \"a1e6dd62-e9a0-45c2-a725-ea4ca7b67279\") "
Jul 09 17:23:27.436062 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.436014    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkfcs\" (UniqueName: \"kubernetes.io/projected/a1e6dd62-e9a0-45c2-a725-ea4ca7b67279-kube-api-access-zkfcs\") pod \"a1e6dd62-e9a0-45c2-a725-ea4ca7b67279\" (UID: \"a1e6dd62-e9a0-45c2-a725-ea4ca7b67279\") "
Jul 09 17:23:27.436368 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.436331    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1e6dd62-e9a0-45c2-a725-ea4ca7b67279-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a1e6dd62-e9a0-45c2-a725-ea4ca7b67279" (UID: "a1e6dd62-e9a0-45c2-a725-ea4ca7b67279"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:23:27.438074 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.438044    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1e6dd62-e9a0-45c2-a725-ea4ca7b67279-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a1e6dd62-e9a0-45c2-a725-ea4ca7b67279" (UID: "a1e6dd62-e9a0-45c2-a725-ea4ca7b67279"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:23:27.438203 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.438157    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1e6dd62-e9a0-45c2-a725-ea4ca7b67279-kube-api-access-zkfcs" (OuterVolumeSpecName: "kube-api-access-zkfcs") pod "a1e6dd62-e9a0-45c2-a725-ea4ca7b67279" (UID: "a1e6dd62-e9a0-45c2-a725-ea4ca7b67279"). InnerVolumeSpecName "kube-api-access-zkfcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:23:27.485598 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.485560    2568 generic.go:356] "Generic (PLEG): container finished" podID="a1e6dd62-e9a0-45c2-a725-ea4ca7b67279" containerID="bd55565dcc30d37a7100f1cbd8f6a39496131a588b184cc7fc23f57b41e5d438" exitCode=0
Jul 09 17:23:27.485598 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.485602    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"
Jul 09 17:23:27.485845 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.485657    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr" event={"ID":"a1e6dd62-e9a0-45c2-a725-ea4ca7b67279","Type":"ContainerDied","Data":"bd55565dcc30d37a7100f1cbd8f6a39496131a588b184cc7fc23f57b41e5d438"}
Jul 09 17:23:27.485845 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.485710    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr" event={"ID":"a1e6dd62-e9a0-45c2-a725-ea4ca7b67279","Type":"ContainerDied","Data":"07f9930a9030e09dd2fd520e07add83f33d1fd510af5d975894b7842f4f58b95"}
Jul 09 17:23:27.485845 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.485734    2568 scope.go:117] "RemoveContainer" containerID="bd55565dcc30d37a7100f1cbd8f6a39496131a588b184cc7fc23f57b41e5d438"
Jul 09 17:23:27.495348 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.495330    2568 scope.go:117] "RemoveContainer" containerID="bd55565dcc30d37a7100f1cbd8f6a39496131a588b184cc7fc23f57b41e5d438"
Jul 09 17:23:27.495639 ip-10-0-140-229 kubenswrapper[2568]: E0709 17:23:27.495619    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd55565dcc30d37a7100f1cbd8f6a39496131a588b184cc7fc23f57b41e5d438\": container with ID starting with bd55565dcc30d37a7100f1cbd8f6a39496131a588b184cc7fc23f57b41e5d438 not found: ID does not exist" containerID="bd55565dcc30d37a7100f1cbd8f6a39496131a588b184cc7fc23f57b41e5d438"
Jul 09 17:23:27.495718 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.495646    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd55565dcc30d37a7100f1cbd8f6a39496131a588b184cc7fc23f57b41e5d438"} err="failed to get container status \"bd55565dcc30d37a7100f1cbd8f6a39496131a588b184cc7fc23f57b41e5d438\": rpc error: code = NotFound desc = could not find container \"bd55565dcc30d37a7100f1cbd8f6a39496131a588b184cc7fc23f57b41e5d438\": container with ID starting with bd55565dcc30d37a7100f1cbd8f6a39496131a588b184cc7fc23f57b41e5d438 not found: ID does not exist"
Jul 09 17:23:27.507365 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.507324    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"]
Jul 09 17:23:27.511653 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.511626    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-90e561-594857b68d-k4fmr"]
Jul 09 17:23:27.536801 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.536763    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkfcs\" (UniqueName: \"kubernetes.io/projected/a1e6dd62-e9a0-45c2-a725-ea4ca7b67279-kube-api-access-zkfcs\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:23:27.536801 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.536792    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1e6dd62-e9a0-45c2-a725-ea4ca7b67279-openshift-service-ca\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:23:27.536801 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.536803    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1e6dd62-e9a0-45c2-a725-ea4ca7b67279-maas-api-tls\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:23:27.940444 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:27.940405    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1e6dd62-e9a0-45c2-a725-ea4ca7b67279" path="/var/lib/kubelet/pods/a1e6dd62-e9a0-45c2-a725-ea4ca7b67279/volumes"
Jul 09 17:23:34.114102 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.114071    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"]
Jul 09 17:23:34.114604 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.114564    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3acfc615-741a-4c68-a989-75b2cb9ee3e3" containerName="maas-api"
Jul 09 17:23:34.114604 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.114577    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3acfc615-741a-4c68-a989-75b2cb9ee3e3" containerName="maas-api"
Jul 09 17:23:34.114604 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.114592    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1e6dd62-e9a0-45c2-a725-ea4ca7b67279" containerName="maas-api"
Jul 09 17:23:34.114604 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.114602    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1e6dd62-e9a0-45c2-a725-ea4ca7b67279" containerName="maas-api"
Jul 09 17:23:34.114740 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.114687    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1e6dd62-e9a0-45c2-a725-ea4ca7b67279" containerName="maas-api"
Jul 09 17:23:34.114740 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.114698    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3acfc615-741a-4c68-a989-75b2cb9ee3e3" containerName="maas-api"
Jul 09 17:23:34.119318 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.119295    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.121777 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.121757    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-31f74d-openshift-default-dockercfg-tczdn\""
Jul 09 17:23:34.129986 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.129961    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"]
Jul 09 17:23:34.199697 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.199658    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-workload-socket\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.199697 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.199695    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-data\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.199955 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.199773    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-workload-certs\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.199955 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.199828    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istiod-ca-cert\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.199955 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.199844    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pztvk\" (UniqueName: \"kubernetes.io/projected/8b65f1cb-93dd-4dbe-9637-a2509d68b377-kube-api-access-pztvk\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.199955 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.199880    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-credential-socket\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.199955 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.199908    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-envoy\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.199955 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.199931    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-podinfo\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.199955 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.199956    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-token\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.300748 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.300709    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istiod-ca-cert\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.300748 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.300748    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pztvk\" (UniqueName: \"kubernetes.io/projected/8b65f1cb-93dd-4dbe-9637-a2509d68b377-kube-api-access-pztvk\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.301003 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.300784    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-credential-socket\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.301003 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.300807    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-envoy\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.301003 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.300829    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-podinfo\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.301003 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.300860    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-token\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.301003 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.300923    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-workload-socket\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.301003 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.300957    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-data\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.301410 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.301035    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-workload-certs\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.301410 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.301199    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-credential-socket\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.301531 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.301419    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-workload-socket\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.301531 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.301453    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-data\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.301531 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.301510    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istiod-ca-cert\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.301531 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.301528    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-workload-certs\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.303232 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.303206    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-envoy\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.303439 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.303424    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-podinfo\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.308718 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.308695    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-token\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.308812 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.308768    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pztvk\" (UniqueName: \"kubernetes.io/projected/8b65f1cb-93dd-4dbe-9637-a2509d68b377-kube-api-access-pztvk\") pod \"e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") " pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.432005 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.431923    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:34.572038 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.572015    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"]
Jul 09 17:23:34.574423 ip-10-0-140-229 kubenswrapper[2568]: W0709 17:23:34.574392    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b65f1cb_93dd_4dbe_9637_a2509d68b377.slice/crio-ee312f0053eb987ff17cd627235272979132bfb565fdb6a2da3a17e094be67f8 WatchSource:0}: Error finding container ee312f0053eb987ff17cd627235272979132bfb565fdb6a2da3a17e094be67f8: Status 404 returned error can't find the container with id ee312f0053eb987ff17cd627235272979132bfb565fdb6a2da3a17e094be67f8
Jul 09 17:23:34.576516 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.576484    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 17:23:34.576596 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.576549    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 17:23:34.576596 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:34.576578    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 17:23:35.532494 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:35.532461    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg" event={"ID":"8b65f1cb-93dd-4dbe-9637-a2509d68b377","Type":"ContainerStarted","Data":"36995c985d57f8020d7f0417e77cb6a0a19f8058082bddc8eb5b74bbfdc66a62"}
Jul 09 17:23:35.532879 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:35.532509    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg" event={"ID":"8b65f1cb-93dd-4dbe-9637-a2509d68b377","Type":"ContainerStarted","Data":"ee312f0053eb987ff17cd627235272979132bfb565fdb6a2da3a17e094be67f8"}
Jul 09 17:23:35.555973 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:35.555921    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg" podStartSLOduration=1.555904923 podStartE2EDuration="1.555904923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:23:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:23:35.55297773 +0000 UTC m=+1953.233393644" watchObservedRunningTime="2026-07-09 17:23:35.555904923 +0000 UTC m=+1953.236320907"
Jul 09 17:23:36.432274 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:36.432235    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:36.437287 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:36.437257    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:36.537801 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:36.537765    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:36.538990 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:36.538967    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:51.539674 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:51.539637    2568 patch_prober.go:28] interesting pod/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 09 17:23:51.540161 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:51.539697    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg" podUID="8b65f1cb-93dd-4dbe-9637-a2509d68b377" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 09 17:23:51.625672 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:51.625636    2568 generic.go:356] "Generic (PLEG): container finished" podID="8b65f1cb-93dd-4dbe-9637-a2509d68b377" containerID="36995c985d57f8020d7f0417e77cb6a0a19f8058082bddc8eb5b74bbfdc66a62" exitCode=0
Jul 09 17:23:51.625834 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:51.625708    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg" event={"ID":"8b65f1cb-93dd-4dbe-9637-a2509d68b377","Type":"ContainerDied","Data":"36995c985d57f8020d7f0417e77cb6a0a19f8058082bddc8eb5b74bbfdc66a62"}
Jul 09 17:23:51.626180 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:51.626166    2568 scope.go:117] "RemoveContainer" containerID="36995c985d57f8020d7f0417e77cb6a0a19f8058082bddc8eb5b74bbfdc66a62"
Jul 09 17:23:51.627210 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:51.627180    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 17:23:51.627281 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:51.627268    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 17:23:51.627317 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:51.627306    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 17:23:52.634145 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:52.634110    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg" event={"ID":"8b65f1cb-93dd-4dbe-9637-a2509d68b377","Type":"ContainerStarted","Data":"920d83f9f3ffb0bb836481ff6355e0a7c4d62b4558554cbc2555c423542173cd"}
Jul 09 17:23:53.432444 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:53.432407    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:53.432660 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:53.432625    2568 patch_prober.go:28] interesting pod/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 09 17:23:53.432748 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:53.432680    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg" podUID="8b65f1cb-93dd-4dbe-9637-a2509d68b377" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 09 17:23:54.433295 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:54.433219    2568 patch_prober.go:28] interesting pod/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 09 17:23:54.433295 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:54.433282    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg" podUID="8b65f1cb-93dd-4dbe-9637-a2509d68b377" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 09 17:23:55.432681 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:55.432640    2568 patch_prober.go:28] interesting pod/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 09 17:23:55.432889 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:55.432699    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg" podUID="8b65f1cb-93dd-4dbe-9637-a2509d68b377" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 09 17:23:56.433250 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:56.433205    2568 patch_prober.go:28] interesting pod/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 09 17:23:56.433675 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:56.433265    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg" podUID="8b65f1cb-93dd-4dbe-9637-a2509d68b377" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 09 17:23:57.437200 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:57.437165    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:57.437695 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:57.437618    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:23:57.438426 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:23:57.438406    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:24:04.240493 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:04.240463    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"]
Jul 09 17:24:04.240948 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:04.240683    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg" podUID="8b65f1cb-93dd-4dbe-9637-a2509d68b377" containerName="istio-proxy" containerID="cri-o://920d83f9f3ffb0bb836481ff6355e0a7c4d62b4558554cbc2555c423542173cd" gracePeriod=30
Jul 09 17:24:09.501072 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.501041    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:24:09.557165 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.557088    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-token\") pod \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") "
Jul 09 17:24:09.557165 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.557131    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-envoy\") pod \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") "
Jul 09 17:24:09.557165 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.557160    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-podinfo\") pod \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") "
Jul 09 17:24:09.557483 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.557214    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-data\") pod \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") "
Jul 09 17:24:09.557483 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.557244    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-workload-socket\") pod \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") "
Jul 09 17:24:09.557483 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.557286    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-credential-socket\") pod \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") "
Jul 09 17:24:09.557483 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.557319    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istiod-ca-cert\") pod \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") "
Jul 09 17:24:09.557483 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.557393    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-workload-certs\") pod \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") "
Jul 09 17:24:09.557483 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.557467    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pztvk\" (UniqueName: \"kubernetes.io/projected/8b65f1cb-93dd-4dbe-9637-a2509d68b377-kube-api-access-pztvk\") pod \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\" (UID: \"8b65f1cb-93dd-4dbe-9637-a2509d68b377\") "
Jul 09 17:24:09.557806 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.557568    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8b65f1cb-93dd-4dbe-9637-a2509d68b377" (UID: "8b65f1cb-93dd-4dbe-9637-a2509d68b377"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:24:09.557806 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.557792    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8b65f1cb-93dd-4dbe-9637-a2509d68b377" (UID: "8b65f1cb-93dd-4dbe-9637-a2509d68b377"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:24:09.557925 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.557870    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8b65f1cb-93dd-4dbe-9637-a2509d68b377" (UID: "8b65f1cb-93dd-4dbe-9637-a2509d68b377"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:24:09.557925 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.557906    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-workload-certs\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:24:09.558031 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.557922    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-credential-socket\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:24:09.558031 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.558012    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8b65f1cb-93dd-4dbe-9637-a2509d68b377" (UID: "8b65f1cb-93dd-4dbe-9637-a2509d68b377"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:24:09.558208 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.558183    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-data" (OuterVolumeSpecName: "istio-data") pod "8b65f1cb-93dd-4dbe-9637-a2509d68b377" (UID: "8b65f1cb-93dd-4dbe-9637-a2509d68b377"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:24:09.559570 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.559548    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8b65f1cb-93dd-4dbe-9637-a2509d68b377" (UID: "8b65f1cb-93dd-4dbe-9637-a2509d68b377"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 17:24:09.559755 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.559733    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8b65f1cb-93dd-4dbe-9637-a2509d68b377" (UID: "8b65f1cb-93dd-4dbe-9637-a2509d68b377"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:24:09.559755 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.559748    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-token" (OuterVolumeSpecName: "istio-token") pod "8b65f1cb-93dd-4dbe-9637-a2509d68b377" (UID: "8b65f1cb-93dd-4dbe-9637-a2509d68b377"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:24:09.559951 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.559931    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b65f1cb-93dd-4dbe-9637-a2509d68b377-kube-api-access-pztvk" (OuterVolumeSpecName: "kube-api-access-pztvk") pod "8b65f1cb-93dd-4dbe-9637-a2509d68b377" (UID: "8b65f1cb-93dd-4dbe-9637-a2509d68b377"). InnerVolumeSpecName "kube-api-access-pztvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:24:09.659318 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.659286    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-data\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:24:09.659318 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.659312    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-workload-socket\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:24:09.659318 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.659322    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istiod-ca-cert\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:24:09.659566 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.659333    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pztvk\" (UniqueName: \"kubernetes.io/projected/8b65f1cb-93dd-4dbe-9637-a2509d68b377-kube-api-access-pztvk\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:24:09.659566 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.659341    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-token\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:24:09.659566 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.659349    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-envoy\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:24:09.659566 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.659379    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b65f1cb-93dd-4dbe-9637-a2509d68b377-istio-podinfo\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:24:09.745119 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.745088    2568 generic.go:356] "Generic (PLEG): container finished" podID="8b65f1cb-93dd-4dbe-9637-a2509d68b377" containerID="920d83f9f3ffb0bb836481ff6355e0a7c4d62b4558554cbc2555c423542173cd" exitCode=0
Jul 09 17:24:09.745288 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.745138    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"
Jul 09 17:24:09.745288 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.745170    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg" event={"ID":"8b65f1cb-93dd-4dbe-9637-a2509d68b377","Type":"ContainerDied","Data":"920d83f9f3ffb0bb836481ff6355e0a7c4d62b4558554cbc2555c423542173cd"}
Jul 09 17:24:09.745288 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.745226    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg" event={"ID":"8b65f1cb-93dd-4dbe-9637-a2509d68b377","Type":"ContainerDied","Data":"ee312f0053eb987ff17cd627235272979132bfb565fdb6a2da3a17e094be67f8"}
Jul 09 17:24:09.745288 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.745249    2568 scope.go:117] "RemoveContainer" containerID="920d83f9f3ffb0bb836481ff6355e0a7c4d62b4558554cbc2555c423542173cd"
Jul 09 17:24:09.755691 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.755678    2568 scope.go:117] "RemoveContainer" containerID="36995c985d57f8020d7f0417e77cb6a0a19f8058082bddc8eb5b74bbfdc66a62"
Jul 09 17:24:09.766898 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.766871    2568 scope.go:117] "RemoveContainer" containerID="920d83f9f3ffb0bb836481ff6355e0a7c4d62b4558554cbc2555c423542173cd"
Jul 09 17:24:09.767540 ip-10-0-140-229 kubenswrapper[2568]: E0709 17:24:09.767517    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"920d83f9f3ffb0bb836481ff6355e0a7c4d62b4558554cbc2555c423542173cd\": container with ID starting with 920d83f9f3ffb0bb836481ff6355e0a7c4d62b4558554cbc2555c423542173cd not found: ID does not exist" containerID="920d83f9f3ffb0bb836481ff6355e0a7c4d62b4558554cbc2555c423542173cd"
Jul 09 17:24:09.767679 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.767548    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"920d83f9f3ffb0bb836481ff6355e0a7c4d62b4558554cbc2555c423542173cd"} err="failed to get container status \"920d83f9f3ffb0bb836481ff6355e0a7c4d62b4558554cbc2555c423542173cd\": rpc error: code = NotFound desc = could not find container \"920d83f9f3ffb0bb836481ff6355e0a7c4d62b4558554cbc2555c423542173cd\": container with ID starting with 920d83f9f3ffb0bb836481ff6355e0a7c4d62b4558554cbc2555c423542173cd not found: ID does not exist"
Jul 09 17:24:09.767679 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.767564    2568 scope.go:117] "RemoveContainer" containerID="36995c985d57f8020d7f0417e77cb6a0a19f8058082bddc8eb5b74bbfdc66a62"
Jul 09 17:24:09.767852 ip-10-0-140-229 kubenswrapper[2568]: E0709 17:24:09.767836    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36995c985d57f8020d7f0417e77cb6a0a19f8058082bddc8eb5b74bbfdc66a62\": container with ID starting with 36995c985d57f8020d7f0417e77cb6a0a19f8058082bddc8eb5b74bbfdc66a62 not found: ID does not exist" containerID="36995c985d57f8020d7f0417e77cb6a0a19f8058082bddc8eb5b74bbfdc66a62"
Jul 09 17:24:09.767895 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.767857    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36995c985d57f8020d7f0417e77cb6a0a19f8058082bddc8eb5b74bbfdc66a62"} err="failed to get container status \"36995c985d57f8020d7f0417e77cb6a0a19f8058082bddc8eb5b74bbfdc66a62\": rpc error: code = NotFound desc = could not find container \"36995c985d57f8020d7f0417e77cb6a0a19f8058082bddc8eb5b74bbfdc66a62\": container with ID starting with 36995c985d57f8020d7f0417e77cb6a0a19f8058082bddc8eb5b74bbfdc66a62 not found: ID does not exist"
Jul 09 17:24:09.769634 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.769604    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"]
Jul 09 17:24:09.772564 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.772546    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-31f74d-openshift-default-67bcb68b89-nj5dg"]
Jul 09 17:24:09.939555 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:09.939528    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b65f1cb-93dd-4dbe-9637-a2509d68b377" path="/var/lib/kubelet/pods/8b65f1cb-93dd-4dbe-9637-a2509d68b377/volumes"
Jul 09 17:24:12.227572 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.227525    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"]
Jul 09 17:24:12.228012 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.227998    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b65f1cb-93dd-4dbe-9637-a2509d68b377" containerName="istio-proxy"
Jul 09 17:24:12.228012 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.228013    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b65f1cb-93dd-4dbe-9637-a2509d68b377" containerName="istio-proxy"
Jul 09 17:24:12.228102 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.228032    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b65f1cb-93dd-4dbe-9637-a2509d68b377" containerName="istio-proxy"
Jul 09 17:24:12.228102 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.228037    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b65f1cb-93dd-4dbe-9637-a2509d68b377" containerName="istio-proxy"
Jul 09 17:24:12.228102 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.228098    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b65f1cb-93dd-4dbe-9637-a2509d68b377" containerName="istio-proxy"
Jul 09 17:24:12.228215 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.228110    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b65f1cb-93dd-4dbe-9637-a2509d68b377" containerName="istio-proxy"
Jul 09 17:24:12.231337 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.231320    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.235896 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.235874    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-553a9f-openshift-default-dockercfg-j4d55\""
Jul 09 17:24:12.277299 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.277265    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"]
Jul 09 17:24:12.283507 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.283477    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-credential-socket\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.283507 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.283510    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-workload-socket\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.283732 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.283536    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-envoy\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.283732 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.283600    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istiod-ca-cert\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.283732 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.283631    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-podinfo\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.283732 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.283651    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-token\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.283732 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.283674    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-data\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.284022 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.283729    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpqfp\" (UniqueName: \"kubernetes.io/projected/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-kube-api-access-wpqfp\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.284022 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.283787    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-workload-certs\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.384946 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.384914    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-credential-socket\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.384946 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.384950    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-workload-socket\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.385152 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.384973    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-envoy\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.385152 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.385094    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istiod-ca-cert\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.385152 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.385142    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-podinfo\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.385293 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.385257    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-token\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.385350 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.385313    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-data\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.385429 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.385373    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpqfp\" (UniqueName: \"kubernetes.io/projected/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-kube-api-access-wpqfp\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.385429 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.385399    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-credential-socket\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.385429 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.385423    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-workload-certs\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.385587 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.385549    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-workload-socket\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.385864 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.385842    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-workload-certs\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.385950 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.385869    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istiod-ca-cert\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.385950 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.385869    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-data\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.387448 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.387428    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-envoy\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.387568 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.387551    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-podinfo\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.394062 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.394040    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpqfp\" (UniqueName: \"kubernetes.io/projected/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-kube-api-access-wpqfp\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.394235 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.394215    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-token\") pod \"e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") " pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.542287 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.542191    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:12.683426 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.683403    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"]
Jul 09 17:24:12.686010 ip-10-0-140-229 kubenswrapper[2568]: W0709 17:24:12.685975    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod530d25fa_62bb_4218_b01a_b5aa0bf1c6df.slice/crio-4436576eb50b28c0fe0870f8097d9188e43bcd4b7cff41c93c446fcfd912600e WatchSource:0}: Error finding container 4436576eb50b28c0fe0870f8097d9188e43bcd4b7cff41c93c446fcfd912600e: Status 404 returned error can't find the container with id 4436576eb50b28c0fe0870f8097d9188e43bcd4b7cff41c93c446fcfd912600e
Jul 09 17:24:12.688387 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.688318    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 17:24:12.688479 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.688424    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 17:24:12.688525 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.688471    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 17:24:12.763451 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.763423    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz" event={"ID":"530d25fa-62bb-4218-b01a-b5aa0bf1c6df","Type":"ContainerStarted","Data":"2c6afa7ad3c67a4ba270fabc41d2d40d9bd7e87028e6ec5177ca33aa4ce191bb"}
Jul 09 17:24:12.763555 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.763479    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz" event={"ID":"530d25fa-62bb-4218-b01a-b5aa0bf1c6df","Type":"ContainerStarted","Data":"4436576eb50b28c0fe0870f8097d9188e43bcd4b7cff41c93c446fcfd912600e"}
Jul 09 17:24:12.785102 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:12.785055    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz" podStartSLOduration=0.7850393 podStartE2EDuration="785.0393ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:24:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:24:12.782435073 +0000 UTC m=+1990.462850982" watchObservedRunningTime="2026-07-09 17:24:12.7850393 +0000 UTC m=+1990.465455207"
Jul 09 17:24:13.542421 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:13.542389    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:13.548051 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:13.548028    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:13.769051 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:13.769022    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:13.770005 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:13.769986    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:29.810525 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:29.810484    2568 patch_prober.go:28] interesting pod/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 09 17:24:29.810970 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:29.810549    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz" podUID="530d25fa-62bb-4218-b01a-b5aa0bf1c6df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 09 17:24:30.862648 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:30.862611    2568 generic.go:356] "Generic (PLEG): container finished" podID="530d25fa-62bb-4218-b01a-b5aa0bf1c6df" containerID="2c6afa7ad3c67a4ba270fabc41d2d40d9bd7e87028e6ec5177ca33aa4ce191bb" exitCode=0
Jul 09 17:24:30.863078 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:30.862686    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz" event={"ID":"530d25fa-62bb-4218-b01a-b5aa0bf1c6df","Type":"ContainerDied","Data":"2c6afa7ad3c67a4ba270fabc41d2d40d9bd7e87028e6ec5177ca33aa4ce191bb"}
Jul 09 17:24:30.863127 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:30.863112    2568 scope.go:117] "RemoveContainer" containerID="2c6afa7ad3c67a4ba270fabc41d2d40d9bd7e87028e6ec5177ca33aa4ce191bb"
Jul 09 17:24:30.864136 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:30.864104    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 17:24:30.864243 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:30.864206    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 17:24:30.864312 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:30.864268    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 17:24:31.872572 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:31.872531    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz" event={"ID":"530d25fa-62bb-4218-b01a-b5aa0bf1c6df","Type":"ContainerStarted","Data":"99f17fcff3401352b00270c5cc2864a90a4ef5f38f0af4c55b3ac9d1886c8ced"}
Jul 09 17:24:32.543439 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:32.542952    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:32.543439 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:32.543082    2568 patch_prober.go:28] interesting pod/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 09 17:24:32.543439 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:32.543140    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz" podUID="530d25fa-62bb-4218-b01a-b5aa0bf1c6df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 09 17:24:33.543013 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:33.542975    2568 patch_prober.go:28] interesting pod/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 09 17:24:33.543982 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:33.543577    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz" podUID="530d25fa-62bb-4218-b01a-b5aa0bf1c6df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 09 17:24:34.542855 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:34.542809    2568 patch_prober.go:28] interesting pod/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 09 17:24:34.543349 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:34.542897    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz" podUID="530d25fa-62bb-4218-b01a-b5aa0bf1c6df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 09 17:24:35.543248 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:35.543211    2568 patch_prober.go:28] interesting pod/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 09 17:24:35.543558 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:35.543525    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz" podUID="530d25fa-62bb-4218-b01a-b5aa0bf1c6df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 09 17:24:36.546019 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:36.545989    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:36.546484 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:36.546392    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:24:36.547335 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:24:36.547315    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:26:02.962231 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:26:02.962206    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ng88_54ed8699-4487-4246-9e22-3d15bd9908ca/ovn-acl-logging/0.log"
Jul 09 17:26:02.967147 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:26:02.967126    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ng88_54ed8699-4487-4246-9e22-3d15bd9908ca/ovn-acl-logging/0.log"
Jul 09 17:26:03.049520 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:26:03.049490    2568 scope.go:117] "RemoveContainer" containerID="bc30625a3761de6b6e4d18b4c9416918ef74c3cb88e53a564cb04f123d78ffab"
Jul 09 17:30:00.138731 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.138699    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt"]
Jul 09 17:30:00.142726 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.142705    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt"
Jul 09 17:30:00.146614 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.146535    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726970-xt7bc"]
Jul 09 17:30:00.161434 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.160168    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm"]
Jul 09 17:30:00.161434 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.160589    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-xt7bc"
Jul 09 17:30:00.166789 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.166075    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt"]
Jul 09 17:30:00.166789 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.166119    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726970-xt7bc"]
Jul 09 17:30:00.166789 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.166212    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm"
Jul 09 17:30:00.167479 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.167458    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm"]
Jul 09 17:30:00.233000 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.232958    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq7f9\" (UniqueName: \"kubernetes.io/projected/267e8bf0-e8ea-4ba6-a321-dfba6924b235-kube-api-access-mq7f9\") pod \"maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm\" (UID: \"267e8bf0-e8ea-4ba6-a321-dfba6924b235\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm"
Jul 09 17:30:00.233184 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.233022    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b8th\" (UniqueName: \"kubernetes.io/projected/e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e-kube-api-access-6b8th\") pod \"maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt\" (UID: \"e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt"
Jul 09 17:30:00.233184 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.233074    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vxd6\" (UniqueName: \"kubernetes.io/projected/d07516ee-1385-472a-aa34-a492dc7d2890-kube-api-access-4vxd6\") pod \"maas-api-key-cleanup-29726970-xt7bc\" (UID: \"d07516ee-1385-472a-aa34-a492dc7d2890\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-xt7bc"
Jul 09 17:30:00.334716 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.334675    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq7f9\" (UniqueName: \"kubernetes.io/projected/267e8bf0-e8ea-4ba6-a321-dfba6924b235-kube-api-access-mq7f9\") pod \"maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm\" (UID: \"267e8bf0-e8ea-4ba6-a321-dfba6924b235\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm"
Jul 09 17:30:00.334913 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.334737    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b8th\" (UniqueName: \"kubernetes.io/projected/e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e-kube-api-access-6b8th\") pod \"maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt\" (UID: \"e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt"
Jul 09 17:30:00.334913 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.334797    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vxd6\" (UniqueName: \"kubernetes.io/projected/d07516ee-1385-472a-aa34-a492dc7d2890-kube-api-access-4vxd6\") pod \"maas-api-key-cleanup-29726970-xt7bc\" (UID: \"d07516ee-1385-472a-aa34-a492dc7d2890\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-xt7bc"
Jul 09 17:30:00.342866 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.342827    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b8th\" (UniqueName: \"kubernetes.io/projected/e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e-kube-api-access-6b8th\") pod \"maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt\" (UID: \"e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt"
Jul 09 17:30:00.342866 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.342827    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vxd6\" (UniqueName: \"kubernetes.io/projected/d07516ee-1385-472a-aa34-a492dc7d2890-kube-api-access-4vxd6\") pod \"maas-api-key-cleanup-29726970-xt7bc\" (UID: \"d07516ee-1385-472a-aa34-a492dc7d2890\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-xt7bc"
Jul 09 17:30:00.343038 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.342927    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq7f9\" (UniqueName: \"kubernetes.io/projected/267e8bf0-e8ea-4ba6-a321-dfba6924b235-kube-api-access-mq7f9\") pod \"maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm\" (UID: \"267e8bf0-e8ea-4ba6-a321-dfba6924b235\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm"
Jul 09 17:30:00.457712 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.457594    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt"
Jul 09 17:30:00.478261 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.478235    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-xt7bc"
Jul 09 17:30:00.485514 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.485483    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm"
Jul 09 17:30:00.637049 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.636856    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt"]
Jul 09 17:30:00.641021 ip-10-0-140-229 kubenswrapper[2568]: W0709 17:30:00.640991    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1e1d2f5_270a_4e5e_8b5d_e9e5830bf78e.slice/crio-135a8aae18ff8d622b5368ebb1f247c6f81523c05abb981bd3864ff73d4cc7b8 WatchSource:0}: Error finding container 135a8aae18ff8d622b5368ebb1f247c6f81523c05abb981bd3864ff73d4cc7b8: Status 404 returned error can't find the container with id 135a8aae18ff8d622b5368ebb1f247c6f81523c05abb981bd3864ff73d4cc7b8
Jul 09 17:30:00.670006 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.669971    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt" event={"ID":"e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e","Type":"ContainerStarted","Data":"135a8aae18ff8d622b5368ebb1f247c6f81523c05abb981bd3864ff73d4cc7b8"}
Jul 09 17:30:00.877385 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.877322    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726970-xt7bc"]
Jul 09 17:30:00.879577 ip-10-0-140-229 kubenswrapper[2568]: W0709 17:30:00.879542    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd07516ee_1385_472a_aa34_a492dc7d2890.slice/crio-230a09b3c7819b440c670d46106110ae8422bb86988033f109b90b9160a1b88b WatchSource:0}: Error finding container 230a09b3c7819b440c670d46106110ae8422bb86988033f109b90b9160a1b88b: Status 404 returned error can't find the container with id 230a09b3c7819b440c670d46106110ae8422bb86988033f109b90b9160a1b88b
Jul 09 17:30:00.879813 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:00.879792    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm"]
Jul 09 17:30:00.880576 ip-10-0-140-229 kubenswrapper[2568]: W0709 17:30:00.880552    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod267e8bf0_e8ea_4ba6_a321_dfba6924b235.slice/crio-14d05532f3ff49f559c83bcdcd5ac07ccdb5e7c9c4276cf6d2ee82d2bc6fb9c1 WatchSource:0}: Error finding container 14d05532f3ff49f559c83bcdcd5ac07ccdb5e7c9c4276cf6d2ee82d2bc6fb9c1: Status 404 returned error can't find the container with id 14d05532f3ff49f559c83bcdcd5ac07ccdb5e7c9c4276cf6d2ee82d2bc6fb9c1
Jul 09 17:30:01.677333 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:01.677288    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-xt7bc" event={"ID":"d07516ee-1385-472a-aa34-a492dc7d2890","Type":"ContainerStarted","Data":"155aba6235cb9058909f7f98076d11efe43b7d7d677e249ae517de4fd77c550e"}
Jul 09 17:30:01.677792 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:01.677347    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-xt7bc" event={"ID":"d07516ee-1385-472a-aa34-a492dc7d2890","Type":"ContainerStarted","Data":"230a09b3c7819b440c670d46106110ae8422bb86988033f109b90b9160a1b88b"}
Jul 09 17:30:01.678833 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:01.678809    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm" event={"ID":"267e8bf0-e8ea-4ba6-a321-dfba6924b235","Type":"ContainerStarted","Data":"977ba9de29123b01fabee9d77243ddc6b625af9c8bd9e15f77265f21fbd2f451"}
Jul 09 17:30:01.678939 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:01.678859    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm" event={"ID":"267e8bf0-e8ea-4ba6-a321-dfba6924b235","Type":"ContainerStarted","Data":"14d05532f3ff49f559c83bcdcd5ac07ccdb5e7c9c4276cf6d2ee82d2bc6fb9c1"}
Jul 09 17:30:01.680294 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:01.680270    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt" event={"ID":"e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e","Type":"ContainerStarted","Data":"6ecaa268a77ed5218836496cb2aca99f5264f0cbf148ec625bf8ee6eb57c5c30"}
Jul 09 17:30:01.693872 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:01.693815    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-xt7bc" podStartSLOduration=1.693799356 podStartE2EDuration="1.693799356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:30:01.692008194 +0000 UTC m=+2339.372424104" watchObservedRunningTime="2026-07-09 17:30:01.693799356 +0000 UTC m=+2339.374215267"
Jul 09 17:30:01.706720 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:01.706642    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm" podStartSLOduration=1.7066254170000001 podStartE2EDuration="1.706625417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:30:01.705960532 +0000 UTC m=+2339.386376438" watchObservedRunningTime="2026-07-09 17:30:01.706625417 +0000 UTC m=+2339.387041326"
Jul 09 17:30:01.722269 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:01.722218    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt" podStartSLOduration=1.722201267 podStartE2EDuration="1.722201267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:30:01.720459568 +0000 UTC m=+2339.400875476" watchObservedRunningTime="2026-07-09 17:30:01.722201267 +0000 UTC m=+2339.402617175"
Jul 09 17:30:32.025981 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:32.025943    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm"]
Jul 09 17:30:32.026532 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:32.026178    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm" podUID="267e8bf0-e8ea-4ba6-a321-dfba6924b235" containerName="cleanup" containerID="cri-o://977ba9de29123b01fabee9d77243ddc6b625af9c8bd9e15f77265f21fbd2f451" gracePeriod=30
Jul 09 17:30:38.181293 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:38.181255    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"]
Jul 09 17:30:38.181796 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:38.181540    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz" podUID="530d25fa-62bb-4218-b01a-b5aa0bf1c6df" containerName="istio-proxy" containerID="cri-o://99f17fcff3401352b00270c5cc2864a90a4ef5f38f0af4c55b3ac9d1886c8ced" gracePeriod=30
Jul 09 17:30:39.297142 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:39.297097    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt"]
Jul 09 17:30:39.297549 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:39.297348    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt" podUID="e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e" containerName="cleanup" containerID="cri-o://6ecaa268a77ed5218836496cb2aca99f5264f0cbf148ec625bf8ee6eb57c5c30" gracePeriod=30
Jul 09 17:30:43.452346 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.452273    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:30:43.470540 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.470506    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-data\") pod \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") "
Jul 09 17:30:43.470730 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.470600    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-workload-certs\") pod \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") "
Jul 09 17:30:43.470730 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.470626    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-podinfo\") pod \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") "
Jul 09 17:30:43.470730 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.470671    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpqfp\" (UniqueName: \"kubernetes.io/projected/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-kube-api-access-wpqfp\") pod \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") "
Jul 09 17:30:43.470730 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.470702    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-token\") pod \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") "
Jul 09 17:30:43.470730 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.470726    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-envoy\") pod \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") "
Jul 09 17:30:43.470979 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.470773    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istiod-ca-cert\") pod \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") "
Jul 09 17:30:43.470979 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.470834    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-credential-socket\") pod \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") "
Jul 09 17:30:43.470979 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.470907    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-workload-socket\") pod \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\" (UID: \"530d25fa-62bb-4218-b01a-b5aa0bf1c6df\") "
Jul 09 17:30:43.470979 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.470906    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "530d25fa-62bb-4218-b01a-b5aa0bf1c6df" (UID: "530d25fa-62bb-4218-b01a-b5aa0bf1c6df"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:30:43.471214 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.471190    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "530d25fa-62bb-4218-b01a-b5aa0bf1c6df" (UID: "530d25fa-62bb-4218-b01a-b5aa0bf1c6df"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:30:43.471379 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.471220    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "530d25fa-62bb-4218-b01a-b5aa0bf1c6df" (UID: "530d25fa-62bb-4218-b01a-b5aa0bf1c6df"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:30:43.471379 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.471304    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-credential-socket\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:30:43.471524 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.471378    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-workload-certs\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:30:43.471524 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.471413    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-data" (OuterVolumeSpecName: "istio-data") pod "530d25fa-62bb-4218-b01a-b5aa0bf1c6df" (UID: "530d25fa-62bb-4218-b01a-b5aa0bf1c6df"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:30:43.471524 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.471487    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "530d25fa-62bb-4218-b01a-b5aa0bf1c6df" (UID: "530d25fa-62bb-4218-b01a-b5aa0bf1c6df"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:30:43.473061 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.473032    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-kube-api-access-wpqfp" (OuterVolumeSpecName: "kube-api-access-wpqfp") pod "530d25fa-62bb-4218-b01a-b5aa0bf1c6df" (UID: "530d25fa-62bb-4218-b01a-b5aa0bf1c6df"). InnerVolumeSpecName "kube-api-access-wpqfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:30:43.473061 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.473037    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "530d25fa-62bb-4218-b01a-b5aa0bf1c6df" (UID: "530d25fa-62bb-4218-b01a-b5aa0bf1c6df"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 17:30:43.473202 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.473096    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "530d25fa-62bb-4218-b01a-b5aa0bf1c6df" (UID: "530d25fa-62bb-4218-b01a-b5aa0bf1c6df"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:30:43.473258 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.473238    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-token" (OuterVolumeSpecName: "istio-token") pod "530d25fa-62bb-4218-b01a-b5aa0bf1c6df" (UID: "530d25fa-62bb-4218-b01a-b5aa0bf1c6df"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:30:43.572289 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.572238    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-podinfo\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:30:43.572289 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.572286    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpqfp\" (UniqueName: \"kubernetes.io/projected/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-kube-api-access-wpqfp\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:30:43.572289 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.572297    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-token\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:30:43.572289 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.572307    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-envoy\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:30:43.572633 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.572316    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istiod-ca-cert\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:30:43.572633 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.572324    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-workload-socket\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:30:43.572633 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.572332    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/530d25fa-62bb-4218-b01a-b5aa0bf1c6df-istio-data\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:30:43.925720 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.925682    2568 generic.go:356] "Generic (PLEG): container finished" podID="530d25fa-62bb-4218-b01a-b5aa0bf1c6df" containerID="99f17fcff3401352b00270c5cc2864a90a4ef5f38f0af4c55b3ac9d1886c8ced" exitCode=0
Jul 09 17:30:43.925914 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.925733    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz" event={"ID":"530d25fa-62bb-4218-b01a-b5aa0bf1c6df","Type":"ContainerDied","Data":"99f17fcff3401352b00270c5cc2864a90a4ef5f38f0af4c55b3ac9d1886c8ced"}
Jul 09 17:30:43.925914 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.925781    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz" event={"ID":"530d25fa-62bb-4218-b01a-b5aa0bf1c6df","Type":"ContainerDied","Data":"4436576eb50b28c0fe0870f8097d9188e43bcd4b7cff41c93c446fcfd912600e"}
Jul 09 17:30:43.925914 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.925738    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"
Jul 09 17:30:43.925914 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.925804    2568 scope.go:117] "RemoveContainer" containerID="99f17fcff3401352b00270c5cc2864a90a4ef5f38f0af4c55b3ac9d1886c8ced"
Jul 09 17:30:43.936854 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.936834    2568 scope.go:117] "RemoveContainer" containerID="2c6afa7ad3c67a4ba270fabc41d2d40d9bd7e87028e6ec5177ca33aa4ce191bb"
Jul 09 17:30:43.946898 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.946872    2568 scope.go:117] "RemoveContainer" containerID="99f17fcff3401352b00270c5cc2864a90a4ef5f38f0af4c55b3ac9d1886c8ced"
Jul 09 17:30:43.947570 ip-10-0-140-229 kubenswrapper[2568]: E0709 17:30:43.947543    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99f17fcff3401352b00270c5cc2864a90a4ef5f38f0af4c55b3ac9d1886c8ced\": container with ID starting with 99f17fcff3401352b00270c5cc2864a90a4ef5f38f0af4c55b3ac9d1886c8ced not found: ID does not exist" containerID="99f17fcff3401352b00270c5cc2864a90a4ef5f38f0af4c55b3ac9d1886c8ced"
Jul 09 17:30:43.947798 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.947584    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99f17fcff3401352b00270c5cc2864a90a4ef5f38f0af4c55b3ac9d1886c8ced"} err="failed to get container status \"99f17fcff3401352b00270c5cc2864a90a4ef5f38f0af4c55b3ac9d1886c8ced\": rpc error: code = NotFound desc = could not find container \"99f17fcff3401352b00270c5cc2864a90a4ef5f38f0af4c55b3ac9d1886c8ced\": container with ID starting with 99f17fcff3401352b00270c5cc2864a90a4ef5f38f0af4c55b3ac9d1886c8ced not found: ID does not exist"
Jul 09 17:30:43.947888 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.947801    2568 scope.go:117] "RemoveContainer" containerID="2c6afa7ad3c67a4ba270fabc41d2d40d9bd7e87028e6ec5177ca33aa4ce191bb"
Jul 09 17:30:43.948154 ip-10-0-140-229 kubenswrapper[2568]: E0709 17:30:43.948121    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c6afa7ad3c67a4ba270fabc41d2d40d9bd7e87028e6ec5177ca33aa4ce191bb\": container with ID starting with 2c6afa7ad3c67a4ba270fabc41d2d40d9bd7e87028e6ec5177ca33aa4ce191bb not found: ID does not exist" containerID="2c6afa7ad3c67a4ba270fabc41d2d40d9bd7e87028e6ec5177ca33aa4ce191bb"
Jul 09 17:30:43.948220 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.948165    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c6afa7ad3c67a4ba270fabc41d2d40d9bd7e87028e6ec5177ca33aa4ce191bb"} err="failed to get container status \"2c6afa7ad3c67a4ba270fabc41d2d40d9bd7e87028e6ec5177ca33aa4ce191bb\": rpc error: code = NotFound desc = could not find container \"2c6afa7ad3c67a4ba270fabc41d2d40d9bd7e87028e6ec5177ca33aa4ce191bb\": container with ID starting with 2c6afa7ad3c67a4ba270fabc41d2d40d9bd7e87028e6ec5177ca33aa4ce191bb not found: ID does not exist"
Jul 09 17:30:43.950250 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.950227    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"]
Jul 09 17:30:43.952522 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:43.952500    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-553a9f-openshift-default-5b855c58ff-26frz"]
Jul 09 17:30:45.942048 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:45.942010    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="530d25fa-62bb-4218-b01a-b5aa0bf1c6df" path="/var/lib/kubelet/pods/530d25fa-62bb-4218-b01a-b5aa0bf1c6df/volumes"
Jul 09 17:30:50.510857 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:50.510819    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zs8tf_839507ef-1950-44c7-97b2-d85dcd8bb6dc/manager/0.log"
Jul 09 17:30:50.632317 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:50.632279    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8mrww_1b3b0989-2d21-49a1-be0b-a78fe7cd64a3/manager/0.log"
Jul 09 17:30:50.766529 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:50.766436    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-774b7d6bb6-xpz22_39ded06a-bd3d-4d51-bdbf-c3abf34ad17b/manager/0.log"
Jul 09 17:30:51.238942 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:51.238914    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fdb769df8-lrclt_c4a4283c-2d84-49ca-8347-b6a90684d01a/copy-manifests/0.log"
Jul 09 17:30:51.246380 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:51.246340    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fdb769df8-lrclt_c4a4283c-2d84-49ca-8347-b6a90684d01a/manager/0.log"
Jul 09 17:30:51.725277 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:51.725239    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-56d696876f-5vslf_ce9bf29b-1d42-473e-8f47-4d718efe2f72/maas-api/0.log"
Jul 09 17:30:51.838415 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:51.838389    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29726970-xt7bc_d07516ee-1385-472a-aa34-a492dc7d2890/cleanup/0.log"
Jul 09 17:30:51.943945 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:51.943910    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm_267e8bf0-e8ea-4ba6-a321-dfba6924b235/cleanup/0.log"
Jul 09 17:30:52.053418 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:52.053311    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt_e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e/cleanup/0.log"
Jul 09 17:30:52.161647 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:52.161613    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-c5qcs_85598aea-4b1f-40d6-bd74-02aa03fdaa40/postgres/0.log"
Jul 09 17:30:53.616110 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:53.616079    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qhgn7_c1f9e985-28cd-4ef3-8dbe-13c1199f65b8/manager/0.log"
Jul 09 17:30:53.845633 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:53.845596    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-whrfc_122284ef-8934-4639-a463-f4875532a01c/registry-server/0.log"
Jul 09 17:30:54.214417 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:54.214381    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-rxbxz_d948c6cb-6dc9-46d2-8651-8b6b0b2ef03a/manager/0.log"
Jul 09 17:30:55.020312 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:55.020279    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4mtjl_d5fad100-e600-490c-93b5-f051ac0391b9/istio-proxy/1.log"
Jul 09 17:30:55.133720 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:55.133687    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rwfvj_819a9a12-3966-454e-b046-6cebf91e21db/payload-pre-processing/0.log"
Jul 09 17:30:55.261265 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:55.261225    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-wcnf5_502f3629-6c44-41a9-b231-392cbb1141a8/payload-processing/0.log"
Jul 09 17:30:55.806487 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:55.806445    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-6vkts_e171c6db-461b-436c-97fa-b1a90515eb07/main/0.log"
Jul 09 17:30:55.917115 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:30:55.917089    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-5lgck_3adc08e1-910b-4550-a0cf-14438d0cd53d/main/0.log"
Jul 09 17:31:00.011534 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:00.011486    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726970-xt7bc"]
Jul 09 17:31:00.012039 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:00.011771    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726970-xt7bc" podUID="d07516ee-1385-472a-aa34-a492dc7d2890" containerName="cleanup" containerID="cri-o://155aba6235cb9058909f7f98076d11efe43b7d7d677e249ae517de4fd77c550e" gracePeriod=30
Jul 09 17:31:02.229469 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:02.229443    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm"
Jul 09 17:31:02.362661 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:02.362626    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq7f9\" (UniqueName: \"kubernetes.io/projected/267e8bf0-e8ea-4ba6-a321-dfba6924b235-kube-api-access-mq7f9\") pod \"267e8bf0-e8ea-4ba6-a321-dfba6924b235\" (UID: \"267e8bf0-e8ea-4ba6-a321-dfba6924b235\") "
Jul 09 17:31:02.364862 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:02.364829    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/267e8bf0-e8ea-4ba6-a321-dfba6924b235-kube-api-access-mq7f9" (OuterVolumeSpecName: "kube-api-access-mq7f9") pod "267e8bf0-e8ea-4ba6-a321-dfba6924b235" (UID: "267e8bf0-e8ea-4ba6-a321-dfba6924b235"). InnerVolumeSpecName "kube-api-access-mq7f9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:31:02.463752 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:02.463706    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq7f9\" (UniqueName: \"kubernetes.io/projected/267e8bf0-e8ea-4ba6-a321-dfba6924b235-kube-api-access-mq7f9\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:31:02.572979 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:02.572948    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-glkgj_6a171ab4-4ad7-4670-8baf-99e5ba09c225/global-pull-secret-syncer/0.log"
Jul 09 17:31:02.699771 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:02.699688    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mwcv8_a3d5cd96-7128-42db-963b-e62e14fc1dac/konnectivity-agent/0.log"
Jul 09 17:31:02.815030 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:02.814992    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-229.ec2.internal_641e9bded5c7fc9e1b94316361d7f097/haproxy/0.log"
Jul 09 17:31:02.999097 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:02.999011    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ng88_54ed8699-4487-4246-9e22-3d15bd9908ca/ovn-acl-logging/0.log"
Jul 09 17:31:03.006048 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:03.006022    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2ng88_54ed8699-4487-4246-9e22-3d15bd9908ca/ovn-acl-logging/0.log"
Jul 09 17:31:03.039004 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:03.038969    2568 generic.go:356] "Generic (PLEG): container finished" podID="267e8bf0-e8ea-4ba6-a321-dfba6924b235" containerID="977ba9de29123b01fabee9d77243ddc6b625af9c8bd9e15f77265f21fbd2f451" exitCode=137
Jul 09 17:31:03.039215 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:03.039032    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm"
Jul 09 17:31:03.039215 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:03.039056    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm" event={"ID":"267e8bf0-e8ea-4ba6-a321-dfba6924b235","Type":"ContainerDied","Data":"977ba9de29123b01fabee9d77243ddc6b625af9c8bd9e15f77265f21fbd2f451"}
Jul 09 17:31:03.039215 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:03.039120    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm" event={"ID":"267e8bf0-e8ea-4ba6-a321-dfba6924b235","Type":"ContainerDied","Data":"14d05532f3ff49f559c83bcdcd5ac07ccdb5e7c9c4276cf6d2ee82d2bc6fb9c1"}
Jul 09 17:31:03.039215 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:03.039152    2568 scope.go:117] "RemoveContainer" containerID="977ba9de29123b01fabee9d77243ddc6b625af9c8bd9e15f77265f21fbd2f451"
Jul 09 17:31:03.049191 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:03.049171    2568 scope.go:117] "RemoveContainer" containerID="977ba9de29123b01fabee9d77243ddc6b625af9c8bd9e15f77265f21fbd2f451"
Jul 09 17:31:03.049521 ip-10-0-140-229 kubenswrapper[2568]: E0709 17:31:03.049501    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"977ba9de29123b01fabee9d77243ddc6b625af9c8bd9e15f77265f21fbd2f451\": container with ID starting with 977ba9de29123b01fabee9d77243ddc6b625af9c8bd9e15f77265f21fbd2f451 not found: ID does not exist" containerID="977ba9de29123b01fabee9d77243ddc6b625af9c8bd9e15f77265f21fbd2f451"
Jul 09 17:31:03.049573 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:03.049531    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"977ba9de29123b01fabee9d77243ddc6b625af9c8bd9e15f77265f21fbd2f451"} err="failed to get container status \"977ba9de29123b01fabee9d77243ddc6b625af9c8bd9e15f77265f21fbd2f451\": rpc error: code = NotFound desc = could not find container \"977ba9de29123b01fabee9d77243ddc6b625af9c8bd9e15f77265f21fbd2f451\": container with ID starting with 977ba9de29123b01fabee9d77243ddc6b625af9c8bd9e15f77265f21fbd2f451 not found: ID does not exist"
Jul 09 17:31:03.061846 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:03.061821    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm"]
Jul 09 17:31:03.063920 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:03.063898    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-553a9f-29726970-4dmpm"]
Jul 09 17:31:03.941182 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:03.941147    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="267e8bf0-e8ea-4ba6-a321-dfba6924b235" path="/var/lib/kubelet/pods/267e8bf0-e8ea-4ba6-a321-dfba6924b235/volumes"
Jul 09 17:31:08.019768 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:08.019733    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qhgn7_c1f9e985-28cd-4ef3-8dbe-13c1199f65b8/manager/0.log"
Jul 09 17:31:08.116673 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:08.116638    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-whrfc_122284ef-8934-4639-a463-f4875532a01c/registry-server/0.log"
Jul 09 17:31:08.442977 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:08.442946    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-rxbxz_d948c6cb-6dc9-46d2-8651-8b6b0b2ef03a/manager/0.log"
Jul 09 17:31:09.483211 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:09.483182    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt"
Jul 09 17:31:09.637280 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:09.637246    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b8th\" (UniqueName: \"kubernetes.io/projected/e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e-kube-api-access-6b8th\") pod \"e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e\" (UID: \"e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e\") "
Jul 09 17:31:09.639296 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:09.639272    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e-kube-api-access-6b8th" (OuterVolumeSpecName: "kube-api-access-6b8th") pod "e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e" (UID: "e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e"). InnerVolumeSpecName "kube-api-access-6b8th". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:31:09.738200 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:09.738160    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b8th\" (UniqueName: \"kubernetes.io/projected/e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e-kube-api-access-6b8th\") on node \"ip-10-0-140-229.ec2.internal\" DevicePath \"\""
Jul 09 17:31:10.032906 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.032874    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_90b97416-91f3-4150-b7dc-b188679ceddd/alertmanager/0.log"
Jul 09 17:31:10.061709 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.061664    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_90b97416-91f3-4150-b7dc-b188679ceddd/config-reloader/0.log"
Jul 09 17:31:10.076991 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.076955    2568 generic.go:356] "Generic (PLEG): container finished" podID="e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e" containerID="6ecaa268a77ed5218836496cb2aca99f5264f0cbf148ec625bf8ee6eb57c5c30" exitCode=137
Jul 09 17:31:10.077177 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.077008    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt"
Jul 09 17:31:10.077177 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.077022    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt" event={"ID":"e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e","Type":"ContainerDied","Data":"6ecaa268a77ed5218836496cb2aca99f5264f0cbf148ec625bf8ee6eb57c5c30"}
Jul 09 17:31:10.077177 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.077061    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt" event={"ID":"e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e","Type":"ContainerDied","Data":"135a8aae18ff8d622b5368ebb1f247c6f81523c05abb981bd3864ff73d4cc7b8"}
Jul 09 17:31:10.077177 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.077088    2568 scope.go:117] "RemoveContainer" containerID="6ecaa268a77ed5218836496cb2aca99f5264f0cbf148ec625bf8ee6eb57c5c30"
Jul 09 17:31:10.088441 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.088333    2568 scope.go:117] "RemoveContainer" containerID="6ecaa268a77ed5218836496cb2aca99f5264f0cbf148ec625bf8ee6eb57c5c30"
Jul 09 17:31:10.088750 ip-10-0-140-229 kubenswrapper[2568]: E0709 17:31:10.088721    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ecaa268a77ed5218836496cb2aca99f5264f0cbf148ec625bf8ee6eb57c5c30\": container with ID starting with 6ecaa268a77ed5218836496cb2aca99f5264f0cbf148ec625bf8ee6eb57c5c30 not found: ID does not exist" containerID="6ecaa268a77ed5218836496cb2aca99f5264f0cbf148ec625bf8ee6eb57c5c30"
Jul 09 17:31:10.088880 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.088757    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ecaa268a77ed5218836496cb2aca99f5264f0cbf148ec625bf8ee6eb57c5c30"} err="failed to get container status \"6ecaa268a77ed5218836496cb2aca99f5264f0cbf148ec625bf8ee6eb57c5c30\": rpc error: code = NotFound desc = could not find container \"6ecaa268a77ed5218836496cb2aca99f5264f0cbf148ec625bf8ee6eb57c5c30\": container with ID starting with 6ecaa268a77ed5218836496cb2aca99f5264f0cbf148ec625bf8ee6eb57c5c30 not found: ID does not exist"
Jul 09 17:31:10.089069 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.089053    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_90b97416-91f3-4150-b7dc-b188679ceddd/kube-rbac-proxy-web/0.log"
Jul 09 17:31:10.099325 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.099289    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt"]
Jul 09 17:31:10.101459 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.101433    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-ba9b25-29726970-wqxvt"]
Jul 09 17:31:10.119100 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.119069    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_90b97416-91f3-4150-b7dc-b188679ceddd/kube-rbac-proxy/0.log"
Jul 09 17:31:10.143690 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.143663    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_90b97416-91f3-4150-b7dc-b188679ceddd/kube-rbac-proxy-metric/0.log"
Jul 09 17:31:10.177252 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.177224    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_90b97416-91f3-4150-b7dc-b188679ceddd/prom-label-proxy/0.log"
Jul 09 17:31:10.206570 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.206486    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_90b97416-91f3-4150-b7dc-b188679ceddd/init-config-reloader/0.log"
Jul 09 17:31:10.471223 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.471129    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-c28lm_5ad2886b-2a4c-4956-9016-750c52c4bb95/kube-state-metrics/0.log"
Jul 09 17:31:10.488760 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.488718    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-c28lm_5ad2886b-2a4c-4956-9016-750c52c4bb95/kube-rbac-proxy-main/0.log"
Jul 09 17:31:10.512557 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.512526    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-c28lm_5ad2886b-2a4c-4956-9016-750c52c4bb95/kube-rbac-proxy-self/0.log"
Jul 09 17:31:10.538632 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.538598    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6df6d8b5f4-xgv2m_4274fb10-befa-4a5e-8fae-bdb9b92b1e65/metrics-server/0.log"
Jul 09 17:31:10.564213 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.564188    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-fj62t_061909ff-3550-4bb1-a854-4a3724e03b1e/monitoring-plugin/0.log"
Jul 09 17:31:10.766372 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.766259    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wk2f2_249f6bd1-f57e-4480-9879-c013393983bb/node-exporter/0.log"
Jul 09 17:31:10.788483 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.788454    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wk2f2_249f6bd1-f57e-4480-9879-c013393983bb/kube-rbac-proxy/0.log"
Jul 09 17:31:10.808892 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.808867    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wk2f2_249f6bd1-f57e-4480-9879-c013393983bb/init-textfile/0.log"
Jul 09 17:31:10.841894 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.841862    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-ksc9q_0bc2e3be-bfc1-459a-918f-7db3cd6ac335/kube-rbac-proxy-main/0.log"
Jul 09 17:31:10.863620 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.863594    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-ksc9q_0bc2e3be-bfc1-459a-918f-7db3cd6ac335/kube-rbac-proxy-self/0.log"
Jul 09 17:31:10.888075 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.888044    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-ksc9q_0bc2e3be-bfc1-459a-918f-7db3cd6ac335/openshift-state-metrics/0.log"
Jul 09 17:31:10.925371 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.925321    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62/prometheus/0.log"
Jul 09 17:31:10.960637 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.960603    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62/config-reloader/0.log"
Jul 09 17:31:10.995123 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:10.995090    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62/thanos-sidecar/0.log"
Jul 09 17:31:11.029983 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:11.029896    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62/kube-rbac-proxy-web/0.log"
Jul 09 17:31:11.058140 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:11.058105    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62/kube-rbac-proxy/0.log"
Jul 09 17:31:11.084717 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:11.084688    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62/kube-rbac-proxy-thanos/0.log"
Jul 09 17:31:11.114157 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:11.114127    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a8ea6f9b-9a94-4aa6-848f-bd1e2d0ffd62/init-config-reloader/0.log"
Jul 09 17:31:11.154134 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:11.154103    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-dbms7_3973f9fa-f1e4-4669-b3dc-82383a96ffc4/prometheus-operator/0.log"
Jul 09 17:31:11.181328 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:11.181301    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-dbms7_3973f9fa-f1e4-4669-b3dc-82383a96ffc4/kube-rbac-proxy/0.log"
Jul 09 17:31:11.218512 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:11.218487    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-686tj_96d13014-8a81-4404-b95d-0f8aa82eaa1d/prometheus-operator-admission-webhook/0.log"
Jul 09 17:31:11.258956 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:11.258929    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7476fc8cd6-xl86h_ea1596bd-8468-40cb-99f3-bc44e453f0c4/telemeter-client/0.log"
Jul 09 17:31:11.287267 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:11.287171    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7476fc8cd6-xl86h_ea1596bd-8468-40cb-99f3-bc44e453f0c4/reload/0.log"
Jul 09 17:31:11.312656 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:11.312623    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7476fc8cd6-xl86h_ea1596bd-8468-40cb-99f3-bc44e453f0c4/kube-rbac-proxy/0.log"
Jul 09 17:31:11.345792 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:11.345759    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7447644696-ttdjb_0b6a0122-bd5b-4780-8284-785811b8ce46/thanos-query/0.log"
Jul 09 17:31:11.373807 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:11.373780    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7447644696-ttdjb_0b6a0122-bd5b-4780-8284-785811b8ce46/kube-rbac-proxy-web/0.log"
Jul 09 17:31:11.402975 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:11.402946    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7447644696-ttdjb_0b6a0122-bd5b-4780-8284-785811b8ce46/kube-rbac-proxy/0.log"
Jul 09 17:31:11.428308 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:11.428277    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7447644696-ttdjb_0b6a0122-bd5b-4780-8284-785811b8ce46/prom-label-proxy/0.log"
Jul 09 17:31:11.469858 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:11.469826    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7447644696-ttdjb_0b6a0122-bd5b-4780-8284-785811b8ce46/kube-rbac-proxy-rules/0.log"
Jul 09 17:31:11.491898 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:11.491865    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7447644696-ttdjb_0b6a0122-bd5b-4780-8284-785811b8ce46/kube-rbac-proxy-metrics/0.log"
Jul 09 17:31:11.947074 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:11.940529    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e" path="/var/lib/kubelet/pods/e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e/volumes"
Jul 09 17:31:12.364850 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.364817    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"]
Jul 09 17:31:12.365261 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.365248    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e" containerName="cleanup"
Jul 09 17:31:12.365311 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.365262    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e" containerName="cleanup"
Jul 09 17:31:12.365311 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.365271    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="530d25fa-62bb-4218-b01a-b5aa0bf1c6df" containerName="istio-proxy"
Jul 09 17:31:12.365311 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.365276    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="530d25fa-62bb-4218-b01a-b5aa0bf1c6df" containerName="istio-proxy"
Jul 09 17:31:12.365311 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.365289    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="530d25fa-62bb-4218-b01a-b5aa0bf1c6df" containerName="istio-proxy"
Jul 09 17:31:12.365311 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.365296    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="530d25fa-62bb-4218-b01a-b5aa0bf1c6df" containerName="istio-proxy"
Jul 09 17:31:12.365515 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.365317    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="267e8bf0-e8ea-4ba6-a321-dfba6924b235" containerName="cleanup"
Jul 09 17:31:12.365515 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.365325    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="267e8bf0-e8ea-4ba6-a321-dfba6924b235" containerName="cleanup"
Jul 09 17:31:12.365515 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.365405    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="530d25fa-62bb-4218-b01a-b5aa0bf1c6df" containerName="istio-proxy"
Jul 09 17:31:12.365515 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.365412    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1e1d2f5-270a-4e5e-8b5d-e9e5830bf78e" containerName="cleanup"
Jul 09 17:31:12.365515 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.365422    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="267e8bf0-e8ea-4ba6-a321-dfba6924b235" containerName="cleanup"
Jul 09 17:31:12.370129 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.370108    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"
Jul 09 17:31:12.376173 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.376155    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l7jhs\"/\"kube-root-ca.crt\""
Jul 09 17:31:12.377201 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.377181    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l7jhs\"/\"openshift-service-ca.crt\""
Jul 09 17:31:12.377308 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.377189    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-l7jhs\"/\"default-dockercfg-nkppl\""
Jul 09 17:31:12.381066 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.381040    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"]
Jul 09 17:31:12.460289 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.460238    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/98d746d3-b7b0-4897-8a0f-ac5bf5dda355-proc\") pod \"perf-node-gather-daemonset-khdxg\" (UID: \"98d746d3-b7b0-4897-8a0f-ac5bf5dda355\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"
Jul 09 17:31:12.460563 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.460304    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drgzm\" (UniqueName: \"kubernetes.io/projected/98d746d3-b7b0-4897-8a0f-ac5bf5dda355-kube-api-access-drgzm\") pod \"perf-node-gather-daemonset-khdxg\" (UID: \"98d746d3-b7b0-4897-8a0f-ac5bf5dda355\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"
Jul 09 17:31:12.460563 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.460429    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98d746d3-b7b0-4897-8a0f-ac5bf5dda355-lib-modules\") pod \"perf-node-gather-daemonset-khdxg\" (UID: \"98d746d3-b7b0-4897-8a0f-ac5bf5dda355\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"
Jul 09 17:31:12.460563 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.460459    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98d746d3-b7b0-4897-8a0f-ac5bf5dda355-sys\") pod \"perf-node-gather-daemonset-khdxg\" (UID: \"98d746d3-b7b0-4897-8a0f-ac5bf5dda355\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"
Jul 09 17:31:12.460563 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.460496    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/98d746d3-b7b0-4897-8a0f-ac5bf5dda355-podres\") pod \"perf-node-gather-daemonset-khdxg\" (UID: \"98d746d3-b7b0-4897-8a0f-ac5bf5dda355\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"
Jul 09 17:31:12.561117 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.561078    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/98d746d3-b7b0-4897-8a0f-ac5bf5dda355-proc\") pod \"perf-node-gather-daemonset-khdxg\" (UID: \"98d746d3-b7b0-4897-8a0f-ac5bf5dda355\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"
Jul 09 17:31:12.561642 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.561127    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drgzm\" (UniqueName: \"kubernetes.io/projected/98d746d3-b7b0-4897-8a0f-ac5bf5dda355-kube-api-access-drgzm\") pod \"perf-node-gather-daemonset-khdxg\" (UID: \"98d746d3-b7b0-4897-8a0f-ac5bf5dda355\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"
Jul 09 17:31:12.561642 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.561190    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98d746d3-b7b0-4897-8a0f-ac5bf5dda355-lib-modules\") pod \"perf-node-gather-daemonset-khdxg\" (UID: \"98d746d3-b7b0-4897-8a0f-ac5bf5dda355\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"
Jul 09 17:31:12.561642 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.561198    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/98d746d3-b7b0-4897-8a0f-ac5bf5dda355-proc\") pod \"perf-node-gather-daemonset-khdxg\" (UID: \"98d746d3-b7b0-4897-8a0f-ac5bf5dda355\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"
Jul 09 17:31:12.561642 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.561218    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98d746d3-b7b0-4897-8a0f-ac5bf5dda355-sys\") pod \"perf-node-gather-daemonset-khdxg\" (UID: \"98d746d3-b7b0-4897-8a0f-ac5bf5dda355\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"
Jul 09 17:31:12.561642 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.561253    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/98d746d3-b7b0-4897-8a0f-ac5bf5dda355-podres\") pod \"perf-node-gather-daemonset-khdxg\" (UID: \"98d746d3-b7b0-4897-8a0f-ac5bf5dda355\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"
Jul 09 17:31:12.561642 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.561313    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98d746d3-b7b0-4897-8a0f-ac5bf5dda355-sys\") pod \"perf-node-gather-daemonset-khdxg\" (UID: \"98d746d3-b7b0-4897-8a0f-ac5bf5dda355\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"
Jul 09 17:31:12.561642 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.561312    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98d746d3-b7b0-4897-8a0f-ac5bf5dda355-lib-modules\") pod \"perf-node-gather-daemonset-khdxg\" (UID: \"98d746d3-b7b0-4897-8a0f-ac5bf5dda355\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"
Jul 09 17:31:12.561642 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.561461    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/98d746d3-b7b0-4897-8a0f-ac5bf5dda355-podres\") pod \"perf-node-gather-daemonset-khdxg\" (UID: \"98d746d3-b7b0-4897-8a0f-ac5bf5dda355\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"
Jul 09 17:31:12.570999 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.570972    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drgzm\" (UniqueName: \"kubernetes.io/projected/98d746d3-b7b0-4897-8a0f-ac5bf5dda355-kube-api-access-drgzm\") pod \"perf-node-gather-daemonset-khdxg\" (UID: \"98d746d3-b7b0-4897-8a0f-ac5bf5dda355\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"
Jul 09 17:31:12.681611 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.681501    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"
Jul 09 17:31:12.829143 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:12.829115    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"]
Jul 09 17:31:12.830597 ip-10-0-140-229 kubenswrapper[2568]: W0709 17:31:12.830563    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod98d746d3_b7b0_4897_8a0f_ac5bf5dda355.slice/crio-e3fa47da8de464fc4e652d8ac6ed97ed67ac861da68daab847f83d3e9dfe62b3 WatchSource:0}: Error finding container e3fa47da8de464fc4e652d8ac6ed97ed67ac861da68daab847f83d3e9dfe62b3: Status 404 returned error can't find the container with id e3fa47da8de464fc4e652d8ac6ed97ed67ac861da68daab847f83d3e9dfe62b3
Jul 09 17:31:13.096467 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:13.096428    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg" event={"ID":"98d746d3-b7b0-4897-8a0f-ac5bf5dda355","Type":"ContainerStarted","Data":"da2a395ed767a4e3b18fea95d2286e0e0815672945b22e4418376360a23be1d0"}
Jul 09 17:31:13.096650 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:13.096482    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg" event={"ID":"98d746d3-b7b0-4897-8a0f-ac5bf5dda355","Type":"ContainerStarted","Data":"e3fa47da8de464fc4e652d8ac6ed97ed67ac861da68daab847f83d3e9dfe62b3"}
Jul 09 17:31:13.096650 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:13.096581    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"
Jul 09 17:31:13.116530 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:13.116470    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg" podStartSLOduration=1.116450685 podStartE2EDuration="1.116450685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:31:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:31:13.114390275 +0000 UTC m=+2410.794806184" watchObservedRunningTime="2026-07-09 17:31:13.116450685 +0000 UTC m=+2410.796866593"
Jul 09 17:31:13.871134 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:13.871105    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cbff4d568-hb9ff_900053bf-e287-4ab6-b916-1f46cfa77715/console/0.log"
Jul 09 17:31:13.908683 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:13.908650    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-9jmr4_c1d0a170-6c31-41a3-bbda-560c76896106/download-server/0.log"
Jul 09 17:31:15.507370 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:15.507318    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lb6th_3aa101ea-5721-4a1b-8012-6a3db8efa1b9/dns/0.log"
Jul 09 17:31:15.543020 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:15.542971    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lb6th_3aa101ea-5721-4a1b-8012-6a3db8efa1b9/kube-rbac-proxy/0.log"
Jul 09 17:31:15.637843 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:15.637811    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dx97p_bed3615c-b651-41bd-9229-90462d4dddea/dns-node-resolver/0.log"
Jul 09 17:31:16.206619 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:16.206585    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kcrrm_787d7f86-db4b-4eac-90bf-c79c0fc629ca/node-ca/0.log"
Jul 09 17:31:17.452217 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:17.452180    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4mtjl_d5fad100-e600-490c-93b5-f051ac0391b9/istio-proxy/0.log"
Jul 09 17:31:17.511318 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:17.511276    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4mtjl_d5fad100-e600-490c-93b5-f051ac0391b9/istio-proxy/1.log"
Jul 09 17:31:17.574828 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:17.574784    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rwfvj_819a9a12-3966-454e-b046-6cebf91e21db/payload-pre-processing/0.log"
Jul 09 17:31:17.654034 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:17.653994    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-wcnf5_502f3629-6c44-41a9-b231-392cbb1141a8/payload-processing/0.log"
Jul 09 17:31:18.396097 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:18.396059    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k6sgl_5abe376b-d71f-4925-8700-3bead0cb2036/serve-healthcheck-canary/0.log"
Jul 09 17:31:19.018374 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:19.018328    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pmvnf_be6d2259-b188-45f9-a2bb-024dd002ff77/kube-rbac-proxy/0.log"
Jul 09 17:31:19.037500 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:19.037470    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pmvnf_be6d2259-b188-45f9-a2bb-024dd002ff77/exporter/0.log"
Jul 09 17:31:19.059623 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:19.059592    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pmvnf_be6d2259-b188-45f9-a2bb-024dd002ff77/extractor/0.log"
Jul 09 17:31:19.111818 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:19.111793    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-khdxg"
Jul 09 17:31:21.199098 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:21.199072    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zs8tf_839507ef-1950-44c7-97b2-d85dcd8bb6dc/manager/0.log"
Jul 09 17:31:21.454125 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:21.454088    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8mrww_1b3b0989-2d21-49a1-be0b-a78fe7cd64a3/manager/0.log"
Jul 09 17:31:21.627490 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:21.627392    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-774b7d6bb6-xpz22_39ded06a-bd3d-4d51-bdbf-c3abf34ad17b/manager/0.log"
Jul 09 17:31:21.854099 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:21.854072    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fdb769df8-lrclt_c4a4283c-2d84-49ca-8347-b6a90684d01a/manager/0.log"
Jul 09 17:31:21.876039 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:21.876013    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fdb769df8-lrclt_c4a4283c-2d84-49ca-8347-b6a90684d01a/copy-manifests/0.log"
Jul 09 17:31:23.208573 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:23.208538    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c969b7c4d-wx9vc_b708a4f8-1731-4f38-b156-a72b8d8d1f88/manager/0.log"
Jul 09 17:31:23.238116 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:23.238080    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-28wgn_b65b7d1b-f96f-4dd7-ac2d-3e0e100b7bbf/openshift-lws-operator/0.log"
Jul 09 17:31:23.377230 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:23.377191    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4mtjl_d5fad100-e600-490c-93b5-f051ac0391b9/istio-proxy/0.log"
Jul 09 17:31:23.431779 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:23.431746    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4mtjl_d5fad100-e600-490c-93b5-f051ac0391b9/istio-proxy/1.log"
Jul 09 17:31:23.481029 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:23.480939    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rwfvj_819a9a12-3966-454e-b046-6cebf91e21db/payload-pre-processing/0.log"
Jul 09 17:31:23.558921 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:23.558888    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-wcnf5_502f3629-6c44-41a9-b231-392cbb1141a8/payload-processing/0.log"
Jul 09 17:31:24.964623 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:24.964589    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4mtjl_d5fad100-e600-490c-93b5-f051ac0391b9/istio-proxy/0.log"
Jul 09 17:31:25.021572 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:25.021539    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4mtjl_d5fad100-e600-490c-93b5-f051ac0391b9/istio-proxy/1.log"
Jul 09 17:31:25.076181 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:25.076144    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rwfvj_819a9a12-3966-454e-b046-6cebf91e21db/payload-pre-processing/0.log"
Jul 09 17:31:25.146911 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:25.146855    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-wcnf5_502f3629-6c44-41a9-b231-392cbb1141a8/payload-processing/0.log"
Jul 09 17:31:29.686298 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:29.686268    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmfkk_3e9cd237-d0aa-47e0-8034-af5d77b0d27a/kube-multus-additional-cni-plugins/0.log"
Jul 09 17:31:29.707550 ip-10-0-140-229 kubenswrapper[2568]: I0709 17:31:29.707521    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmfkk_3e9cd237-d0aa-47e0-8034-af5d77b0d27a/egress-router-binary-copy/0.log"