May 20 20:17:15.884170 ip-10-0-129-75 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 20 20:17:15.884184 ip-10-0-129-75 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 20 20:17:15.884194 ip-10-0-129-75 systemd[1]: kubelet.service: Failed with result 'resources'.
May 20 20:17:15.884632 ip-10-0-129-75 systemd[1]: Failed to start Kubernetes Kubelet.
May 20 20:17:26.046998 ip-10-0-129-75 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 20 20:17:26.047014 ip-10-0-129-75 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6c6602abaeb94e2b9624484b42c7f71c --
May 20 20:19:45.847154 ip-10-0-129-75 systemd[1]: Starting Kubernetes Kubelet...
May 20 20:19:46.300222 ip-10-0-129-75 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 20:19:46.300222 ip-10-0-129-75 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 20 20:19:46.300222 ip-10-0-129-75 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 20:19:46.300222 ip-10-0-129-75 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 20 20:19:46.300222 ip-10-0-129-75 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 20:19:46.303290 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.303202    2566 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 20 20:19:46.306622 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306605    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 20:19:46.306622 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306622    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 20:19:46.306622 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306627    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 20:19:46.306803 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306632    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 20:19:46.306803 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306636    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 20:19:46.306803 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306642    2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 20:19:46.306803 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306646    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 20:19:46.306803 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306650    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 20:19:46.306803 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306654    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 20:19:46.306803 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306658    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 20:19:46.306803 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306662    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 20:19:46.306803 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306667    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 20:19:46.306803 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306671    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 20:19:46.306803 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306674    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 20:19:46.306803 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306678    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 20:19:46.306803 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306689    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 20:19:46.306803 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306693    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 20:19:46.306803 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306700    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 20:19:46.306803 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306707    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 20:19:46.306803 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306713    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 20:19:46.306803 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306718    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 20:19:46.306803 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306722    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 20:19:46.306803 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306726    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 20:19:46.307643 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306731    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 20:19:46.307643 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306735    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 20:19:46.307643 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306739    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 20:19:46.307643 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306743    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 20:19:46.307643 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306748    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 20:19:46.307643 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306752    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 20:19:46.307643 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306757    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 20:19:46.307643 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306761    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 20:19:46.307643 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306766    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 20:19:46.307643 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306771    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 20:19:46.307643 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306775    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 20:19:46.307643 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306780    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 20:19:46.307643 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306784    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 20:19:46.307643 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306789    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 20:19:46.307643 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306794    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 20:19:46.307643 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306798    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 20:19:46.307643 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306802    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 20:19:46.307643 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306806    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 20:19:46.307643 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306811    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 20:19:46.307643 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306818    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 20:19:46.308377 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306824    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 20:19:46.308377 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306828    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 20:19:46.308377 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306832    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 20:19:46.308377 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306836    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 20:19:46.308377 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306840    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 20:19:46.308377 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306845    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 20:19:46.308377 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306849    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 20:19:46.308377 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306853    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 20:19:46.308377 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306857    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 20:19:46.308377 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306861    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 20:19:46.308377 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306865    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 20:19:46.308377 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306869    2566 feature_gate.go:328] unrecognized feature gate: Example2
May 20 20:19:46.308377 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306873    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 20:19:46.308377 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306878    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 20:19:46.308377 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306882    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 20:19:46.308377 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306886    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 20:19:46.308377 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306911    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 20:19:46.308377 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306915    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 20:19:46.308377 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306920    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 20:19:46.308377 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306924    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 20:19:46.309047 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306928    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 20:19:46.309047 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306932    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 20:19:46.309047 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306936    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 20:19:46.309047 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306949    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 20:19:46.309047 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306955    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 20:19:46.309047 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306963    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 20:19:46.309047 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306968    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 20:19:46.309047 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306972    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 20:19:46.309047 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306976    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 20:19:46.309047 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306980    2566 feature_gate.go:328] unrecognized feature gate: Example
May 20 20:19:46.309047 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306984    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 20:19:46.309047 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306989    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 20:19:46.309047 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306993    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 20:19:46.309047 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.306997    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 20:19:46.309047 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307002    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 20:19:46.309047 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307006    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 20:19:46.309047 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307010    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 20:19:46.309047 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307014    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 20:19:46.309047 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307018    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 20:19:46.309984 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307022    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 20:19:46.309984 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307027    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 20:19:46.309984 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307031    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 20:19:46.309984 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307035    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 20:19:46.309984 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307683    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 20:19:46.309984 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307693    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 20:19:46.309984 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307697    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 20:19:46.309984 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307704    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 20:19:46.309984 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307709    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 20:19:46.309984 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307714    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 20:19:46.309984 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307719    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 20:19:46.309984 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307726    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 20:19:46.309984 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307731    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 20:19:46.309984 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307736    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 20:19:46.309984 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307741    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 20:19:46.309984 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307745    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 20:19:46.309984 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307750    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 20:19:46.309984 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307756    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 20:19:46.309984 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307761    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 20:19:46.310505 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307766    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 20:19:46.310505 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307771    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 20:19:46.310505 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307776    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 20:19:46.310505 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307780    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 20:19:46.310505 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307784    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 20:19:46.310505 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307788    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 20:19:46.310505 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307792    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 20:19:46.310505 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307796    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 20:19:46.310505 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307800    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 20:19:46.310505 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307805    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 20:19:46.310505 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307809    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 20:19:46.310505 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307813    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 20:19:46.310505 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307817    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 20:19:46.310505 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307821    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 20:19:46.310505 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307825    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 20:19:46.310505 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307830    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 20:19:46.310505 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307834    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 20:19:46.310505 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307838    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 20:19:46.310505 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307842    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 20:19:46.310505 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307846    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 20:19:46.311127 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307850    2566 feature_gate.go:328] unrecognized feature gate: Example
May 20 20:19:46.311127 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307854    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 20:19:46.311127 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307858    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 20:19:46.311127 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307862    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 20:19:46.311127 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307866    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 20:19:46.311127 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307871    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 20:19:46.311127 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307875    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 20:19:46.311127 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307879    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 20:19:46.311127 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307883    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 20:19:46.311127 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307905    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 20:19:46.311127 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307911    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 20:19:46.311127 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307916    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 20:19:46.311127 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307920    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 20:19:46.311127 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307924    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 20:19:46.311127 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307928    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 20:19:46.311127 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307934    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 20:19:46.311127 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307938    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 20:19:46.311127 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307942    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 20:19:46.311127 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307947    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 20:19:46.311127 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307951    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 20:19:46.311843 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307956    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 20:19:46.311843 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307961    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 20:19:46.311843 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307966    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 20:19:46.311843 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307969    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 20:19:46.311843 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307973    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 20:19:46.311843 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307977    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 20:19:46.311843 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307981    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 20:19:46.311843 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307985    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 20:19:46.311843 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307989    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 20:19:46.311843 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307993    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 20:19:46.311843 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.307998    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 20:19:46.311843 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.308002    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 20:19:46.311843 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.308006    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 20:19:46.311843 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.308010    2566 feature_gate.go:328] unrecognized feature gate: Example2
May 20 20:19:46.311843 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.308014    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 20:19:46.311843 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.308020    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 20:19:46.311843 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.308025    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 20:19:46.311843 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.308029    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 20:19:46.311843 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.308033    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 20:19:46.311843 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.308037    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 20:19:46.312372 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.308041    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 20:19:46.312372 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.308047    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 20:19:46.312372 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.308054    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 20:19:46.312372 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.308059    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 20:19:46.312372 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.308063    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 20:19:46.312372 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.308067    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 20:19:46.312372 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.308072    2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 20:19:46.312372 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.308076    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 20:19:46.312372 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.308080    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 20:19:46.312372 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.308084    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 20:19:46.312372 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.308087    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 20:19:46.312372 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308679    2566 flags.go:64] FLAG: --address="0.0.0.0"
May 20 20:19:46.312372 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308693    2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 20 20:19:46.312372 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308702    2566 flags.go:64] FLAG: --anonymous-auth="true"
May 20 20:19:46.312372 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308709    2566 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 20 20:19:46.312372 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308716    2566 flags.go:64] FLAG: --authentication-token-webhook="false"
May 20 20:19:46.312372 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308722    2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 20 20:19:46.312372 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308729    2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 20 20:19:46.312372 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308737    2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 20 20:19:46.312372 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308743    2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308747    2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308753    2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308759    2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308764    2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308769    2566 flags.go:64] FLAG: --cgroup-root=""
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308774    2566 flags.go:64] FLAG: --cgroups-per-qos="true"
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308778    2566 flags.go:64] FLAG: --client-ca-file=""
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308783    2566 flags.go:64] FLAG: --cloud-config=""
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308788    2566 flags.go:64] FLAG: --cloud-provider="external"
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308793    2566 flags.go:64] FLAG: --cluster-dns="[]"
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308801    2566 flags.go:64] FLAG: --cluster-domain=""
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308806    2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308812    2566 flags.go:64] FLAG: --config-dir=""
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308816    2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308822    2566 flags.go:64] FLAG: --container-log-max-files="5"
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308828    2566 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308835    2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308840    2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308846    2566 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308851    2566 flags.go:64] FLAG: --contention-profiling="false"
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308855    2566 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308860    2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308865    2566 flags.go:64] FLAG: --cpu-manager-policy="none"
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308870    2566 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 20 20:19:46.312886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308877    2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308882    2566 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308906    2566 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308911    2566 flags.go:64] FLAG: --enable-load-reader="false"
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308916    2566 flags.go:64] FLAG: --enable-server="true"
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308921    2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308928    2566 flags.go:64] FLAG: --event-burst="100"
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308932    2566 flags.go:64] FLAG: --event-qps="50"
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308937    2566 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308942    2566 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308947    2566 flags.go:64] FLAG: --eviction-hard=""
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308953    2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308958    2566 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308963    2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308968    2566 flags.go:64] FLAG: --eviction-soft=""
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308973    2566 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308978    2566 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308983    2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308988    2566 flags.go:64] FLAG: --experimental-mounter-path=""
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308992    2566 flags.go:64] FLAG: --fail-cgroupv1="false"
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.308997    2566 flags.go:64] FLAG: --fail-swap-on="true"
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309002    2566 flags.go:64] FLAG: --feature-gates=""
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309008    2566 flags.go:64] FLAG: --file-check-frequency="20s"
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309013    2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309018    2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 20 20:19:46.313605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309024    2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309030    2566 flags.go:64] FLAG: --healthz-port="10248"
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309035    2566 flags.go:64] FLAG: --help="false"
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309039    2566 flags.go:64] FLAG: --hostname-override="ip-10-0-129-75.ec2.internal"
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309044    2566 flags.go:64] FLAG: --housekeeping-interval="10s"
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309049    2566 flags.go:64] FLAG: --http-check-frequency="20s"
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309053    2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309059    2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309064    2566 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309069    2566 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309074    2566 flags.go:64] FLAG: --image-service-endpoint=""
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309079    2566 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309083    2566 flags.go:64] FLAG: --kube-api-burst="100"
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309088    2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309092    2566 flags.go:64] FLAG: --kube-api-qps="50"
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309097    2566 flags.go:64] FLAG: --kube-reserved=""
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309101    2566 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309105    2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309110    2566 flags.go:64] FLAG: --kubelet-cgroups=""
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309114    2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309118    2566 flags.go:64] FLAG: --lock-file=""
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309123    2566 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309127    2566 flags.go:64] FLAG: --log-flush-frequency="5s"
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309131    2566 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 20 20:19:46.314230 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309139    2566 flags.go:64] FLAG: --log-json-split-stream="false"
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309143    2566 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309148    2566 flags.go:64] FLAG: --log-text-split-stream="false"
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309152    2566 flags.go:64] FLAG: --logging-format="text"
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309156    2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309162    2566 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309166    2566 flags.go:64] FLAG: --manifest-url=""
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309170    2566 flags.go:64] FLAG: --manifest-url-header=""
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309176    2566 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309182    2566 flags.go:64] FLAG: --max-open-files="1000000"
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309189    2566 flags.go:64] FLAG: --max-pods="110"
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309194    2566 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309198    2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309203    2566 flags.go:64] FLAG: --memory-manager-policy="None"
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309208    2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309215    2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309220    2566 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309225    2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309236    2566 flags.go:64] FLAG: --node-status-max-images="50"
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309241    2566 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309246    2566 flags.go:64] FLAG: --oom-score-adj="-999"
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309251    2566 flags.go:64] FLAG: --pod-cidr=""
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309256    2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 20 20:19:46.314840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309266    2566 flags.go:64] FLAG: --pod-manifest-path=""
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309271    2566 flags.go:64] FLAG: --pod-max-pids="-1"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309276    2566 flags.go:64] FLAG: --pods-per-core="0"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309281    2566 flags.go:64] FLAG: --port="10250"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309287    2566 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309292    2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b363da8df1aa3fda"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309297    2566 flags.go:64] FLAG: --qos-reserved=""
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309302    2566 flags.go:64] FLAG: --read-only-port="10255"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309306    2566 flags.go:64] FLAG: --register-node="true"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309311    2566 flags.go:64] FLAG: --register-schedulable="true"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309316    2566 flags.go:64] FLAG: --register-with-taints=""
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309322    2566 flags.go:64] FLAG: --registry-burst="10"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309327    2566 flags.go:64] FLAG: --registry-qps="5"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309332    2566 flags.go:64] FLAG: --reserved-cpus=""
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309336    2566 flags.go:64] FLAG: --reserved-memory=""
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309342    2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309347    2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309352    2566 flags.go:64] FLAG: --rotate-certificates="false"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309357    2566 flags.go:64] FLAG: --rotate-server-certificates="false"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309363    2566 flags.go:64] FLAG: --runonce="false"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309367    2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309372    2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309377    2566 flags.go:64] FLAG: --seccomp-default="false"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309382    2566 flags.go:64] FLAG: --serialize-image-pulls="true"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309391    2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309396    2566 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 20 20:19:46.315423 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309402    2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309407    2566 flags.go:64] FLAG: --storage-driver-password="root"
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309412    2566 flags.go:64] FLAG: --storage-driver-secure="false"
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309416    2566 flags.go:64] FLAG: --storage-driver-table="stats"
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309421    2566 flags.go:64] FLAG: --storage-driver-user="root"
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309426    2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309431    2566 flags.go:64] FLAG: --sync-frequency="1m0s"
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309436    2566 flags.go:64] FLAG: --system-cgroups=""
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309441    2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309450    2566 flags.go:64] FLAG: --system-reserved-cgroup=""
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309454    2566 flags.go:64] FLAG: --tls-cert-file=""
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309459    2566 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309466    2566 flags.go:64] FLAG: --tls-min-version=""
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309470    2566 flags.go:64] FLAG: --tls-private-key-file=""
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309475    2566 flags.go:64] FLAG: --topology-manager-policy="none"
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309479    2566 flags.go:64] FLAG: --topology-manager-policy-options=""
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309485    2566 flags.go:64] FLAG: --topology-manager-scope="container"
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309489    2566 flags.go:64] FLAG: --v="2"
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309500    2566 flags.go:64] FLAG: --version="false"
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309507    2566 flags.go:64] FLAG: --vmodule=""
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309513    2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.309518    2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309682    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309688    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 20:19:46.316106 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309693    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 20:19:46.316741 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309698    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 20:19:46.316741 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309710    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 20:19:46.316741 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309715    2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 20:19:46.316741 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309719    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 20:19:46.316741 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309723    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 20:19:46.316741 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309730    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 20:19:46.316741 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309734    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 20:19:46.316741 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309740    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 20:19:46.316741 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309744    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 20:19:46.316741 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309748    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 20:19:46.316741 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309752    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 20:19:46.316741 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309756    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 20:19:46.316741 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309761    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 20:19:46.316741 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309765    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 20:19:46.316741 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309769    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 20:19:46.316741 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309773    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 20:19:46.316741 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309777    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 20:19:46.316741 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309782    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 20:19:46.316741 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309786    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 20:19:46.316741 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309791    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 20:19:46.317279 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309795    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 20:19:46.317279 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309799    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 20:19:46.317279 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309804    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 20:19:46.317279 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309808    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 20:19:46.317279 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309812    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 20:19:46.317279 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309815    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 20:19:46.317279 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309820    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 20:19:46.317279 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309824    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 20:19:46.317279 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309828    2566 feature_gate.go:328] unrecognized feature gate: Example2
May 20 20:19:46.317279 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309832    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 20:19:46.317279 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309837    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 20:19:46.317279 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309841    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 20:19:46.317279 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309846    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 20:19:46.317279 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309850    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 20:19:46.317279 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309862    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 20:19:46.317279 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309867    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 20:19:46.317279 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309871    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 20:19:46.317279 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309876    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 20:19:46.317279 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309881    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 20:19:46.317279 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309904    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 20:19:46.317771 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309909    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 20:19:46.317771 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309913    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 20:19:46.317771 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309916    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 20:19:46.317771 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309921    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 20:19:46.317771 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309925    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 20:19:46.317771 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309929    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 20:19:46.317771 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309933    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 20:19:46.317771 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309937    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 20:19:46.317771 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309941    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 20:19:46.317771 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309945    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 20:19:46.317771 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309949    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 20:19:46.317771 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309953    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 20:19:46.317771 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309957    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 20:19:46.317771 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309962    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 20:19:46.317771 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309968    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 20:19:46.317771 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309974    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 20:19:46.317771 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309979    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 20:19:46.317771 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309983    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 20:19:46.317771 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309987    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 20:19:46.318270 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309991    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 20:19:46.318270 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309994    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 20:19:46.318270 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.309998    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 20:19:46.318270 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310002    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 20:19:46.318270 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310006    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 20:19:46.318270 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310010    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 20:19:46.318270 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310014    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 20:19:46.318270 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310018    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 20:19:46.318270 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310024    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 20:19:46.318270 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310028    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 20:19:46.318270 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310035    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 20:19:46.318270 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310040    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 20:19:46.318270 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310047    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 20:19:46.318270 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310051    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 20:19:46.318270 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310056    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 20:19:46.318270 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310061    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 20:19:46.318270 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310065    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 20:19:46.318270 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310069    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 20:19:46.318270 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310073    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 20:19:46.318737 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310077    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 20:19:46.318737 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310081    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 20:19:46.318737 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310085    2566 feature_gate.go:328] unrecognized feature gate: Example
May 20 20:19:46.318737 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310089    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 20:19:46.318737 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.310093    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 20:19:46.318737 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.310694    2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 20:19:46.318737 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.318401    2566 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 20 20:19:46.318737 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.318419    2566 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 20 20:19:46.318737 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318465    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 20:19:46.318737 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318471    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 20:19:46.318737 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318474    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 20:19:46.318737 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318477    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 20:19:46.318737 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318480    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 20:19:46.318737 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318483    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 20:19:46.318737 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318486    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 20:19:46.318737 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318503    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 20:19:46.319158 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318507    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 20:19:46.319158 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318511    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 20:19:46.319158 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318514    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 20:19:46.319158 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318518    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 20:19:46.319158 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318521    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 20:19:46.319158 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318524    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 20:19:46.319158 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318527    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 20:19:46.319158 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318530    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 20:19:46.319158 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318533    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 20:19:46.319158 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318536    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 20:19:46.319158 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318538    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 20:19:46.319158 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318541    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 20:19:46.319158 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318543    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 20:19:46.319158 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318547    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 20:19:46.319158 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318552    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 20:19:46.319158 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318555    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 20:19:46.319158 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318558    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 20:19:46.319158 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318561    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 20:19:46.319158 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318564    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 20:19:46.319656 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318567    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 20:19:46.319656 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318570    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 20:19:46.319656 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318572    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 20:19:46.319656 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318575    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 20:19:46.319656 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318580    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 20:19:46.319656 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318583    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 20:19:46.319656 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318586    2566 feature_gate.go:328] unrecognized feature gate: Example
May 20 20:19:46.319656 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318588    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 20:19:46.319656 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318591    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 20:19:46.319656 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318594    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 20:19:46.319656 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318597    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 20:19:46.319656 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318599    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 20:19:46.319656 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318602    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 20:19:46.319656 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318605    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 20:19:46.319656 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318608    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 20:19:46.319656 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318610    2566 feature_gate.go:328] unrecognized feature gate: Example2
May 20 20:19:46.319656 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318613    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 20:19:46.319656 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318615    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 20:19:46.319656 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318618    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 20:19:46.319656 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318621    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 20:19:46.320228 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318623    2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 20:19:46.320228 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318626    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 20:19:46.320228 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318628    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 20:19:46.320228 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318631    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 20:19:46.320228 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318634    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 20:19:46.320228 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318636    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 20:19:46.320228 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318639    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 20:19:46.320228 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318641    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 20:19:46.320228 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318644    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 20:19:46.320228 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318646    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 20:19:46.320228 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318649    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 20:19:46.320228 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318651    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 20:19:46.320228 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318654    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 20:19:46.320228 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318656    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 20:19:46.320228 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318659    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 20:19:46.320228 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318661    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 20:19:46.320228 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318665    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 20:19:46.320228 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318668    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 20:19:46.320228 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318671    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 20:19:46.320696 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318673    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 20:19:46.320696 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318676    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 20:19:46.320696 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318678    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 20:19:46.320696 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318681    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 20:19:46.320696 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318684    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 20:19:46.320696 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318686    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 20:19:46.320696 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318689    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 20:19:46.320696 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318691    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 20:19:46.320696 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318693    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 20:19:46.320696 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318696    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 20:19:46.320696 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318699    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 20:19:46.320696 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318701    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 20:19:46.320696 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318705    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 20:19:46.320696 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318708    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 20:19:46.320696 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318711    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 20:19:46.320696 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318713    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 20:19:46.320696 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318716    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 20:19:46.320696 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318718    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 20:19:46.320696 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318721    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 20:19:46.320696 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318723    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 20:19:46.321203 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.318728    2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 20:19:46.321203 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318826    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 20:19:46.321203 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318830    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 20:19:46.321203 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318833    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 20:19:46.321203 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318836    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 20:19:46.321203 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318839    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 20:19:46.321203 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318841    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 20:19:46.321203 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318844    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 20:19:46.321203 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318847    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 20:19:46.321203 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318851    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 20:19:46.321203 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318854    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 20:19:46.321203 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318857    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 20:19:46.321203 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318860    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 20:19:46.321203 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318863    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 20:19:46.321203 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318866    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 20:19:46.321203 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318868    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 20:19:46.321597 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318871    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 20:19:46.321597 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318873    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 20:19:46.321597 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318876    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 20:19:46.321597 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318878    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 20:19:46.321597 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318881    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 20:19:46.321597 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318884    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 20:19:46.321597 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318886    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 20:19:46.321597 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318907    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 20:19:46.321597 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318911    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 20:19:46.321597 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318915    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 20:19:46.321597 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318920    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 20:19:46.321597 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318923    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 20:19:46.321597 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318925    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 20:19:46.321597 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318928    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 20:19:46.321597 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318930    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 20:19:46.321597 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318933    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 20:19:46.321597 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318935    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 20:19:46.321597 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318938    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 20:19:46.321597 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318941    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 20:19:46.321597 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318943    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 20:19:46.322100 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318946    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 20:19:46.322100 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318949    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 20:19:46.322100 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318951    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 20:19:46.322100 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318954    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 20:19:46.322100 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318956    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 20:19:46.322100 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318959    2566 feature_gate.go:328] unrecognized feature gate: Example
May 20 20:19:46.322100 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318962    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 20:19:46.322100 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318965    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 20:19:46.322100 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318968    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 20:19:46.322100 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318971    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 20:19:46.322100 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318973    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 20:19:46.322100 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318976    2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 20:19:46.322100 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318979    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 20:19:46.322100 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318981    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 20:19:46.322100 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318984    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 20:19:46.322100 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318986    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 20:19:46.322100 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318989    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 20:19:46.322100 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318991    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 20:19:46.322100 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318994    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 20:19:46.322100 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318997    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 20:19:46.322581 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.318999    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 20:19:46.322581 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319001    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 20:19:46.322581 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319004    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 20:19:46.322581 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319007    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 20:19:46.322581 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319011    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 20:19:46.322581 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319014    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 20:19:46.322581 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319017    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 20:19:46.322581 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319020    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 20:19:46.322581 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319022    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 20:19:46.322581 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319025    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 20:19:46.322581 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319027    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 20:19:46.322581 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319030    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 20:19:46.322581 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319032    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 20:19:46.322581 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319035    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 20:19:46.322581 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319037    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 20:19:46.322581 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319040    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 20:19:46.322581 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319042    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 20:19:46.322581 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319044    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 20:19:46.322581 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319048    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 20:19:46.323104 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319051    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 20:19:46.323104 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319053    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 20:19:46.323104 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319056    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 20:19:46.323104 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319059    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 20:19:46.323104 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319061    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 20:19:46.323104 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319064    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 20:19:46.323104 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319066    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 20:19:46.323104 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319069    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 20:19:46.323104 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319071    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 20:19:46.323104 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319074    2566 feature_gate.go:328] unrecognized feature gate: Example2
May 20 20:19:46.323104 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319076    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 20:19:46.323104 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:46.319079    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 20:19:46.323104 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.319083    2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 20:19:46.323104 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.321456    2566 server.go:962] "Client rotation is on, will bootstrap in background"
May 20 20:19:46.323462 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.323293    2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 20 20:19:46.324307 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.324294    2566 server.go:1019] "Starting client certificate rotation"
May 20 20:19:46.324410 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.324397    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 20 20:19:46.324443 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.324429    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 20 20:19:46.350188 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.350171    2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 20 20:19:46.354255 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.354237    2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 20 20:19:46.372053 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.372033    2566 log.go:25] "Validated CRI v1 runtime API"
May 20 20:19:46.376470 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.376451    2566 log.go:25] "Validated CRI v1 image API"
May 20 20:19:46.377771 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.377757    2566 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 20 20:19:46.381637 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.381620    2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 20 20:19:46.384375 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.384354    2566 fs.go:135] Filesystem UUIDs: map[1731c99e-792b-4b34-8c8e-79daf70c1329:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c6ae85d5-5c08-4dfa-82b4-cabc537ec0fa:/dev/nvme0n1p3]
May 20 20:19:46.384430 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.384374    2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 20 20:19:46.388575 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.388475    2566 manager.go:217] Machine: {Timestamp:2026-05-20 20:19:46.388011841 +0000 UTC m=+0.419177659 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3089747 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ac5a6511f8504bd0a5797d2f8f7a3 SystemUUID:ec2ac5a6-511f-8504-bd0a-5797d2f8f7a3 BootID:6c6602ab-aeb9-4e2b-9624-484b42c7f71c Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c6:04:a2:46:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c6:04:a2:46:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:0d:11:b9:c4:95 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 20 20:19:46.389416 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.389405    2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 20 20:19:46.389523 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.389511    2566 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 20 20:19:46.391729 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.391708    2566 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 20 20:19:46.391857 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.391732    2566 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-75.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 20 20:19:46.391925 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.391867    2566 topology_manager.go:138] "Creating topology manager with none policy"
May 20 20:19:46.391925 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.391875    2566 container_manager_linux.go:306] "Creating device plugin manager"
May 20 20:19:46.391925 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.391882    2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 20 20:19:46.392750 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.392740    2566 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 20 20:19:46.394398 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.394387    2566 state_mem.go:36] "Initialized new in-memory state store"
May 20 20:19:46.394635 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.394624    2566 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 20 20:19:46.396781 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.396771    2566 kubelet.go:491] "Attempting to sync node with API server"
May 20 20:19:46.396815 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.396786    2566 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 20 20:19:46.396815 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.396798    2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 20 20:19:46.396815 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.396806    2566 kubelet.go:397] "Adding apiserver pod source"
May 20 20:19:46.396815 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.396815    2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 20 20:19:46.397928 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.397916    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 20 20:19:46.397982 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.397934    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 20 20:19:46.401916 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.401877    2566 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 20 20:19:46.404218 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.404201    2566 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 20 20:19:46.405095 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.405083    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 20 20:19:46.405145 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.405100    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 20 20:19:46.405145 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.405107    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 20 20:19:46.405145 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.405115    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 20 20:19:46.405145 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.405125    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 20 20:19:46.405145 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.405131    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 20 20:19:46.405145 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.405137    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 20 20:19:46.405145 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.405142    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 20 20:19:46.405321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.405150    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 20 20:19:46.405321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.405156    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 20 20:19:46.405321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.405165    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 20 20:19:46.405404 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.405368    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 20 20:19:46.406860 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.406846    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 20 20:19:46.406860 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.406858    2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 20 20:19:46.408705 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:46.408679    2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 20 20:19:46.408773 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:46.408725    2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-75.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 20 20:19:46.410068 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.410056    2566 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 20 20:19:46.410130 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.410089    2566 server.go:1295] "Started kubelet"
May 20 20:19:46.410176 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.410166    2566 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-75.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 20 20:19:46.410212 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.410150    2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 20 20:19:46.410269 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.410231    2566 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 20 20:19:46.410298 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.410285    2566 server_v1.go:47] "podresources" method="list" useActivePods=true
May 20 20:19:46.410730 ip-10-0-129-75 systemd[1]: Started Kubernetes Kubelet.
May 20 20:19:46.411375 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.411260    2566 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 20 20:19:46.412643 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.412631    2566 server.go:317] "Adding debug handlers to kubelet server"
May 20 20:19:46.416266 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.416243    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 20 20:19:46.416694 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.416677    2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 20 20:19:46.416768 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.416762    2566 volume_manager.go:295] "The desired_state_of_world populator starts"
May 20 20:19:46.416812 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.416774    2566 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 20 20:19:46.416857 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.416812    2566 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 20 20:19:46.417025 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.417011    2566 reconstruct.go:97] "Volume reconstruction finished"
May 20 20:19:46.417025 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.417020    2566 reconciler.go:26] "Reconciler: start to sync state"
May 20 20:19:46.417467 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:46.417441    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-75.ec2.internal\" not found"
May 20 20:19:46.419223 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.419166    2566 factory.go:55] Registering systemd factory
May 20 20:19:46.419223 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.419184    2566 factory.go:223] Registration of the systemd container factory successfully
May 20 20:19:46.419427 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.419411    2566 factory.go:153] Registering CRI-O factory
May 20 20:19:46.419427 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.419429    2566 factory.go:223] Registration of the crio container factory successfully
May 20 20:19:46.419568 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.419531    2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 20 20:19:46.419624 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.419578    2566 factory.go:103] Registering Raw factory
May 20 20:19:46.419624 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.419600    2566 manager.go:1196] Started watching for new ooms in manager
May 20 20:19:46.420133 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.420116    2566 manager.go:319] Starting recovery of all containers
May 20 20:19:46.420580 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:46.418847    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-75.ec2.internal.18b15f8cddd8768f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-75.ec2.internal,UID:ip-10-0-129-75.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-75.ec2.internal,},FirstTimestamp:2026-05-20 20:19:46.410067599 +0000 UTC m=+0.441233418,LastTimestamp:2026-05-20 20:19:46.410067599 +0000 UTC m=+0.441233418,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-75.ec2.internal,}"
May 20 20:19:46.421691 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:46.421122    2566 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 20 20:19:46.423829 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:46.423803    2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-75.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 20 20:19:46.423957 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:46.423936    2566 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 20 20:19:46.432002 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.431984    2566 manager.go:324] Recovery completed
May 20 20:19:46.432570 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.432552    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h6np8"
May 20 20:19:46.436246 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.436234    2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 20:19:46.437742 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.437727    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-75.ec2.internal" event="NodeHasSufficientMemory"
May 20 20:19:46.437809 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.437753    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-75.ec2.internal" event="NodeHasNoDiskPressure"
May 20 20:19:46.437809 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.437763    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-75.ec2.internal" event="NodeHasSufficientPID"
May 20 20:19:46.438232 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.438217    2566 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 20 20:19:46.438278 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.438232    2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 20 20:19:46.438278 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.438249    2566 state_mem.go:36] "Initialized new in-memory state store"
May 20 20:19:46.439753 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:46.439697    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-75.ec2.internal.18b15f8cdf7eb923  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-75.ec2.internal,UID:ip-10-0-129-75.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-75.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-75.ec2.internal,},FirstTimestamp:2026-05-20 20:19:46.437740835 +0000 UTC m=+0.468906652,LastTimestamp:2026-05-20 20:19:46.437740835 +0000 UTC m=+0.468906652,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-75.ec2.internal,}"
May 20 20:19:46.440633 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.440616    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h6np8"
May 20 20:19:46.441417 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.441404    2566 policy_none.go:49] "None policy: Start"
May 20 20:19:46.441488 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.441420    2566 memory_manager.go:186] "Starting memorymanager" policy="None"
May 20 20:19:46.441488 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.441430    2566 state_mem.go:35] "Initializing new in-memory state store"
May 20 20:19:46.481443 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.481429    2566 manager.go:341] "Starting Device Plugin manager"
May 20 20:19:46.503686 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:46.481496    2566 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 20 20:19:46.503686 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.481510    2566 server.go:85] "Starting device plugin registration server"
May 20 20:19:46.503686 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.481734    2566 eviction_manager.go:189] "Eviction manager: starting control loop"
May 20 20:19:46.503686 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.481746    2566 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 20 20:19:46.503686 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.481835    2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 20 20:19:46.503686 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.481916    2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 20 20:19:46.503686 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.481925    2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 20 20:19:46.503686 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:46.482398    2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 20 20:19:46.503686 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:46.482434    2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-75.ec2.internal\" not found"
May 20 20:19:46.550836 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.550752    2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 20 20:19:46.552001 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.551983    2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 20 20:19:46.552087 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.552016    2566 status_manager.go:230] "Starting to sync pod status with apiserver"
May 20 20:19:46.552087 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.552041    2566 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 20 20:19:46.552087 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.552051    2566 kubelet.go:2451] "Starting kubelet main sync loop"
May 20 20:19:46.552222 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:46.552100    2566 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 20 20:19:46.554468 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.554442    2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:19:46.582849 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.582819    2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 20:19:46.583945 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.583929    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-75.ec2.internal" event="NodeHasSufficientMemory"
May 20 20:19:46.584023 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.583959    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-75.ec2.internal" event="NodeHasNoDiskPressure"
May 20 20:19:46.584023 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.583969    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-75.ec2.internal" event="NodeHasSufficientPID"
May 20 20:19:46.584023 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.583999    2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-75.ec2.internal"
May 20 20:19:46.597321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.597302    2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-75.ec2.internal"
May 20 20:19:46.597378 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:46.597326    2566 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-75.ec2.internal\": node \"ip-10-0-129-75.ec2.internal\" not found"
May 20 20:19:46.633971 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:46.633929    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-75.ec2.internal\" not found"
May 20 20:19:46.652790 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.652753    2566 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-75.ec2.internal"]
May 20 20:19:46.652870 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.652831    2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 20:19:46.653739 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.653723    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-75.ec2.internal" event="NodeHasSufficientMemory"
May 20 20:19:46.653802 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.653750    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-75.ec2.internal" event="NodeHasNoDiskPressure"
May 20 20:19:46.653802 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.653759    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-75.ec2.internal" event="NodeHasSufficientPID"
May 20 20:19:46.656082 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.656069    2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 20:19:46.656226 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.656214    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal"
May 20 20:19:46.656263 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.656243    2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 20:19:46.656802 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.656780    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-75.ec2.internal" event="NodeHasSufficientMemory"
May 20 20:19:46.656914 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.656808    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-75.ec2.internal" event="NodeHasNoDiskPressure"
May 20 20:19:46.656914 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.656822    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-75.ec2.internal" event="NodeHasSufficientPID"
May 20 20:19:46.656914 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.656782    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-75.ec2.internal" event="NodeHasSufficientMemory"
May 20 20:19:46.657029 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.656921    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-75.ec2.internal" event="NodeHasNoDiskPressure"
May 20 20:19:46.657029 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.656943    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-75.ec2.internal" event="NodeHasSufficientPID"
May 20 20:19:46.659152 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.659135    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-75.ec2.internal"
May 20 20:19:46.659245 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.659158    2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 20:19:46.659873 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.659855    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-75.ec2.internal" event="NodeHasSufficientMemory"
May 20 20:19:46.659971 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.659877    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-75.ec2.internal" event="NodeHasNoDiskPressure"
May 20 20:19:46.659971 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.659887    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-75.ec2.internal" event="NodeHasSufficientPID"
May 20 20:19:46.678627 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:46.678604    2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-75.ec2.internal\" not found" node="ip-10-0-129-75.ec2.internal"
May 20 20:19:46.683080 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:46.683063    2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-75.ec2.internal\" not found" node="ip-10-0-129-75.ec2.internal"
May 20 20:19:46.718199 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.718177    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa81253f2cf6f11f2c24641000c0c71d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal\" (UID: \"aa81253f2cf6f11f2c24641000c0c71d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal"
May 20 20:19:46.718314 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.718210    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa81253f2cf6f11f2c24641000c0c71d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal\" (UID: \"aa81253f2cf6f11f2c24641000c0c71d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal"
May 20 20:19:46.718314 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.718228    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/acc2ea8a697df6df18f7e95b5c7362f2-config\") pod \"kube-apiserver-proxy-ip-10-0-129-75.ec2.internal\" (UID: \"acc2ea8a697df6df18f7e95b5c7362f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-75.ec2.internal"
May 20 20:19:46.734652 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:46.734629    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-75.ec2.internal\" not found"
May 20 20:19:46.818536 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.818445    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa81253f2cf6f11f2c24641000c0c71d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal\" (UID: \"aa81253f2cf6f11f2c24641000c0c71d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal"
May 20 20:19:46.818536 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.818509    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa81253f2cf6f11f2c24641000c0c71d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal\" (UID: \"aa81253f2cf6f11f2c24641000c0c71d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal"
May 20 20:19:46.818717 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.818540    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa81253f2cf6f11f2c24641000c0c71d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal\" (UID: \"aa81253f2cf6f11f2c24641000c0c71d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal"
May 20 20:19:46.818717 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.818586    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa81253f2cf6f11f2c24641000c0c71d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal\" (UID: \"aa81253f2cf6f11f2c24641000c0c71d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal"
May 20 20:19:46.818717 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.818549    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/acc2ea8a697df6df18f7e95b5c7362f2-config\") pod \"kube-apiserver-proxy-ip-10-0-129-75.ec2.internal\" (UID: \"acc2ea8a697df6df18f7e95b5c7362f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-75.ec2.internal"
May 20 20:19:46.818717 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.818600    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/acc2ea8a697df6df18f7e95b5c7362f2-config\") pod \"kube-apiserver-proxy-ip-10-0-129-75.ec2.internal\" (UID: \"acc2ea8a697df6df18f7e95b5c7362f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-75.ec2.internal"
May 20 20:19:46.835557 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:46.835534    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-75.ec2.internal\" not found"
May 20 20:19:46.936304 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:46.936272    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-75.ec2.internal\" not found"
May 20 20:19:46.981461 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.981437    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal"
May 20 20:19:46.985338 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:46.985316    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-75.ec2.internal"
May 20 20:19:47.037170 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:47.037150    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-75.ec2.internal\" not found"
May 20 20:19:47.137655 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:47.137595    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-75.ec2.internal\" not found"
May 20 20:19:47.238059 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:47.238035    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-75.ec2.internal\" not found"
May 20 20:19:47.291346 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:47.291322    2566 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:19:47.323776 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:47.323757    2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 20 20:19:47.324349 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:47.323872    2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 20 20:19:47.324349 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:47.323914    2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 20 20:19:47.338922 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:47.338884    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-75.ec2.internal\" not found"
May 20 20:19:47.416797 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:47.416777    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 20 20:19:47.428125 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:47.428104    2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 20 20:19:47.438996 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:47.438971    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-75.ec2.internal\" not found"
May 20 20:19:47.442125 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:47.442099    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-19 20:14:46 +0000 UTC" deadline="2027-11-02 02:12:58.272759585 +0000 UTC"
May 20 20:19:47.442193 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:47.442125    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12725h53m10.830638096s"
May 20 20:19:47.451723 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:47.451705    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8gt7q"
May 20 20:19:47.458623 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:47.458509    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8gt7q"
May 20 20:19:47.523187 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:47.523168    2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:19:47.536144 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:47.536117    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc2ea8a697df6df18f7e95b5c7362f2.slice/crio-c3e3474c8b9ec07df9045e1d271c1ca9177866f3e0cd88e1640a8fb56accf762 WatchSource:0}: Error finding container c3e3474c8b9ec07df9045e1d271c1ca9177866f3e0cd88e1640a8fb56accf762: Status 404 returned error can't find the container with id c3e3474c8b9ec07df9045e1d271c1ca9177866f3e0cd88e1640a8fb56accf762
May 20 20:19:47.536361 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:47.536338    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa81253f2cf6f11f2c24641000c0c71d.slice/crio-e0ff5c67f1a87e596c7a47a0287aa6785cbce6c1c00d544db21469421ff57392 WatchSource:0}: Error finding container e0ff5c67f1a87e596c7a47a0287aa6785cbce6c1c00d544db21469421ff57392: Status 404 returned error can't find the container with id e0ff5c67f1a87e596c7a47a0287aa6785cbce6c1c00d544db21469421ff57392
May 20 20:19:47.539072 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:47.539051    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-75.ec2.internal\" not found"
May 20 20:19:47.539756 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:47.539741    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 20:19:47.557034 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:47.556991    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal" event={"ID":"aa81253f2cf6f11f2c24641000c0c71d","Type":"ContainerStarted","Data":"e0ff5c67f1a87e596c7a47a0287aa6785cbce6c1c00d544db21469421ff57392"}
May 20 20:19:47.557906 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:47.557874    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-75.ec2.internal" event={"ID":"acc2ea8a697df6df18f7e95b5c7362f2","Type":"ContainerStarted","Data":"c3e3474c8b9ec07df9045e1d271c1ca9177866f3e0cd88e1640a8fb56accf762"}
May 20 20:19:47.639331 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:47.639311    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-75.ec2.internal\" not found"
May 20 20:19:47.739850 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:47.739774    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-75.ec2.internal\" not found"
May 20 20:19:47.840185 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:47.840157    2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-75.ec2.internal\" not found"
May 20 20:19:47.937560 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:47.937535    2566 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:19:48.017957 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.017925    2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal"
May 20 20:19:48.033886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.033751    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 20:19:48.034936 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.034875    2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-75.ec2.internal"
May 20 20:19:48.044174 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.044155    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 20:19:48.325062 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.324991    2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:19:48.397556 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.397523    2566 apiserver.go:52] "Watching apiserver"
May 20 20:19:48.406020 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.405997    2566 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 20 20:19:48.408705 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.408677    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-tqwsz","kube-system/kube-apiserver-proxy-ip-10-0-129-75.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm","openshift-multus/multus-additional-cni-plugins-tpmmg","openshift-multus/network-metrics-daemon-lpcq8","openshift-ovn-kubernetes/ovnkube-node-njrxw","openshift-cluster-node-tuning-operator/tuned-mfcvq","openshift-image-registry/node-ca-rpxfx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal","openshift-multus/multus-q7zzq","openshift-network-diagnostics/network-check-target-gggx7","openshift-network-operator/iptables-alerter-7hj86"]
May 20 20:19:48.411445 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.411422    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tqwsz"
May 20 20:19:48.413713 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.413692    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.414363 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.414305    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 20 20:19:48.414468 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.414455    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zlvg5\""
May 20 20:19:48.414718 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.414700    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 20 20:19:48.416145 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.416114    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 20 20:19:48.416260 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.416159    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 20 20:19:48.416474 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.416455    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 20 20:19:48.416627 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.416604    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sdbng\""
May 20 20:19:48.417982 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.417960    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.418072 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.418052    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:19:48.418128 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:48.418110    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpcq8" podUID="58397932-927e-4bcb-8ccd-3ba17d08a9f0"
May 20 20:19:48.420390 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.420371    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.420476 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.420454    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 20 20:19:48.420476 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.420461    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 20 20:19:48.420836 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.420818    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 20 20:19:48.420836 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.420829    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 20 20:19:48.420988 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.420834    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 20 20:19:48.421159 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.421143    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mg6lw\""
May 20 20:19:48.422615 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.422596    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.424622 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.424597    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 20 20:19:48.424937 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.424923    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rpxfx"
May 20 20:19:48.426123 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.426096    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 20 20:19:48.426208 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.426161    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 20 20:19:48.426693 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.426658    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tjbwn\""
May 20 20:19:48.426847 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.426830    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 20 20:19:48.427061 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.427040    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 20 20:19:48.429559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.427214    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.429559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.427258    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a3a7768-26b3-4d23-831a-582df6968f4c-sys-fs\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.429559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.427272    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 20 20:19:48.429559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.427390    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 20 20:19:48.429559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.427411    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cddff\""
May 20 20:19:48.429559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.427290    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-os-release\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.429559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.427836    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 20 20:19:48.429559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.427856    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.429559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.427929    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh96n\" (UniqueName: \"kubernetes.io/projected/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-kube-api-access-qh96n\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.429559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.427984    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 20 20:19:48.429559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.427992    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11b13fe0-9674-4919-ad3a-65e936aebf4d-agent-certs\") pod \"konnectivity-agent-tqwsz\" (UID: \"11b13fe0-9674-4919-ad3a-65e936aebf4d\") " pod="kube-system/konnectivity-agent-tqwsz"
May 20 20:19:48.429559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.428052    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11b13fe0-9674-4919-ad3a-65e936aebf4d-konnectivity-ca\") pod \"konnectivity-agent-tqwsz\" (UID: \"11b13fe0-9674-4919-ad3a-65e936aebf4d\") " pod="kube-system/konnectivity-agent-tqwsz"
May 20 20:19:48.429559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.428120    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a3a7768-26b3-4d23-831a-582df6968f4c-device-dir\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.429559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.428158    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pc2v\" (UniqueName: \"kubernetes.io/projected/6a3a7768-26b3-4d23-831a-582df6968f4c-kube-api-access-9pc2v\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.429559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.428229    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-system-cni-dir\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.429559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.428284    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 20 20:19:48.429559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.428299    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-cnibin\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.429559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.428374    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 20 20:19:48.429559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.428402    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-cni-binary-copy\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.429559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.428593    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jkbw6\""
May 20 20:19:48.430644 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.428597    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a3a7768-26b3-4d23-831a-582df6968f4c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.430644 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.428777    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a3a7768-26b3-4d23-831a-582df6968f4c-socket-dir\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.430644 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.428814    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a3a7768-26b3-4d23-831a-582df6968f4c-registration-dir\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.430644 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.428845    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a3a7768-26b3-4d23-831a-582df6968f4c-etc-selinux\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.430644 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.428885    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs\") pod \"network-metrics-daemon-lpcq8\" (UID: \"58397932-927e-4bcb-8ccd-3ba17d08a9f0\") " pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:19:48.430644 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.428933    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnv8c\" (UniqueName: \"kubernetes.io/projected/58397932-927e-4bcb-8ccd-3ba17d08a9f0-kube-api-access-tnv8c\") pod \"network-metrics-daemon-lpcq8\" (UID: \"58397932-927e-4bcb-8ccd-3ba17d08a9f0\") " pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:19:48.430644 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.428966    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.430644 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.430362    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.432552 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.432532    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 20 20:19:48.432637 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.432621    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2cxxk\""
May 20 20:19:48.432996 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.432978    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:19:48.433084 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:48.433062    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gggx7" podUID="e490d1ca-0378-490c-8a3c-52cb7cc2e4fb"
May 20 20:19:48.435092 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.435074    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7hj86"
May 20 20:19:48.437550 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.437530    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 20 20:19:48.437828 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.437811    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 20 20:19:48.437908 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.437818    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 20 20:19:48.438289 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.438274    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-csj7g\""
May 20 20:19:48.459965 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.459941    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 20:14:47 +0000 UTC" deadline="2027-12-29 18:44:42.152614932 +0000 UTC"
May 20 20:19:48.459965 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.459964    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14110h24m53.692653285s"
May 20 20:19:48.518018 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.517991    2566 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 20 20:19:48.529748 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.529721    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.529878 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.529756    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-multus-cni-dir\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.529878 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.529787    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62a925ec-94bc-4c35-8971-b1598fc77b67-ovnkube-script-lib\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.529878 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.529834    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-host-var-lib-kubelet\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.529878 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.529871    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-hostroot\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.530084 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.529907    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a3a7768-26b3-4d23-831a-582df6968f4c-sys-fs\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.530084 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.529944    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.530084 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.529954    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.530084 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.529966    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-sysctl-conf\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.530084 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.529988    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-host\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.530084 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.529984    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a3a7768-26b3-4d23-831a-582df6968f4c-sys-fs\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.530084 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530032    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-cnibin\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.530084 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530079    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-host-run-netns\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.530414 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530110    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11b13fe0-9674-4919-ad3a-65e936aebf4d-agent-certs\") pod \"konnectivity-agent-tqwsz\" (UID: \"11b13fe0-9674-4919-ad3a-65e936aebf4d\") " pod="kube-system/konnectivity-agent-tqwsz"
May 20 20:19:48.530414 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530132    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-system-cni-dir\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.530414 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530186    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4brn\" (UniqueName: \"kubernetes.io/projected/8eed8f09-7a8b-414c-b186-0733b5881f70-kube-api-access-p4brn\") pod \"node-ca-rpxfx\" (UID: \"8eed8f09-7a8b-414c-b186-0733b5881f70\") " pod="openshift-image-registry/node-ca-rpxfx"
May 20 20:19:48.530414 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530247    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-system-cni-dir\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.530414 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530278    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-host-var-lib-cni-bin\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.530414 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530326    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-run-systemd\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.530414 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530354    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc2xb\" (UniqueName: \"kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb\") pod \"network-check-target-gggx7\" (UID: \"e490d1ca-0378-490c-8a3c-52cb7cc2e4fb\") " pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:19:48.530414 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530381    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-sysconfig\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.530739 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530425    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-systemd\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.530739 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530450    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-var-lib-openvswitch\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.530739 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530495    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62a925ec-94bc-4c35-8971-b1598fc77b67-env-overrides\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.530739 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530518    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-sys\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.530739 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530538    2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 20 20:19:48.530739 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530553    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-host-var-lib-cni-multus\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.530739 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530604    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-etc-kubernetes\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.530739 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530610    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.530739 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530628    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-slash\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.530739 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530653    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-cni-netd\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.530739 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530677    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.530739 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530704    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a1e2f844-8c91-4f30-8df0-1c9cab84e2a1-iptables-alerter-script\") pod \"iptables-alerter-7hj86\" (UID: \"a1e2f844-8c91-4f30-8df0-1c9cab84e2a1\") " pod="openshift-network-operator/iptables-alerter-7hj86"
May 20 20:19:48.530739 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530730    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-sysctl-d\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.531351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530755    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwljm\" (UniqueName: \"kubernetes.io/projected/a1e2f844-8c91-4f30-8df0-1c9cab84e2a1-kube-api-access-qwljm\") pod \"iptables-alerter-7hj86\" (UID: \"a1e2f844-8c91-4f30-8df0-1c9cab84e2a1\") " pod="openshift-network-operator/iptables-alerter-7hj86"
May 20 20:19:48.531351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530783    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11b13fe0-9674-4919-ad3a-65e936aebf4d-konnectivity-ca\") pod \"konnectivity-agent-tqwsz\" (UID: \"11b13fe0-9674-4919-ad3a-65e936aebf4d\") " pod="kube-system/konnectivity-agent-tqwsz"
May 20 20:19:48.531351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530805    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-cnibin\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.531351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530831    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-cni-binary-copy\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.531351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530856    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tnv8c\" (UniqueName: \"kubernetes.io/projected/58397932-927e-4bcb-8ccd-3ba17d08a9f0-kube-api-access-tnv8c\") pod \"network-metrics-daemon-lpcq8\" (UID: \"58397932-927e-4bcb-8ccd-3ba17d08a9f0\") " pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:19:48.531351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530867    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-cnibin\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.531351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530881    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-kubelet\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.531351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.530955    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-run-ovn\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.531351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531084    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a3a7768-26b3-4d23-831a-582df6968f4c-registration-dir\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.531351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531139    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a3a7768-26b3-4d23-831a-582df6968f4c-registration-dir\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.531351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531163    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-host-run-k8s-cni-cncf-io\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.531351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531191    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-systemd-units\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.531351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531224    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-run-netns\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.531351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531255    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.531351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531280    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8eed8f09-7a8b-414c-b186-0733b5881f70-host\") pod \"node-ca-rpxfx\" (UID: \"8eed8f09-7a8b-414c-b186-0733b5881f70\") " pod="openshift-image-registry/node-ca-rpxfx"
May 20 20:19:48.531351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531297    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-system-cni-dir\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.531351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531315    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-os-release\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.532124 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531339    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-cni-binary-copy\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.532124 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531356    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-cni-binary-copy\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.532124 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531363    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11b13fe0-9674-4919-ad3a-65e936aebf4d-konnectivity-ca\") pod \"konnectivity-agent-tqwsz\" (UID: \"11b13fe0-9674-4919-ad3a-65e936aebf4d\") " pod="kube-system/konnectivity-agent-tqwsz"
May 20 20:19:48.532124 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531365    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb46b\" (UniqueName: \"kubernetes.io/projected/62a925ec-94bc-4c35-8971-b1598fc77b67-kube-api-access-wb46b\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.532124 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531441    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-os-release\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.532124 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531480    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qh96n\" (UniqueName: \"kubernetes.io/projected/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-kube-api-access-qh96n\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.532124 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531531    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-os-release\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.532124 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531576    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a56c0b09-2443-4841-9b57-c3cf818995f3-tmp\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.532124 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531673    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-run-ovn-kubernetes\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.532124 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531713    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a3a7768-26b3-4d23-831a-582df6968f4c-device-dir\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.532124 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531743    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9pc2v\" (UniqueName: \"kubernetes.io/projected/6a3a7768-26b3-4d23-831a-582df6968f4c-kube-api-access-9pc2v\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.532124 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531763    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.532124 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531772    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs\") pod \"network-metrics-daemon-lpcq8\" (UID: \"58397932-927e-4bcb-8ccd-3ba17d08a9f0\") " pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:19:48.532124 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531777    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a3a7768-26b3-4d23-831a-582df6968f4c-device-dir\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.532124 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531801    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-tuned\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.532124 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531822    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd8l9\" (UniqueName: \"kubernetes.io/projected/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-kube-api-access-wd8l9\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.532124 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:48.531909    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:19:48.532859 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531921    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-run-openvswitch\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.532859 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.531962    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-node-log\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.532859 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:48.532011    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs podName:58397932-927e-4bcb-8ccd-3ba17d08a9f0 nodeName:}" failed. No retries permitted until 2026-05-20 20:19:49.031982433 +0000 UTC m=+3.063148242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs") pod "network-metrics-daemon-lpcq8" (UID: "58397932-927e-4bcb-8ccd-3ba17d08a9f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:19:48.532859 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532091    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-host-run-multus-certs\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.532859 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532123    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a3a7768-26b3-4d23-831a-582df6968f4c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.532859 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532148    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a3a7768-26b3-4d23-831a-582df6968f4c-socket-dir\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.532859 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532173    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a3a7768-26b3-4d23-831a-582df6968f4c-etc-selinux\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.532859 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532252    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a3a7768-26b3-4d23-831a-582df6968f4c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.532859 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532281    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-modprobe-d\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.532859 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532298    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a3a7768-26b3-4d23-831a-582df6968f4c-etc-selinux\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.532859 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532308    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8eed8f09-7a8b-414c-b186-0733b5881f70-serviceca\") pod \"node-ca-rpxfx\" (UID: \"8eed8f09-7a8b-414c-b186-0733b5881f70\") " pod="openshift-image-registry/node-ca-rpxfx"
May 20 20:19:48.532859 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532339    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-cni-bin\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.532859 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532364    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a3a7768-26b3-4d23-831a-582df6968f4c-socket-dir\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.532859 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532368    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62a925ec-94bc-4c35-8971-b1598fc77b67-ovnkube-config\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.532859 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532413    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-run\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.532859 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532460    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-var-lib-kubelet\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.533551 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532489    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2772\" (UniqueName: \"kubernetes.io/projected/a56c0b09-2443-4841-9b57-c3cf818995f3-kube-api-access-f2772\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.533551 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532520    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-etc-openvswitch\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.533551 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532542    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-log-socket\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.533551 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532568    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-lib-modules\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.533551 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532611    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-multus-daemon-config\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.533551 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532635    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62a925ec-94bc-4c35-8971-b1598fc77b67-ovn-node-metrics-cert\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.533551 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532670    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-kubernetes\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.533551 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532716    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-multus-conf-dir\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.533551 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532747    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1e2f844-8c91-4f30-8df0-1c9cab84e2a1-host-slash\") pod \"iptables-alerter-7hj86\" (UID: \"a1e2f844-8c91-4f30-8df0-1c9cab84e2a1\") " pod="openshift-network-operator/iptables-alerter-7hj86"
May 20 20:19:48.533551 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.532815    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-multus-socket-dir-parent\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.534237 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.534032    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11b13fe0-9674-4919-ad3a-65e936aebf4d-agent-certs\") pod \"konnectivity-agent-tqwsz\" (UID: \"11b13fe0-9674-4919-ad3a-65e936aebf4d\") " pod="kube-system/konnectivity-agent-tqwsz"
May 20 20:19:48.540558 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.540519    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh96n\" (UniqueName: \"kubernetes.io/projected/203d6be2-2ddd-48be-9d18-8a17fa95d2c3-kube-api-access-qh96n\") pod \"multus-additional-cni-plugins-tpmmg\" (UID: \"203d6be2-2ddd-48be-9d18-8a17fa95d2c3\") " pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.541059 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.541041    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pc2v\" (UniqueName: \"kubernetes.io/projected/6a3a7768-26b3-4d23-831a-582df6968f4c-kube-api-access-9pc2v\") pod \"aws-ebs-csi-driver-node-wdzvm\" (UID: \"6a3a7768-26b3-4d23-831a-582df6968f4c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.541159 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.541083    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnv8c\" (UniqueName: \"kubernetes.io/projected/58397932-927e-4bcb-8ccd-3ba17d08a9f0-kube-api-access-tnv8c\") pod \"network-metrics-daemon-lpcq8\" (UID: \"58397932-927e-4bcb-8ccd-3ba17d08a9f0\") " pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:19:48.634020 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.633930    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-var-lib-kubelet\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.634020 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.633981    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2772\" (UniqueName: \"kubernetes.io/projected/a56c0b09-2443-4841-9b57-c3cf818995f3-kube-api-access-f2772\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.634020 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634008    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-etc-openvswitch\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.634300 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634034    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-log-socket\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.634300 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634054    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-var-lib-kubelet\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.634300 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634060    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-lib-modules\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.634300 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634116    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-multus-daemon-config\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.634300 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634142    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62a925ec-94bc-4c35-8971-b1598fc77b67-ovn-node-metrics-cert\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.634300 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634159    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-kubernetes\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.634300 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634173    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-multus-conf-dir\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.634300 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634181    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-lib-modules\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.634300 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634189    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1e2f844-8c91-4f30-8df0-1c9cab84e2a1-host-slash\") pod \"iptables-alerter-7hj86\" (UID: \"a1e2f844-8c91-4f30-8df0-1c9cab84e2a1\") " pod="openshift-network-operator/iptables-alerter-7hj86"
May 20 20:19:48.634300 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634215    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-multus-socket-dir-parent\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.634300 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634238    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-multus-cni-dir\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.634300 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634254    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62a925ec-94bc-4c35-8971-b1598fc77b67-ovnkube-script-lib\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.634300 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634297    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-host-var-lib-kubelet\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.634875 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634323    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-hostroot\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.634875 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634322    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-kubernetes\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.634875 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634328    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-etc-openvswitch\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.634875 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634369    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-log-socket\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.634875 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634370    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-sysctl-conf\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.634875 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634398    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-multus-conf-dir\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.634875 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634414    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-host\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.634875 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634422    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-hostroot\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.634875 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634444    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-cnibin\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.634875 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634479    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-host-run-netns\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.634875 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634491    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-multus-socket-dir-parent\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.634875 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634498    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-host\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.634875 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634505    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p4brn\" (UniqueName: \"kubernetes.io/projected/8eed8f09-7a8b-414c-b186-0733b5881f70-kube-api-access-p4brn\") pod \"node-ca-rpxfx\" (UID: \"8eed8f09-7a8b-414c-b186-0733b5881f70\") " pod="openshift-image-registry/node-ca-rpxfx"
May 20 20:19:48.634875 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634450    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-host-var-lib-kubelet\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.634875 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634537    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-host-var-lib-cni-bin\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.634875 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634548    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-cnibin\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.634875 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634554    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-sysctl-conf\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.634875 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634559    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-host-run-netns\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.635672 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634562    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-run-systemd\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.635672 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634597    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2xb\" (UniqueName: \"kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb\") pod \"network-check-target-gggx7\" (UID: \"e490d1ca-0378-490c-8a3c-52cb7cc2e4fb\") " pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:19:48.635672 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634623    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-sysconfig\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.635672 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634648    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-systemd\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.635672 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634673    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-var-lib-openvswitch\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.635672 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634700    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62a925ec-94bc-4c35-8971-b1598fc77b67-env-overrides\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.635672 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634600    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-run-systemd\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.635672 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634758    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-multus-cni-dir\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.635672 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634765    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-sysconfig\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.635672 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634765    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-systemd\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.635672 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634792    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-sys\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.635672 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634625    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-host-var-lib-cni-bin\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.635672 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634804    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-var-lib-openvswitch\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.635672 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634831    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-host-var-lib-cni-multus\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.635672 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634842    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-sys\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.635672 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634844    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62a925ec-94bc-4c35-8971-b1598fc77b67-ovnkube-script-lib\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.635672 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634844    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-multus-daemon-config\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.635672 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634870    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-etc-kubernetes\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.636511 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634968    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-etc-kubernetes\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.636511 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634971    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1e2f844-8c91-4f30-8df0-1c9cab84e2a1-host-slash\") pod \"iptables-alerter-7hj86\" (UID: \"a1e2f844-8c91-4f30-8df0-1c9cab84e2a1\") " pod="openshift-network-operator/iptables-alerter-7hj86"
May 20 20:19:48.636511 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634987    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-slash\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.636511 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635018    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-slash\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.636511 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635020    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-cni-netd\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.636511 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.634887    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-host-var-lib-cni-multus\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.636511 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635048    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.636511 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635076    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a1e2f844-8c91-4f30-8df0-1c9cab84e2a1-iptables-alerter-script\") pod \"iptables-alerter-7hj86\" (UID: \"a1e2f844-8c91-4f30-8df0-1c9cab84e2a1\") " pod="openshift-network-operator/iptables-alerter-7hj86"
May 20 20:19:48.636511 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635101    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-sysctl-d\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.636511 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635105    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.636511 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635128    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwljm\" (UniqueName: \"kubernetes.io/projected/a1e2f844-8c91-4f30-8df0-1c9cab84e2a1-kube-api-access-qwljm\") pod \"iptables-alerter-7hj86\" (UID: \"a1e2f844-8c91-4f30-8df0-1c9cab84e2a1\") " pod="openshift-network-operator/iptables-alerter-7hj86"
May 20 20:19:48.636511 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635140    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-cni-netd\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.636511 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635156    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-kubelet\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.636511 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635181    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-run-ovn\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.636511 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635212    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62a925ec-94bc-4c35-8971-b1598fc77b67-env-overrides\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.636511 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635216    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-host-run-k8s-cni-cncf-io\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.636511 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635248    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-host-run-k8s-cni-cncf-io\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.637321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635266    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-systemd-units\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.637321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635270    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-sysctl-d\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.637321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635289    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-kubelet\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.637321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635294    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-run-netns\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.637321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635311    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-systemd-units\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.637321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635323    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-run-ovn\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.637321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635340    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8eed8f09-7a8b-414c-b186-0733b5881f70-host\") pod \"node-ca-rpxfx\" (UID: \"8eed8f09-7a8b-414c-b186-0733b5881f70\") " pod="openshift-image-registry/node-ca-rpxfx"
May 20 20:19:48.637321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635349    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-run-netns\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.637321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635367    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-system-cni-dir\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.637321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635372    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8eed8f09-7a8b-414c-b186-0733b5881f70-host\") pod \"node-ca-rpxfx\" (UID: \"8eed8f09-7a8b-414c-b186-0733b5881f70\") " pod="openshift-image-registry/node-ca-rpxfx"
May 20 20:19:48.637321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635393    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-os-release\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.637321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635417    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-cni-binary-copy\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.637321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635423    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-system-cni-dir\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.637321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635451    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wb46b\" (UniqueName: \"kubernetes.io/projected/62a925ec-94bc-4c35-8971-b1598fc77b67-kube-api-access-wb46b\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.637321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635481    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a56c0b09-2443-4841-9b57-c3cf818995f3-tmp\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.637321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635487    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-os-release\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.637321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635504    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-run-ovn-kubernetes\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.637321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635563    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-run-ovn-kubernetes\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.638073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635595    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-tuned\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.638073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635615    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wd8l9\" (UniqueName: \"kubernetes.io/projected/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-kube-api-access-wd8l9\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.638073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635630    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-run-openvswitch\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.638073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635651    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-node-log\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.638073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635653    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a1e2f844-8c91-4f30-8df0-1c9cab84e2a1-iptables-alerter-script\") pod \"iptables-alerter-7hj86\" (UID: \"a1e2f844-8c91-4f30-8df0-1c9cab84e2a1\") " pod="openshift-network-operator/iptables-alerter-7hj86"
May 20 20:19:48.638073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635674    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-host-run-multus-certs\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.638073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635704    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-modprobe-d\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.638073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635715    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-node-log\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.638073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635731    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8eed8f09-7a8b-414c-b186-0733b5881f70-serviceca\") pod \"node-ca-rpxfx\" (UID: \"8eed8f09-7a8b-414c-b186-0733b5881f70\") " pod="openshift-image-registry/node-ca-rpxfx"
May 20 20:19:48.638073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635758    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-run-openvswitch\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.638073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635766    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-cni-bin\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.638073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635795    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62a925ec-94bc-4c35-8971-b1598fc77b67-ovnkube-config\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.638073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635830    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-run\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.638073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635861    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-modprobe-d\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.638073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635883    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-cni-binary-copy\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.638073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635927    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a56c0b09-2443-4841-9b57-c3cf818995f3-run\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.638073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635913    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-host-run-multus-certs\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.638073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.635988    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62a925ec-94bc-4c35-8971-b1598fc77b67-host-cni-bin\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.638747 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.636336    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8eed8f09-7a8b-414c-b186-0733b5881f70-serviceca\") pod \"node-ca-rpxfx\" (UID: \"8eed8f09-7a8b-414c-b186-0733b5881f70\") " pod="openshift-image-registry/node-ca-rpxfx"
May 20 20:19:48.638747 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.636452    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62a925ec-94bc-4c35-8971-b1598fc77b67-ovnkube-config\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.638747 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.638319    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62a925ec-94bc-4c35-8971-b1598fc77b67-ovn-node-metrics-cert\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.638747 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.638324    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a56c0b09-2443-4841-9b57-c3cf818995f3-etc-tuned\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.638747 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.638362    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a56c0b09-2443-4841-9b57-c3cf818995f3-tmp\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.641446 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:48.641129    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:19:48.641446 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:48.641154    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:19:48.641446 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:48.641167    2566 projected.go:194] Error preparing data for projected volume kube-api-access-lc2xb for pod openshift-network-diagnostics/network-check-target-gggx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:19:48.641446 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:48.641229    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb podName:e490d1ca-0378-490c-8a3c-52cb7cc2e4fb nodeName:}" failed. No retries permitted until 2026-05-20 20:19:49.141210101 +0000 UTC m=+3.172375924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lc2xb" (UniqueName: "kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb") pod "network-check-target-gggx7" (UID: "e490d1ca-0378-490c-8a3c-52cb7cc2e4fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:19:48.643615 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.643591    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwljm\" (UniqueName: \"kubernetes.io/projected/a1e2f844-8c91-4f30-8df0-1c9cab84e2a1-kube-api-access-qwljm\") pod \"iptables-alerter-7hj86\" (UID: \"a1e2f844-8c91-4f30-8df0-1c9cab84e2a1\") " pod="openshift-network-operator/iptables-alerter-7hj86"
May 20 20:19:48.643718 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.643661    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2772\" (UniqueName: \"kubernetes.io/projected/a56c0b09-2443-4841-9b57-c3cf818995f3-kube-api-access-f2772\") pod \"tuned-mfcvq\" (UID: \"a56c0b09-2443-4841-9b57-c3cf818995f3\") " pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.643844 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.643827    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb46b\" (UniqueName: \"kubernetes.io/projected/62a925ec-94bc-4c35-8971-b1598fc77b67-kube-api-access-wb46b\") pod \"ovnkube-node-njrxw\" (UID: \"62a925ec-94bc-4c35-8971-b1598fc77b67\") " pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.644049 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.644024    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4brn\" (UniqueName: \"kubernetes.io/projected/8eed8f09-7a8b-414c-b186-0733b5881f70-kube-api-access-p4brn\") pod \"node-ca-rpxfx\" (UID: \"8eed8f09-7a8b-414c-b186-0733b5881f70\") " pod="openshift-image-registry/node-ca-rpxfx"
May 20 20:19:48.645150 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.645129    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd8l9\" (UniqueName: \"kubernetes.io/projected/d75886b8-b771-4f7f-b2a1-dd683a5ac8e9-kube-api-access-wd8l9\") pod \"multus-q7zzq\" (UID: \"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9\") " pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.723729 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.723693    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tqwsz"
May 20 20:19:48.731465 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.731443    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm"
May 20 20:19:48.740089 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.740070    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tpmmg"
May 20 20:19:48.745687 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.745670    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:19:48.752262 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.752246    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mfcvq"
May 20 20:19:48.759213 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.759196    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rpxfx"
May 20 20:19:48.766710 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.766697    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q7zzq"
May 20 20:19:48.772169 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:48.772154    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7hj86"
May 20 20:19:49.038252 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:49.038168    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs\") pod \"network-metrics-daemon-lpcq8\" (UID: \"58397932-927e-4bcb-8ccd-3ba17d08a9f0\") " pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:19:49.038415 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:49.038333    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:19:49.038415 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:49.038408    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs podName:58397932-927e-4bcb-8ccd-3ba17d08a9f0 nodeName:}" failed. No retries permitted until 2026-05-20 20:19:50.038388807 +0000 UTC m=+4.069554626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs") pod "network-metrics-daemon-lpcq8" (UID: "58397932-927e-4bcb-8ccd-3ba17d08a9f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:19:49.136104 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:49.136070    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eed8f09_7a8b_414c_b186_0733b5881f70.slice/crio-00142dca3c38c9aaf45e9c5008999bc1fbde807bdb4f9d92b5b77fa7e8a256d7 WatchSource:0}: Error finding container 00142dca3c38c9aaf45e9c5008999bc1fbde807bdb4f9d92b5b77fa7e8a256d7: Status 404 returned error can't find the container with id 00142dca3c38c9aaf45e9c5008999bc1fbde807bdb4f9d92b5b77fa7e8a256d7
May 20 20:19:49.137242 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:49.137130    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62a925ec_94bc_4c35_8971_b1598fc77b67.slice/crio-37f5a9665fe4b3f083b2f5820fbc6041eba44563509af56a6863747380986d0b WatchSource:0}: Error finding container 37f5a9665fe4b3f083b2f5820fbc6041eba44563509af56a6863747380986d0b: Status 404 returned error can't find the container with id 37f5a9665fe4b3f083b2f5820fbc6041eba44563509af56a6863747380986d0b
May 20 20:19:49.138592 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:49.138170    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a3a7768_26b3_4d23_831a_582df6968f4c.slice/crio-0d3ddc4796b7466bfdb491717243cc9599b022de69ee657829b460c9aa10e810 WatchSource:0}: Error finding container 0d3ddc4796b7466bfdb491717243cc9599b022de69ee657829b460c9aa10e810: Status 404 returned error can't find the container with id 0d3ddc4796b7466bfdb491717243cc9599b022de69ee657829b460c9aa10e810
May 20 20:19:49.141966 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:49.141922    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda56c0b09_2443_4841_9b57_c3cf818995f3.slice/crio-1c62f3e6dc64da02ec4373dfdff5181d18a010f209df39b0a16d9f68a6e5bd9e WatchSource:0}: Error finding container 1c62f3e6dc64da02ec4373dfdff5181d18a010f209df39b0a16d9f68a6e5bd9e: Status 404 returned error can't find the container with id 1c62f3e6dc64da02ec4373dfdff5181d18a010f209df39b0a16d9f68a6e5bd9e
May 20 20:19:49.143014 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:49.142991    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b13fe0_9674_4919_ad3a_65e936aebf4d.slice/crio-7dfdf1ea35ff3cda8a0ea0e13260d7726b364e9c2d63d762a7fe03151ec7ec8f WatchSource:0}: Error finding container 7dfdf1ea35ff3cda8a0ea0e13260d7726b364e9c2d63d762a7fe03151ec7ec8f: Status 404 returned error can't find the container with id 7dfdf1ea35ff3cda8a0ea0e13260d7726b364e9c2d63d762a7fe03151ec7ec8f
May 20 20:19:49.143978 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:49.143933    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e2f844_8c91_4f30_8df0_1c9cab84e2a1.slice/crio-086de58b792d06d403104b74a010eac539689c6b82cdcf906a52dddac1a76b0c WatchSource:0}: Error finding container 086de58b792d06d403104b74a010eac539689c6b82cdcf906a52dddac1a76b0c: Status 404 returned error can't find the container with id 086de58b792d06d403104b74a010eac539689c6b82cdcf906a52dddac1a76b0c
May 20 20:19:49.146017 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:49.144882    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd75886b8_b771_4f7f_b2a1_dd683a5ac8e9.slice/crio-e8466766c826bf469cc66cb5af8181db3da35375aebe6d724839cb34d1e3e907 WatchSource:0}: Error finding container e8466766c826bf469cc66cb5af8181db3da35375aebe6d724839cb34d1e3e907: Status 404 returned error can't find the container with id e8466766c826bf469cc66cb5af8181db3da35375aebe6d724839cb34d1e3e907
May 20 20:19:49.146326 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:19:49.146302    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod203d6be2_2ddd_48be_9d18_8a17fa95d2c3.slice/crio-145f8af662a47c6feb32e9eaddc53f0edc0e3b274e126a3792e13d585b0879f7 WatchSource:0}: Error finding container 145f8af662a47c6feb32e9eaddc53f0edc0e3b274e126a3792e13d585b0879f7: Status 404 returned error can't find the container with id 145f8af662a47c6feb32e9eaddc53f0edc0e3b274e126a3792e13d585b0879f7
May 20 20:19:49.239417 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:49.239389    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2xb\" (UniqueName: \"kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb\") pod \"network-check-target-gggx7\" (UID: \"e490d1ca-0378-490c-8a3c-52cb7cc2e4fb\") " pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:19:49.239540 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:49.239524    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:19:49.239585 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:49.239548    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:19:49.239585 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:49.239563    2566 projected.go:194] Error preparing data for projected volume kube-api-access-lc2xb for pod openshift-network-diagnostics/network-check-target-gggx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:19:49.239646 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:49.239611    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb podName:e490d1ca-0378-490c-8a3c-52cb7cc2e4fb nodeName:}" failed. No retries permitted until 2026-05-20 20:19:50.239598203 +0000 UTC m=+4.270764013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lc2xb" (UniqueName: "kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb") pod "network-check-target-gggx7" (UID: "e490d1ca-0378-490c-8a3c-52cb7cc2e4fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:19:49.460120 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:49.460074    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 20:14:47 +0000 UTC" deadline="2027-10-18 00:11:15.209645423 +0000 UTC"
May 20 20:19:49.460120 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:49.460113    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12363h51m25.749536566s"
May 20 20:19:49.484093 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:49.483839    2566 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:19:49.553192 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:49.552618    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:19:49.553192 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:49.552764    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpcq8" podUID="58397932-927e-4bcb-8ccd-3ba17d08a9f0"
May 20 20:19:49.563663 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:49.563124    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tqwsz" event={"ID":"11b13fe0-9674-4919-ad3a-65e936aebf4d","Type":"ContainerStarted","Data":"7dfdf1ea35ff3cda8a0ea0e13260d7726b364e9c2d63d762a7fe03151ec7ec8f"}
May 20 20:19:49.565008 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:49.564944    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm" event={"ID":"6a3a7768-26b3-4d23-831a-582df6968f4c","Type":"ContainerStarted","Data":"0d3ddc4796b7466bfdb491717243cc9599b022de69ee657829b460c9aa10e810"}
May 20 20:19:49.567904 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:49.567123    2566 generic.go:358] "Generic (PLEG): container finished" podID="aa81253f2cf6f11f2c24641000c0c71d" containerID="424703c3288b0daccb757c7046c115b54e6015ba09f2fa1da309445d5845ac07" exitCode=0
May 20 20:19:49.567904 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:49.567678    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal" event={"ID":"aa81253f2cf6f11f2c24641000c0c71d","Type":"ContainerDied","Data":"424703c3288b0daccb757c7046c115b54e6015ba09f2fa1da309445d5845ac07"}
May 20 20:19:49.570554 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:49.570179    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7hj86" event={"ID":"a1e2f844-8c91-4f30-8df0-1c9cab84e2a1","Type":"ContainerStarted","Data":"086de58b792d06d403104b74a010eac539689c6b82cdcf906a52dddac1a76b0c"}
May 20 20:19:49.573673 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:49.573630    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-njrxw" event={"ID":"62a925ec-94bc-4c35-8971-b1598fc77b67","Type":"ContainerStarted","Data":"37f5a9665fe4b3f083b2f5820fbc6041eba44563509af56a6863747380986d0b"}
May 20 20:19:49.575451 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:49.575406    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rpxfx" event={"ID":"8eed8f09-7a8b-414c-b186-0733b5881f70","Type":"ContainerStarted","Data":"00142dca3c38c9aaf45e9c5008999bc1fbde807bdb4f9d92b5b77fa7e8a256d7"}
May 20 20:19:49.578725 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:49.578696    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-75.ec2.internal" event={"ID":"acc2ea8a697df6df18f7e95b5c7362f2","Type":"ContainerStarted","Data":"01dad48cc5e082bc217fb76cf7c2088ce9d76894c275ca588e23602d046607a1"}
May 20 20:19:49.585245 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:49.583724    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpmmg" event={"ID":"203d6be2-2ddd-48be-9d18-8a17fa95d2c3","Type":"ContainerStarted","Data":"145f8af662a47c6feb32e9eaddc53f0edc0e3b274e126a3792e13d585b0879f7"}
May 20 20:19:49.587616 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:49.587581    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q7zzq" event={"ID":"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9","Type":"ContainerStarted","Data":"e8466766c826bf469cc66cb5af8181db3da35375aebe6d724839cb34d1e3e907"}
May 20 20:19:49.590000 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:49.589974    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mfcvq" event={"ID":"a56c0b09-2443-4841-9b57-c3cf818995f3","Type":"ContainerStarted","Data":"1c62f3e6dc64da02ec4373dfdff5181d18a010f209df39b0a16d9f68a6e5bd9e"}
May 20 20:19:50.048408 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:50.048242    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs\") pod \"network-metrics-daemon-lpcq8\" (UID: \"58397932-927e-4bcb-8ccd-3ba17d08a9f0\") " pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:19:50.048569 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:50.048437    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:19:50.048569 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:50.048514    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs podName:58397932-927e-4bcb-8ccd-3ba17d08a9f0 nodeName:}" failed. No retries permitted until 2026-05-20 20:19:52.048494502 +0000 UTC m=+6.079660333 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs") pod "network-metrics-daemon-lpcq8" (UID: "58397932-927e-4bcb-8ccd-3ba17d08a9f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:19:50.249733 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:50.249691    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2xb\" (UniqueName: \"kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb\") pod \"network-check-target-gggx7\" (UID: \"e490d1ca-0378-490c-8a3c-52cb7cc2e4fb\") " pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:19:50.249956 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:50.249872    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:19:50.249956 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:50.249907    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:19:50.249956 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:50.249921    2566 projected.go:194] Error preparing data for projected volume kube-api-access-lc2xb for pod openshift-network-diagnostics/network-check-target-gggx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:19:50.250135 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:50.249980    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb podName:e490d1ca-0378-490c-8a3c-52cb7cc2e4fb nodeName:}" failed. No retries permitted until 2026-05-20 20:19:52.249962972 +0000 UTC m=+6.281128796 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lc2xb" (UniqueName: "kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb") pod "network-check-target-gggx7" (UID: "e490d1ca-0378-490c-8a3c-52cb7cc2e4fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:19:50.555322 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:50.554845    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:19:50.555322 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:50.554987    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gggx7" podUID="e490d1ca-0378-490c-8a3c-52cb7cc2e4fb"
May 20 20:19:50.609458 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:50.609403    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal" event={"ID":"aa81253f2cf6f11f2c24641000c0c71d","Type":"ContainerStarted","Data":"2f7e6b37f60392393f75dc0364feb0087c876adec6614e5544aa53f22fa63115"}
May 20 20:19:50.623336 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:50.622635    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-75.ec2.internal" podStartSLOduration=2.62261833 podStartE2EDuration="2.62261833s" podCreationTimestamp="2026-05-20 20:19:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:19:50.622371131 +0000 UTC m=+4.653536973" watchObservedRunningTime="2026-05-20 20:19:50.62261833 +0000 UTC m=+4.653784163"
May 20 20:19:50.623336 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:50.622995    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-75.ec2.internal" podStartSLOduration=2.622985538 podStartE2EDuration="2.622985538s" podCreationTimestamp="2026-05-20 20:19:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:19:49.595028349 +0000 UTC m=+3.626194177" watchObservedRunningTime="2026-05-20 20:19:50.622985538 +0000 UTC m=+4.654151366"
May 20 20:19:51.552514 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:51.552466    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:19:51.552703 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:51.552615    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpcq8" podUID="58397932-927e-4bcb-8ccd-3ba17d08a9f0"
May 20 20:19:52.063869 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:52.063827    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs\") pod \"network-metrics-daemon-lpcq8\" (UID: \"58397932-927e-4bcb-8ccd-3ba17d08a9f0\") " pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:19:52.064324 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:52.064010    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:19:52.064324 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:52.064068    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs podName:58397932-927e-4bcb-8ccd-3ba17d08a9f0 nodeName:}" failed. No retries permitted until 2026-05-20 20:19:56.064049719 +0000 UTC m=+10.095215539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs") pod "network-metrics-daemon-lpcq8" (UID: "58397932-927e-4bcb-8ccd-3ba17d08a9f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:19:52.265324 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:52.265287    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2xb\" (UniqueName: \"kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb\") pod \"network-check-target-gggx7\" (UID: \"e490d1ca-0378-490c-8a3c-52cb7cc2e4fb\") " pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:19:52.265487 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:52.265452    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:19:52.265487 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:52.265478    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:19:52.265607 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:52.265491    2566 projected.go:194] Error preparing data for projected volume kube-api-access-lc2xb for pod openshift-network-diagnostics/network-check-target-gggx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:19:52.265607 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:52.265546    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb podName:e490d1ca-0378-490c-8a3c-52cb7cc2e4fb nodeName:}" failed. No retries permitted until 2026-05-20 20:19:56.265532871 +0000 UTC m=+10.296698681 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lc2xb" (UniqueName: "kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb") pod "network-check-target-gggx7" (UID: "e490d1ca-0378-490c-8a3c-52cb7cc2e4fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:19:52.555424 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:52.555341    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:19:52.555568 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:52.555458    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gggx7" podUID="e490d1ca-0378-490c-8a3c-52cb7cc2e4fb"
May 20 20:19:53.552725 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:53.552686    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:19:53.553192 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:53.552841    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpcq8" podUID="58397932-927e-4bcb-8ccd-3ba17d08a9f0"
May 20 20:19:54.431237 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:54.430404    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-btjv5"]
May 20 20:19:54.436871 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:54.436841    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:19:54.437022 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:54.437005    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btjv5" podUID="137212f9-191f-4845-bf90-69a40a5f1ac0"
May 20 20:19:54.483566 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:54.483369    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/137212f9-191f-4845-bf90-69a40a5f1ac0-dbus\") pod \"global-pull-secret-syncer-btjv5\" (UID: \"137212f9-191f-4845-bf90-69a40a5f1ac0\") " pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:19:54.483566 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:54.483413    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret\") pod \"global-pull-secret-syncer-btjv5\" (UID: \"137212f9-191f-4845-bf90-69a40a5f1ac0\") " pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:19:54.483566 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:54.483472    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/137212f9-191f-4845-bf90-69a40a5f1ac0-kubelet-config\") pod \"global-pull-secret-syncer-btjv5\" (UID: \"137212f9-191f-4845-bf90-69a40a5f1ac0\") " pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:19:54.552590 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:54.552554    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:19:54.552759 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:54.552685    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gggx7" podUID="e490d1ca-0378-490c-8a3c-52cb7cc2e4fb"
May 20 20:19:54.583813 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:54.583755    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/137212f9-191f-4845-bf90-69a40a5f1ac0-kubelet-config\") pod \"global-pull-secret-syncer-btjv5\" (UID: \"137212f9-191f-4845-bf90-69a40a5f1ac0\") " pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:19:54.583966 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:54.583840    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/137212f9-191f-4845-bf90-69a40a5f1ac0-dbus\") pod \"global-pull-secret-syncer-btjv5\" (UID: \"137212f9-191f-4845-bf90-69a40a5f1ac0\") " pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:19:54.583966 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:54.583872    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret\") pod \"global-pull-secret-syncer-btjv5\" (UID: \"137212f9-191f-4845-bf90-69a40a5f1ac0\") " pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:19:54.583966 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:54.583924    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/137212f9-191f-4845-bf90-69a40a5f1ac0-kubelet-config\") pod \"global-pull-secret-syncer-btjv5\" (UID: \"137212f9-191f-4845-bf90-69a40a5f1ac0\") " pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:19:54.584134 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:54.584033    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 20:19:54.584134 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:54.584091    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret podName:137212f9-191f-4845-bf90-69a40a5f1ac0 nodeName:}" failed. No retries permitted until 2026-05-20 20:19:55.084074553 +0000 UTC m=+9.115240366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret") pod "global-pull-secret-syncer-btjv5" (UID: "137212f9-191f-4845-bf90-69a40a5f1ac0") : object "kube-system"/"original-pull-secret" not registered
May 20 20:19:54.584134 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:54.584103    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/137212f9-191f-4845-bf90-69a40a5f1ac0-dbus\") pod \"global-pull-secret-syncer-btjv5\" (UID: \"137212f9-191f-4845-bf90-69a40a5f1ac0\") " pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:19:55.088435 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:55.088398    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret\") pod \"global-pull-secret-syncer-btjv5\" (UID: \"137212f9-191f-4845-bf90-69a40a5f1ac0\") " pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:19:55.088622 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:55.088561    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 20:19:55.088679 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:55.088627    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret podName:137212f9-191f-4845-bf90-69a40a5f1ac0 nodeName:}" failed. No retries permitted until 2026-05-20 20:19:56.088612505 +0000 UTC m=+10.119778327 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret") pod "global-pull-secret-syncer-btjv5" (UID: "137212f9-191f-4845-bf90-69a40a5f1ac0") : object "kube-system"/"original-pull-secret" not registered
May 20 20:19:55.553210 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:55.553127    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:19:55.553621 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:55.553278    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpcq8" podUID="58397932-927e-4bcb-8ccd-3ba17d08a9f0"
May 20 20:19:56.099288 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:56.098366    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret\") pod \"global-pull-secret-syncer-btjv5\" (UID: \"137212f9-191f-4845-bf90-69a40a5f1ac0\") " pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:19:56.099288 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:56.098474    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs\") pod \"network-metrics-daemon-lpcq8\" (UID: \"58397932-927e-4bcb-8ccd-3ba17d08a9f0\") " pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:19:56.099288 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:56.098656    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:19:56.099288 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:56.098722    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs podName:58397932-927e-4bcb-8ccd-3ba17d08a9f0 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:04.098703279 +0000 UTC m=+18.129869107 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs") pod "network-metrics-daemon-lpcq8" (UID: "58397932-927e-4bcb-8ccd-3ba17d08a9f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:19:56.099288 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:56.099220    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 20:19:56.099288 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:56.099278    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret podName:137212f9-191f-4845-bf90-69a40a5f1ac0 nodeName:}" failed. No retries permitted until 2026-05-20 20:19:58.09926154 +0000 UTC m=+12.130427346 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret") pod "global-pull-secret-syncer-btjv5" (UID: "137212f9-191f-4845-bf90-69a40a5f1ac0") : object "kube-system"/"original-pull-secret" not registered
May 20 20:19:56.300223 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:56.300182    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2xb\" (UniqueName: \"kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb\") pod \"network-check-target-gggx7\" (UID: \"e490d1ca-0378-490c-8a3c-52cb7cc2e4fb\") " pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:19:56.300400 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:56.300357    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:19:56.300400 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:56.300376    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:19:56.300400 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:56.300389    2566 projected.go:194] Error preparing data for projected volume kube-api-access-lc2xb for pod openshift-network-diagnostics/network-check-target-gggx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:19:56.300549 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:56.300456    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb podName:e490d1ca-0378-490c-8a3c-52cb7cc2e4fb nodeName:}" failed. No retries permitted until 2026-05-20 20:20:04.300437132 +0000 UTC m=+18.331602943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lc2xb" (UniqueName: "kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb") pod "network-check-target-gggx7" (UID: "e490d1ca-0378-490c-8a3c-52cb7cc2e4fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:19:56.553637 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:56.553537    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:19:56.554081 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:56.553646    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btjv5" podUID="137212f9-191f-4845-bf90-69a40a5f1ac0"
May 20 20:19:56.554081 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:56.553709    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:19:56.554081 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:56.553813    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gggx7" podUID="e490d1ca-0378-490c-8a3c-52cb7cc2e4fb"
May 20 20:19:57.553210 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:57.553171    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:19:57.553388 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:57.553318    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpcq8" podUID="58397932-927e-4bcb-8ccd-3ba17d08a9f0"
May 20 20:19:58.115829 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:58.115245    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret\") pod \"global-pull-secret-syncer-btjv5\" (UID: \"137212f9-191f-4845-bf90-69a40a5f1ac0\") " pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:19:58.115829 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:58.115431    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 20:19:58.115829 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:58.115502    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret podName:137212f9-191f-4845-bf90-69a40a5f1ac0 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:02.115483663 +0000 UTC m=+16.146649473 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret") pod "global-pull-secret-syncer-btjv5" (UID: "137212f9-191f-4845-bf90-69a40a5f1ac0") : object "kube-system"/"original-pull-secret" not registered
May 20 20:19:58.221475 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:58.221441    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-nkc5b"]
May 20 20:19:58.252620 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:58.252594    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nkc5b"
May 20 20:19:58.257213 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:58.257186    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 20 20:19:58.257323 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:58.257299    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l4r8b\""
May 20 20:19:58.257718 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:58.257704    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 20 20:19:58.317033 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:58.317007    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2gzj\" (UniqueName: \"kubernetes.io/projected/6cc19b57-f3ee-428d-a00e-b5ec641fd9bd-kube-api-access-d2gzj\") pod \"node-resolver-nkc5b\" (UID: \"6cc19b57-f3ee-428d-a00e-b5ec641fd9bd\") " pod="openshift-dns/node-resolver-nkc5b"
May 20 20:19:58.317127 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:58.317038    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cc19b57-f3ee-428d-a00e-b5ec641fd9bd-tmp-dir\") pod \"node-resolver-nkc5b\" (UID: \"6cc19b57-f3ee-428d-a00e-b5ec641fd9bd\") " pod="openshift-dns/node-resolver-nkc5b"
May 20 20:19:58.317127 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:58.317080    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6cc19b57-f3ee-428d-a00e-b5ec641fd9bd-hosts-file\") pod \"node-resolver-nkc5b\" (UID: \"6cc19b57-f3ee-428d-a00e-b5ec641fd9bd\") " pod="openshift-dns/node-resolver-nkc5b"
May 20 20:19:58.417387 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:58.417316    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d2gzj\" (UniqueName: \"kubernetes.io/projected/6cc19b57-f3ee-428d-a00e-b5ec641fd9bd-kube-api-access-d2gzj\") pod \"node-resolver-nkc5b\" (UID: \"6cc19b57-f3ee-428d-a00e-b5ec641fd9bd\") " pod="openshift-dns/node-resolver-nkc5b"
May 20 20:19:58.417387 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:58.417351    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cc19b57-f3ee-428d-a00e-b5ec641fd9bd-tmp-dir\") pod \"node-resolver-nkc5b\" (UID: \"6cc19b57-f3ee-428d-a00e-b5ec641fd9bd\") " pod="openshift-dns/node-resolver-nkc5b"
May 20 20:19:58.417387 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:58.417393    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6cc19b57-f3ee-428d-a00e-b5ec641fd9bd-hosts-file\") pod \"node-resolver-nkc5b\" (UID: \"6cc19b57-f3ee-428d-a00e-b5ec641fd9bd\") " pod="openshift-dns/node-resolver-nkc5b"
May 20 20:19:58.417647 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:58.417455    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6cc19b57-f3ee-428d-a00e-b5ec641fd9bd-hosts-file\") pod \"node-resolver-nkc5b\" (UID: \"6cc19b57-f3ee-428d-a00e-b5ec641fd9bd\") " pod="openshift-dns/node-resolver-nkc5b"
May 20 20:19:58.417713 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:58.417691    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cc19b57-f3ee-428d-a00e-b5ec641fd9bd-tmp-dir\") pod \"node-resolver-nkc5b\" (UID: \"6cc19b57-f3ee-428d-a00e-b5ec641fd9bd\") " pod="openshift-dns/node-resolver-nkc5b"
May 20 20:19:58.428220 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:58.428192    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2gzj\" (UniqueName: \"kubernetes.io/projected/6cc19b57-f3ee-428d-a00e-b5ec641fd9bd-kube-api-access-d2gzj\") pod \"node-resolver-nkc5b\" (UID: \"6cc19b57-f3ee-428d-a00e-b5ec641fd9bd\") " pod="openshift-dns/node-resolver-nkc5b"
May 20 20:19:58.552652 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:58.552610    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:19:58.552832 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:58.552615    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:19:58.552832 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:58.552743    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gggx7" podUID="e490d1ca-0378-490c-8a3c-52cb7cc2e4fb"
May 20 20:19:58.552967 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:58.552844    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btjv5" podUID="137212f9-191f-4845-bf90-69a40a5f1ac0"
May 20 20:19:58.561013 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:58.560982    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nkc5b"
May 20 20:19:59.552989 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:19:59.552917    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:19:59.553350 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:19:59.553052    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpcq8" podUID="58397932-927e-4bcb-8ccd-3ba17d08a9f0"
May 20 20:20:00.552779 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:00.552736    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:20:00.552964 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:00.552736    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:20:00.552964 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:00.552877    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btjv5" podUID="137212f9-191f-4845-bf90-69a40a5f1ac0"
May 20 20:20:00.552964 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:00.552923    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gggx7" podUID="e490d1ca-0378-490c-8a3c-52cb7cc2e4fb"
May 20 20:20:01.552316 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:01.552284    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:20:01.552497 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:01.552425    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpcq8" podUID="58397932-927e-4bcb-8ccd-3ba17d08a9f0"
May 20 20:20:02.146705 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:02.146675    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret\") pod \"global-pull-secret-syncer-btjv5\" (UID: \"137212f9-191f-4845-bf90-69a40a5f1ac0\") " pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:20:02.147105 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:02.146845    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 20:20:02.147105 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:02.146936    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret podName:137212f9-191f-4845-bf90-69a40a5f1ac0 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:10.146912933 +0000 UTC m=+24.178078740 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret") pod "global-pull-secret-syncer-btjv5" (UID: "137212f9-191f-4845-bf90-69a40a5f1ac0") : object "kube-system"/"original-pull-secret" not registered
May 20 20:20:02.552805 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:02.552729    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:20:02.552978 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:02.552839    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gggx7" podUID="e490d1ca-0378-490c-8a3c-52cb7cc2e4fb"
May 20 20:20:02.552978 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:02.552910    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:20:02.553084 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:02.553022    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btjv5" podUID="137212f9-191f-4845-bf90-69a40a5f1ac0"
May 20 20:20:03.553259 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:03.553219    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:20:03.553760 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:03.553348    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpcq8" podUID="58397932-927e-4bcb-8ccd-3ba17d08a9f0"
May 20 20:20:04.163439 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:04.163405    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs\") pod \"network-metrics-daemon-lpcq8\" (UID: \"58397932-927e-4bcb-8ccd-3ba17d08a9f0\") " pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:20:04.163686 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:04.163572    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:20:04.163686 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:04.163658    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs podName:58397932-927e-4bcb-8ccd-3ba17d08a9f0 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:20.16363572 +0000 UTC m=+34.194801525 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs") pod "network-metrics-daemon-lpcq8" (UID: "58397932-927e-4bcb-8ccd-3ba17d08a9f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:20:04.365197 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:04.365156    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2xb\" (UniqueName: \"kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb\") pod \"network-check-target-gggx7\" (UID: \"e490d1ca-0378-490c-8a3c-52cb7cc2e4fb\") " pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:20:04.365355 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:04.365331    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:20:04.365414 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:04.365359    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:20:04.365414 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:04.365373    2566 projected.go:194] Error preparing data for projected volume kube-api-access-lc2xb for pod openshift-network-diagnostics/network-check-target-gggx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:20:04.365528 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:04.365432    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb podName:e490d1ca-0378-490c-8a3c-52cb7cc2e4fb nodeName:}" failed. No retries permitted until 2026-05-20 20:20:20.365418039 +0000 UTC m=+34.396583843 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lc2xb" (UniqueName: "kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb") pod "network-check-target-gggx7" (UID: "e490d1ca-0378-490c-8a3c-52cb7cc2e4fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:20:04.552920 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:04.552828    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:20:04.553048 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:04.552970    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gggx7" podUID="e490d1ca-0378-490c-8a3c-52cb7cc2e4fb"
May 20 20:20:04.553048 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:04.553023    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:20:04.553137 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:04.553111    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btjv5" podUID="137212f9-191f-4845-bf90-69a40a5f1ac0"
May 20 20:20:05.552287 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:05.552255    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:20:05.552629 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:05.552367    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpcq8" podUID="58397932-927e-4bcb-8ccd-3ba17d08a9f0"
May 20 20:20:06.553952 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:06.553925    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:20:06.554347 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:06.554034    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gggx7" podUID="e490d1ca-0378-490c-8a3c-52cb7cc2e4fb"
May 20 20:20:06.554347 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:06.554069    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:20:06.554347 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:06.554142    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btjv5" podUID="137212f9-191f-4845-bf90-69a40a5f1ac0"
May 20 20:20:07.343936 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:20:07.343680    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc19b57_f3ee_428d_a00e_b5ec641fd9bd.slice/crio-d9da3b7ba2088bd3a88018c16001a8e134dd887eb3ca745edafae663b267772a WatchSource:0}: Error finding container d9da3b7ba2088bd3a88018c16001a8e134dd887eb3ca745edafae663b267772a: Status 404 returned error can't find the container with id d9da3b7ba2088bd3a88018c16001a8e134dd887eb3ca745edafae663b267772a
May 20 20:20:07.552235 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:07.552203    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:20:07.552361 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:07.552340    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpcq8" podUID="58397932-927e-4bcb-8ccd-3ba17d08a9f0"
May 20 20:20:07.643856 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:07.643582    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mfcvq" event={"ID":"a56c0b09-2443-4841-9b57-c3cf818995f3","Type":"ContainerStarted","Data":"814052bf483dc8fc193c69c98d3eb2773c5b1d6bc6c718f70b0e9c7fd36fe1c7"}
May 20 20:20:07.644984 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:07.644958    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tqwsz" event={"ID":"11b13fe0-9674-4919-ad3a-65e936aebf4d","Type":"ContainerStarted","Data":"a0281422e7c13051ac6b68ec0fb4e83ba2adefb79431e43a26a1d4f604dc2f62"}
May 20 20:20:07.646286 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:07.646262    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm" event={"ID":"6a3a7768-26b3-4d23-831a-582df6968f4c","Type":"ContainerStarted","Data":"b9337f4836ede8b4257a605e3ce5c5016c6b9fc44667dd0ac9c58af68fa75506"}
May 20 20:20:07.647428 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:07.647405    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nkc5b" event={"ID":"6cc19b57-f3ee-428d-a00e-b5ec641fd9bd","Type":"ContainerStarted","Data":"9d82745ae895e154c5ad13b54ad1f96c81a80aa935460c0bd4541f3329c669c9"}
May 20 20:20:07.647517 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:07.647443    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nkc5b" event={"ID":"6cc19b57-f3ee-428d-a00e-b5ec641fd9bd","Type":"ContainerStarted","Data":"d9da3b7ba2088bd3a88018c16001a8e134dd887eb3ca745edafae663b267772a"}
May 20 20:20:07.648994 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:07.648965    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-njrxw" event={"ID":"62a925ec-94bc-4c35-8971-b1598fc77b67","Type":"ContainerStarted","Data":"e52426b1dd45fe5cfc050d04cd4fff5a83ae9384d83da02a6f781fba96530071"}
May 20 20:20:07.648994 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:07.648993    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-njrxw" event={"ID":"62a925ec-94bc-4c35-8971-b1598fc77b67","Type":"ContainerStarted","Data":"be9e3e044bd8173a2bd31063db86af3e50f7fe68e3278c78f7a1be1869e640ca"}
May 20 20:20:07.650159 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:07.650134    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rpxfx" event={"ID":"8eed8f09-7a8b-414c-b186-0733b5881f70","Type":"ContainerStarted","Data":"4307287ac9f0a51738fc6cf10d48a92fa65d5c1ab968b96d71a315b3ddaeb21c"}
May 20 20:20:07.651450 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:07.651431    2566 generic.go:358] "Generic (PLEG): container finished" podID="203d6be2-2ddd-48be-9d18-8a17fa95d2c3" containerID="3b351b7eca77a6713233f6bf9d3c83bd34306d8ad18b8ebfed7d3bcc6b871a12" exitCode=0
May 20 20:20:07.651574 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:07.651484    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpmmg" event={"ID":"203d6be2-2ddd-48be-9d18-8a17fa95d2c3","Type":"ContainerDied","Data":"3b351b7eca77a6713233f6bf9d3c83bd34306d8ad18b8ebfed7d3bcc6b871a12"}
May 20 20:20:07.652870 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:07.652797    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q7zzq" event={"ID":"d75886b8-b771-4f7f-b2a1-dd683a5ac8e9","Type":"ContainerStarted","Data":"d6f78cb8bbe3dc26e736f9a60ed2c98409acb3026762b27fc61a54aacb5e1770"}
May 20 20:20:07.659921 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:07.658725    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mfcvq" podStartSLOduration=3.46263453 podStartE2EDuration="21.658711783s" podCreationTimestamp="2026-05-20 20:19:46 +0000 UTC" firstStartedPulling="2026-05-20 20:19:49.143829552 +0000 UTC m=+3.174995361" lastFinishedPulling="2026-05-20 20:20:07.339906794 +0000 UTC m=+21.371072614" observedRunningTime="2026-05-20 20:20:07.658359759 +0000 UTC m=+21.689525586" watchObservedRunningTime="2026-05-20 20:20:07.658711783 +0000 UTC m=+21.689877612"
May 20 20:20:07.671685 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:07.671645    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-q7zzq" podStartSLOduration=3.427812483 podStartE2EDuration="21.671630912s" podCreationTimestamp="2026-05-20 20:19:46 +0000 UTC" firstStartedPulling="2026-05-20 20:19:49.147114679 +0000 UTC m=+3.178280497" lastFinishedPulling="2026-05-20 20:20:07.390933119 +0000 UTC m=+21.422098926" observedRunningTime="2026-05-20 20:20:07.670774815 +0000 UTC m=+21.701940643" watchObservedRunningTime="2026-05-20 20:20:07.671630912 +0000 UTC m=+21.702796738"
May 20 20:20:07.700478 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:07.700438    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rpxfx" podStartSLOduration=3.537723545 podStartE2EDuration="21.70042497s" podCreationTimestamp="2026-05-20 20:19:46 +0000 UTC" firstStartedPulling="2026-05-20 20:19:49.138088394 +0000 UTC m=+3.169254199" lastFinishedPulling="2026-05-20 20:20:07.300789819 +0000 UTC m=+21.331955624" observedRunningTime="2026-05-20 20:20:07.700367778 +0000 UTC m=+21.731533604" watchObservedRunningTime="2026-05-20 20:20:07.70042497 +0000 UTC m=+21.731590795"
May 20 20:20:07.714945 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:07.714878    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-nkc5b" podStartSLOduration=9.714866071 podStartE2EDuration="9.714866071s" podCreationTimestamp="2026-05-20 20:19:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:20:07.714649027 +0000 UTC m=+21.745814855" watchObservedRunningTime="2026-05-20 20:20:07.714866071 +0000 UTC m=+21.746031897"
May 20 20:20:07.732210 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:07.732168    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tqwsz" podStartSLOduration=3.577350714 podStartE2EDuration="21.732154599s" podCreationTimestamp="2026-05-20 20:19:46 +0000 UTC" firstStartedPulling="2026-05-20 20:19:49.145991365 +0000 UTC m=+3.177157185" lastFinishedPulling="2026-05-20 20:20:07.300795251 +0000 UTC m=+21.331961070" observedRunningTime="2026-05-20 20:20:07.731999662 +0000 UTC m=+21.763165489" watchObservedRunningTime="2026-05-20 20:20:07.732154599 +0000 UTC m=+21.763320426"
May 20 20:20:08.552565 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:08.552537    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:20:08.552565 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:08.552551    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:20:08.552844 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:08.552635    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gggx7" podUID="e490d1ca-0378-490c-8a3c-52cb7cc2e4fb"
May 20 20:20:08.552844 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:08.552766    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btjv5" podUID="137212f9-191f-4845-bf90-69a40a5f1ac0"
May 20 20:20:08.656782 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:08.656741    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7hj86" event={"ID":"a1e2f844-8c91-4f30-8df0-1c9cab84e2a1","Type":"ContainerStarted","Data":"01e86a24c746e842bc9493cde276dd649271d96814c806313f346286ca5cb2a5"}
May 20 20:20:08.659746 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:08.659655    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-njrxw" event={"ID":"62a925ec-94bc-4c35-8971-b1598fc77b67","Type":"ContainerStarted","Data":"3a03a90bec5be7aac338f7d3dab1532e5d1ae1e908631aafac9c5a50edd0b984"}
May 20 20:20:08.659746 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:08.659723    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-njrxw" event={"ID":"62a925ec-94bc-4c35-8971-b1598fc77b67","Type":"ContainerStarted","Data":"63c860275e8cfdc901dec024fca42917bf5f5934453a720aafdec26529e21f12"}
May 20 20:20:08.659972 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:08.659747    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-njrxw" event={"ID":"62a925ec-94bc-4c35-8971-b1598fc77b67","Type":"ContainerStarted","Data":"3912024e2cca4612ed10ab44acfc97414e6fd0dc655a730e7aa9b3212db72eb6"}
May 20 20:20:08.659972 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:08.659760    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-njrxw" event={"ID":"62a925ec-94bc-4c35-8971-b1598fc77b67","Type":"ContainerStarted","Data":"a414207e959909cf9fca3416b95484fcf7dcf334d82359fb16ec23226864dc93"}
May 20 20:20:08.801594 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:08.801394    2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 20 20:20:09.180001 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:09.179973    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tqwsz"
May 20 20:20:09.180648 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:09.180612    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tqwsz"
May 20 20:20:09.200649 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:09.200602    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7hj86" podStartSLOduration=5.005338586 podStartE2EDuration="23.200587233s" podCreationTimestamp="2026-05-20 20:19:46 +0000 UTC" firstStartedPulling="2026-05-20 20:19:49.147061799 +0000 UTC m=+3.178227604" lastFinishedPulling="2026-05-20 20:20:07.342310429 +0000 UTC m=+21.373476251" observedRunningTime="2026-05-20 20:20:08.68299167 +0000 UTC m=+22.714157497" watchObservedRunningTime="2026-05-20 20:20:09.200587233 +0000 UTC m=+23.231753060"
May 20 20:20:09.495128 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:09.494974    2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-20T20:20:08.801589967Z","UUID":"15d381c9-6123-4aa4-be81-4ab983644a0b","Handler":null,"Name":"","Endpoint":""}
May 20 20:20:09.497072 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:09.497045    2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 20 20:20:09.497072 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:09.497075    2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 20 20:20:09.552534 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:09.552495    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:20:09.552690 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:09.552628    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpcq8" podUID="58397932-927e-4bcb-8ccd-3ba17d08a9f0"
May 20 20:20:09.663634 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:09.663599    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm" event={"ID":"6a3a7768-26b3-4d23-831a-582df6968f4c","Type":"ContainerStarted","Data":"d24e3f0fc0d152805f4f19442ef50b4ac9f80d5fe357f1c68168bb3b0b586b72"}
May 20 20:20:09.664161 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:09.664064    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tqwsz"
May 20 20:20:09.664482 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:09.664456    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tqwsz"
May 20 20:20:10.214888 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:10.214800    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret\") pod \"global-pull-secret-syncer-btjv5\" (UID: \"137212f9-191f-4845-bf90-69a40a5f1ac0\") " pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:20:10.215055 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:10.214967    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 20:20:10.215055 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:10.215049    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret podName:137212f9-191f-4845-bf90-69a40a5f1ac0 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:26.215027571 +0000 UTC m=+40.246193391 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret") pod "global-pull-secret-syncer-btjv5" (UID: "137212f9-191f-4845-bf90-69a40a5f1ac0") : object "kube-system"/"original-pull-secret" not registered
May 20 20:20:10.553093 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:10.553025    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:20:10.553093 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:10.553044    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:20:10.553268 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:10.553129    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gggx7" podUID="e490d1ca-0378-490c-8a3c-52cb7cc2e4fb"
May 20 20:20:10.553268 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:10.553239    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btjv5" podUID="137212f9-191f-4845-bf90-69a40a5f1ac0"
May 20 20:20:10.668883 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:10.668844    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-njrxw" event={"ID":"62a925ec-94bc-4c35-8971-b1598fc77b67","Type":"ContainerStarted","Data":"24362cec21a0a1e43984939a313855d427f8e5e8205d563f1ea76e7cfe924adb"}
May 20 20:20:10.670808 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:10.670776    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm" event={"ID":"6a3a7768-26b3-4d23-831a-582df6968f4c","Type":"ContainerStarted","Data":"2a8ce7ec90794984a4466da48de22a4119ae89ff5f7a96ccd4d67cee6444a692"}
May 20 20:20:11.552781 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:11.552746    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:20:11.552974 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:11.552875    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpcq8" podUID="58397932-927e-4bcb-8ccd-3ba17d08a9f0"
May 20 20:20:12.552908 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:12.552644    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:20:12.553589 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:12.552687    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:20:12.553589 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:12.552918    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gggx7" podUID="e490d1ca-0378-490c-8a3c-52cb7cc2e4fb"
May 20 20:20:12.553589 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:12.552986    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btjv5" podUID="137212f9-191f-4845-bf90-69a40a5f1ac0"
May 20 20:20:12.677407 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:12.677373    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-njrxw" event={"ID":"62a925ec-94bc-4c35-8971-b1598fc77b67","Type":"ContainerStarted","Data":"97f2115ef0cab51ef9dd4f2d5c596020ce103d6137b827178c557d206cf0e629"}
May 20 20:20:12.677716 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:12.677690    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:20:12.677864 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:12.677722    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:20:12.679024 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:12.679002    2566 generic.go:358] "Generic (PLEG): container finished" podID="203d6be2-2ddd-48be-9d18-8a17fa95d2c3" containerID="21fee49a3e03c1512c5ec8eb2cf967abf3cca121c908d4d940e0823f5c2f0094" exitCode=0
May 20 20:20:12.679113 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:12.679046    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpmmg" event={"ID":"203d6be2-2ddd-48be-9d18-8a17fa95d2c3","Type":"ContainerDied","Data":"21fee49a3e03c1512c5ec8eb2cf967abf3cca121c908d4d940e0823f5c2f0094"}
May 20 20:20:12.693520 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:12.693501    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:20:12.705812 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:12.705775    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wdzvm" podStartSLOduration=5.9925693110000005 podStartE2EDuration="26.705762549s" podCreationTimestamp="2026-05-20 20:19:46 +0000 UTC" firstStartedPulling="2026-05-20 20:19:49.140376394 +0000 UTC m=+3.171542207" lastFinishedPulling="2026-05-20 20:20:09.853569628 +0000 UTC m=+23.884735445" observedRunningTime="2026-05-20 20:20:10.691990721 +0000 UTC m=+24.723156548" watchObservedRunningTime="2026-05-20 20:20:12.705762549 +0000 UTC m=+26.736928421"
May 20 20:20:12.705992 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:12.705971    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-njrxw" podStartSLOduration=8.440309232 podStartE2EDuration="26.705966976s" podCreationTimestamp="2026-05-20 20:19:46 +0000 UTC" firstStartedPulling="2026-05-20 20:19:49.139614249 +0000 UTC m=+3.170780061" lastFinishedPulling="2026-05-20 20:20:07.405271995 +0000 UTC m=+21.436437805" observedRunningTime="2026-05-20 20:20:12.704513538 +0000 UTC m=+26.735679364" watchObservedRunningTime="2026-05-20 20:20:12.705966976 +0000 UTC m=+26.737132805"
May 20 20:20:13.553014 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:13.552982    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:20:13.553371 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:13.553091    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpcq8" podUID="58397932-927e-4bcb-8ccd-3ba17d08a9f0"
May 20 20:20:13.681566 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:13.681536    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:20:13.695775 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:13.695751    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:20:14.177500 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:14.177309    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gggx7"]
May 20 20:20:14.177667 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:14.177595    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:20:14.177706 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:14.177679    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gggx7" podUID="e490d1ca-0378-490c-8a3c-52cb7cc2e4fb"
May 20 20:20:14.180055 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:14.180035    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lpcq8"]
May 20 20:20:14.180162 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:14.180106    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:20:14.180207 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:14.180192    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpcq8" podUID="58397932-927e-4bcb-8ccd-3ba17d08a9f0"
May 20 20:20:14.188656 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:14.188635    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-btjv5"]
May 20 20:20:14.188736 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:14.188716    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:20:14.188796 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:14.188782    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btjv5" podUID="137212f9-191f-4845-bf90-69a40a5f1ac0"
May 20 20:20:14.684704 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:14.684674    2566 generic.go:358] "Generic (PLEG): container finished" podID="203d6be2-2ddd-48be-9d18-8a17fa95d2c3" containerID="63663be2d9305991aebf4af6a54a5d2e0c433c697c44d1797a9eedcad68aff40" exitCode=0
May 20 20:20:14.685255 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:14.684760    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpmmg" event={"ID":"203d6be2-2ddd-48be-9d18-8a17fa95d2c3","Type":"ContainerDied","Data":"63663be2d9305991aebf4af6a54a5d2e0c433c697c44d1797a9eedcad68aff40"}
May 20 20:20:15.552941 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:15.552908    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:20:15.552941 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:15.552930    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:20:15.553179 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:15.553023    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gggx7" podUID="e490d1ca-0378-490c-8a3c-52cb7cc2e4fb"
May 20 20:20:15.553179 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:15.553128    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btjv5" podUID="137212f9-191f-4845-bf90-69a40a5f1ac0"
May 20 20:20:16.553391 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:16.553318    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:20:16.553807 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:16.553427    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpcq8" podUID="58397932-927e-4bcb-8ccd-3ba17d08a9f0"
May 20 20:20:16.689622 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:16.689594    2566 generic.go:358] "Generic (PLEG): container finished" podID="203d6be2-2ddd-48be-9d18-8a17fa95d2c3" containerID="3c2ec31431239086bd057e2f4bebcde2392c59684b92b88d2ddba895c8904240" exitCode=0
May 20 20:20:16.689743 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:16.689640    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpmmg" event={"ID":"203d6be2-2ddd-48be-9d18-8a17fa95d2c3","Type":"ContainerDied","Data":"3c2ec31431239086bd057e2f4bebcde2392c59684b92b88d2ddba895c8904240"}
May 20 20:20:17.552689 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:17.552654    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:20:17.552865 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:17.552663    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:20:17.552865 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:17.552767    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btjv5" podUID="137212f9-191f-4845-bf90-69a40a5f1ac0"
May 20 20:20:17.553029 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:17.552869    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gggx7" podUID="e490d1ca-0378-490c-8a3c-52cb7cc2e4fb"
May 20 20:20:18.553379 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:18.553349    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:20:18.554104 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:18.553483    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lpcq8" podUID="58397932-927e-4bcb-8ccd-3ba17d08a9f0"
May 20 20:20:19.552269 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:19.552235    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:20:19.552269 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:19.552261    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:20:19.552466 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:19.552350    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btjv5" podUID="137212f9-191f-4845-bf90-69a40a5f1ac0"
May 20 20:20:19.552466 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:19.552405    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gggx7" podUID="e490d1ca-0378-490c-8a3c-52cb7cc2e4fb"
May 20 20:20:20.192502 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.192413    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs\") pod \"network-metrics-daemon-lpcq8\" (UID: \"58397932-927e-4bcb-8ccd-3ba17d08a9f0\") " pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:20:20.193010 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:20.192554    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:20:20.193010 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:20.192640    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs podName:58397932-927e-4bcb-8ccd-3ba17d08a9f0 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:52.192618972 +0000 UTC m=+66.223784781 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs") pod "network-metrics-daemon-lpcq8" (UID: "58397932-927e-4bcb-8ccd-3ba17d08a9f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:20:20.304114 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.304074    2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-75.ec2.internal" event="NodeReady"
May 20 20:20:20.304285 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.304223    2566 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 20 20:20:20.348884 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.348851    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8698d89747-fj9fs"]
May 20 20:20:20.350832 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.350815    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.354354 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.354327    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 20 20:20:20.354463 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.354394    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 20 20:20:20.354463 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.354452    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 20 20:20:20.354675 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.354660    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lck56\""
May 20 20:20:20.363448 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.363405    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 20 20:20:20.365398 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.365375    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8698d89747-fj9fs"]
May 20 20:20:20.374885 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.374852    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ptgqm"]
May 20 20:20:20.376755 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.376737    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"]
May 20 20:20:20.376900 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.376873    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ptgqm"
May 20 20:20:20.378139 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.378121    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"
May 20 20:20:20.380013 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.379746    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 20 20:20:20.380013 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.379800    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jx4zj"]
May 20 20:20:20.380013 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.379855    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 20 20:20:20.380013 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.379858    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8wmjb\""
May 20 20:20:20.380283 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.380262    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 20 20:20:20.380345 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.380314    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 20 20:20:20.380396 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.380317    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-98fhr\""
May 20 20:20:20.381681 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.381664    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jx4zj"
May 20 20:20:20.387332 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.387082    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 20 20:20:20.387332 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.387100    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 20 20:20:20.387332 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.387083    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 20 20:20:20.387843 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.387822    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6s6vr\""
May 20 20:20:20.394054 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.394029    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2xb\" (UniqueName: \"kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb\") pod \"network-check-target-gggx7\" (UID: \"e490d1ca-0378-490c-8a3c-52cb7cc2e4fb\") " pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:20:20.394196 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:20.394172    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:20:20.394196 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:20.394193    2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:20:20.394355 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:20.394206    2566 projected.go:194] Error preparing data for projected volume kube-api-access-lc2xb for pod openshift-network-diagnostics/network-check-target-gggx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:20:20.394355 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:20.394259    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb podName:e490d1ca-0378-490c-8a3c-52cb7cc2e4fb nodeName:}" failed. No retries permitted until 2026-05-20 20:20:52.394242071 +0000 UTC m=+66.425407892 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lc2xb" (UniqueName: "kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb") pod "network-check-target-gggx7" (UID: "e490d1ca-0378-490c-8a3c-52cb7cc2e4fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:20:20.395274 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.395240    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ptgqm"]
May 20 20:20:20.395937 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.395917    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"]
May 20 20:20:20.401181 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.401158    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jx4zj"]
May 20 20:20:20.494681 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.494610    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xnb7\" (UniqueName: \"kubernetes.io/projected/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-kube-api-access-9xnb7\") pod \"ingress-canary-jx4zj\" (UID: \"a60784d9-7267-4cdd-bfe1-9828b0ab3ee1\") " pod="openshift-ingress-canary/ingress-canary-jx4zj"
May 20 20:20:20.494681 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.494639    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-trusted-ca\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.494681 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.494662    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-image-registry-private-configuration\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.494681 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.494681    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2ece298-1b7c-43ed-a06d-4f0684ba0180-config-volume\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:20:20.494985 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.494717    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-9rqk8\" (UID: \"b77a7447-7dda-48f7-ae38-5aa565402fc3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"
May 20 20:20:20.494985 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.494757    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:20:20.494985 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.494772    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m5cx\" (UniqueName: \"kubernetes.io/projected/c2ece298-1b7c-43ed-a06d-4f0684ba0180-kube-api-access-8m5cx\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:20:20.494985 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.494791    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b77a7447-7dda-48f7-ae38-5aa565402fc3-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-9rqk8\" (UID: \"b77a7447-7dda-48f7-ae38-5aa565402fc3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"
May 20 20:20:20.494985 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.494831    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs57z\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-kube-api-access-fs57z\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.494985 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.494855    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-ca-trust-extracted\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.494985 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.494873    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-certificates\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.494985 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.494925    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-installation-pull-secrets\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.494985 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.494946    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2ece298-1b7c-43ed-a06d-4f0684ba0180-tmp-dir\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:20:20.494985 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.494964    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.494985 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.494990    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-bound-sa-token\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.495429 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.495060    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert\") pod \"ingress-canary-jx4zj\" (UID: \"a60784d9-7267-4cdd-bfe1-9828b0ab3ee1\") " pod="openshift-ingress-canary/ingress-canary-jx4zj"
May 20 20:20:20.553110 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.553081    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:20:20.555497 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.555472    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 20 20:20:20.555780 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.555758    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qsfbr\""
May 20 20:20:20.596273 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.596249    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-ca-trust-extracted\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.596416 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.596279    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-certificates\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.596416 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.596302    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-installation-pull-secrets\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.596416 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.596330    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2ece298-1b7c-43ed-a06d-4f0684ba0180-tmp-dir\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:20:20.596416 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.596358    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.596416 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.596389    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-bound-sa-token\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.596673 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.596440    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert\") pod \"ingress-canary-jx4zj\" (UID: \"a60784d9-7267-4cdd-bfe1-9828b0ab3ee1\") " pod="openshift-ingress-canary/ingress-canary-jx4zj"
May 20 20:20:20.596673 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:20.596464    2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:20:20.596673 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:20.596484    2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8698d89747-fj9fs: secret "image-registry-tls" not found
May 20 20:20:20.596673 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:20.596528    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:20:20.596673 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.596469    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9xnb7\" (UniqueName: \"kubernetes.io/projected/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-kube-api-access-9xnb7\") pod \"ingress-canary-jx4zj\" (UID: \"a60784d9-7267-4cdd-bfe1-9828b0ab3ee1\") " pod="openshift-ingress-canary/ingress-canary-jx4zj"
May 20 20:20:20.596673 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:20.596601    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls podName:38f8c7f1-7e2e-4bde-94b6-963844a3bdf0 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:21.096579917 +0000 UTC m=+35.127745743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls") pod "image-registry-8698d89747-fj9fs" (UID: "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0") : secret "image-registry-tls" not found
May 20 20:20:20.596673 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:20.596645    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert podName:a60784d9-7267-4cdd-bfe1-9828b0ab3ee1 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:21.096629575 +0000 UTC m=+35.127795386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert") pod "ingress-canary-jx4zj" (UID: "a60784d9-7267-4cdd-bfe1-9828b0ab3ee1") : secret "canary-serving-cert" not found
May 20 20:20:20.596673 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.596666    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2ece298-1b7c-43ed-a06d-4f0684ba0180-tmp-dir\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:20:20.596673 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.596668    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-trusted-ca\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.597094 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.596718    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-image-registry-private-configuration\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.597094 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.596743    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2ece298-1b7c-43ed-a06d-4f0684ba0180-config-volume\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:20:20.597094 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.596749    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-ca-trust-extracted\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.597094 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.596783    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-9rqk8\" (UID: \"b77a7447-7dda-48f7-ae38-5aa565402fc3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"
May 20 20:20:20.597094 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.596834    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:20:20.597094 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:20.596853    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 20:20:20.597094 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.596864    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8m5cx\" (UniqueName: \"kubernetes.io/projected/c2ece298-1b7c-43ed-a06d-4f0684ba0180-kube-api-access-8m5cx\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:20:20.597094 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.596911    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b77a7447-7dda-48f7-ae38-5aa565402fc3-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-9rqk8\" (UID: \"b77a7447-7dda-48f7-ae38-5aa565402fc3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"
May 20 20:20:20.597094 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:20.596939    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert podName:b77a7447-7dda-48f7-ae38-5aa565402fc3 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:21.096921733 +0000 UTC m=+35.128087554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-9rqk8" (UID: "b77a7447-7dda-48f7-ae38-5aa565402fc3") : secret "networking-console-plugin-cert" not found
May 20 20:20:20.597094 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.596985    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fs57z\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-kube-api-access-fs57z\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.597539 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.597146    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-certificates\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.597539 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:20.597238    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:20:20.597539 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:20.597286    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls podName:c2ece298-1b7c-43ed-a06d-4f0684ba0180 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:21.097271602 +0000 UTC m=+35.128437425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls") pod "dns-default-ptgqm" (UID: "c2ece298-1b7c-43ed-a06d-4f0684ba0180") : secret "dns-default-metrics-tls" not found
May 20 20:20:20.597539 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.597295    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2ece298-1b7c-43ed-a06d-4f0684ba0180-config-volume\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:20:20.597539 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.597463    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b77a7447-7dda-48f7-ae38-5aa565402fc3-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-9rqk8\" (UID: \"b77a7447-7dda-48f7-ae38-5aa565402fc3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"
May 20 20:20:20.597539 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.597507    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-trusted-ca\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.600613 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.600590    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-installation-pull-secrets\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.600727 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.600671    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-image-registry-private-configuration\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.616563 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.616540    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-bound-sa-token\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.623242 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.623222    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs57z\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-kube-api-access-fs57z\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:20.638502 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.638480    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xnb7\" (UniqueName: \"kubernetes.io/projected/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-kube-api-access-9xnb7\") pod \"ingress-canary-jx4zj\" (UID: \"a60784d9-7267-4cdd-bfe1-9828b0ab3ee1\") " pod="openshift-ingress-canary/ingress-canary-jx4zj"
May 20 20:20:20.646939 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:20.646884    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m5cx\" (UniqueName: \"kubernetes.io/projected/c2ece298-1b7c-43ed-a06d-4f0684ba0180-kube-api-access-8m5cx\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:20:21.101687 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:21.101653    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert\") pod \"ingress-canary-jx4zj\" (UID: \"a60784d9-7267-4cdd-bfe1-9828b0ab3ee1\") " pod="openshift-ingress-canary/ingress-canary-jx4zj"
May 20 20:20:21.101860 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:21.101719    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-9rqk8\" (UID: \"b77a7447-7dda-48f7-ae38-5aa565402fc3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"
May 20 20:20:21.101860 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:21.101762    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:20:21.101860 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:21.101809    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:21.101860 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:21.101823    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:20:21.102036 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:21.101878    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 20:20:21.102036 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:21.101928    2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:20:21.102036 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:21.101942    2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8698d89747-fj9fs: secret "image-registry-tls" not found
May 20 20:20:21.102036 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:21.101886    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert podName:a60784d9-7267-4cdd-bfe1-9828b0ab3ee1 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:22.101871442 +0000 UTC m=+36.133037267 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert") pod "ingress-canary-jx4zj" (UID: "a60784d9-7267-4cdd-bfe1-9828b0ab3ee1") : secret "canary-serving-cert" not found
May 20 20:20:21.102036 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:21.101979    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert podName:b77a7447-7dda-48f7-ae38-5aa565402fc3 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:22.101961902 +0000 UTC m=+36.133127722 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-9rqk8" (UID: "b77a7447-7dda-48f7-ae38-5aa565402fc3") : secret "networking-console-plugin-cert" not found
May 20 20:20:21.102036 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:21.101996    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls podName:38f8c7f1-7e2e-4bde-94b6-963844a3bdf0 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:22.101985847 +0000 UTC m=+36.133151658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls") pod "image-registry-8698d89747-fj9fs" (UID: "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0") : secret "image-registry-tls" not found
May 20 20:20:21.102036 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:21.102022    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:20:21.102306 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:21.102081    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls podName:c2ece298-1b7c-43ed-a06d-4f0684ba0180 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:22.102068664 +0000 UTC m=+36.133234477 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls") pod "dns-default-ptgqm" (UID: "c2ece298-1b7c-43ed-a06d-4f0684ba0180") : secret "dns-default-metrics-tls" not found
May 20 20:20:21.552388 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:21.552266    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:20:21.552388 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:21.552266    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:20:21.555704 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:21.555677    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5c2rk\""
May 20 20:20:21.556090 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:21.555683    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 20 20:20:21.556576 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:21.556497    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 20 20:20:21.556576 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:21.556550    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 20 20:20:22.110326 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:22.110289    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:22.110512 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:22.110350    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert\") pod \"ingress-canary-jx4zj\" (UID: \"a60784d9-7267-4cdd-bfe1-9828b0ab3ee1\") " pod="openshift-ingress-canary/ingress-canary-jx4zj"
May 20 20:20:22.110512 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:22.110402    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-9rqk8\" (UID: \"b77a7447-7dda-48f7-ae38-5aa565402fc3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"
May 20 20:20:22.110512 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:22.110445    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:20:22.110512 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:22.110466    2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:20:22.110512 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:22.110491    2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8698d89747-fj9fs: secret "image-registry-tls" not found
May 20 20:20:22.110748 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:22.110466    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:20:22.110748 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:22.110559    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls podName:38f8c7f1-7e2e-4bde-94b6-963844a3bdf0 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:24.110538361 +0000 UTC m=+38.141704183 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls") pod "image-registry-8698d89747-fj9fs" (UID: "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0") : secret "image-registry-tls" not found
May 20 20:20:22.110748 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:22.110599    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert podName:a60784d9-7267-4cdd-bfe1-9828b0ab3ee1 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:24.110581281 +0000 UTC m=+38.141747105 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert") pod "ingress-canary-jx4zj" (UID: "a60784d9-7267-4cdd-bfe1-9828b0ab3ee1") : secret "canary-serving-cert" not found
May 20 20:20:22.110748 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:22.110544    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 20:20:22.110748 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:22.110644    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert podName:b77a7447-7dda-48f7-ae38-5aa565402fc3 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:24.11063325 +0000 UTC m=+38.141799070 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-9rqk8" (UID: "b77a7447-7dda-48f7-ae38-5aa565402fc3") : secret "networking-console-plugin-cert" not found
May 20 20:20:22.110748 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:22.110544    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:20:22.110748 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:22.110681    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls podName:c2ece298-1b7c-43ed-a06d-4f0684ba0180 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:24.110672472 +0000 UTC m=+38.141838292 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls") pod "dns-default-ptgqm" (UID: "c2ece298-1b7c-43ed-a06d-4f0684ba0180") : secret "dns-default-metrics-tls" not found
May 20 20:20:23.705766 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:23.705734    2566 generic.go:358] "Generic (PLEG): container finished" podID="203d6be2-2ddd-48be-9d18-8a17fa95d2c3" containerID="6e17d83410f743f304c164499f010e4f0fccc74c5ce2bdc82316aabc3f736ece" exitCode=0
May 20 20:20:23.706290 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:23.705797    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpmmg" event={"ID":"203d6be2-2ddd-48be-9d18-8a17fa95d2c3","Type":"ContainerDied","Data":"6e17d83410f743f304c164499f010e4f0fccc74c5ce2bdc82316aabc3f736ece"}
May 20 20:20:24.128265 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:24.128229    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-9rqk8\" (UID: \"b77a7447-7dda-48f7-ae38-5aa565402fc3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"
May 20 20:20:24.128407 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:24.128281    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:20:24.128407 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:24.128313    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:24.128407 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:24.128343    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert\") pod \"ingress-canary-jx4zj\" (UID: \"a60784d9-7267-4cdd-bfe1-9828b0ab3ee1\") " pod="openshift-ingress-canary/ingress-canary-jx4zj"
May 20 20:20:24.128407 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:24.128369    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 20:20:24.128527 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:24.128419    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:20:24.128527 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:24.128424    2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:20:24.128527 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:24.128437    2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8698d89747-fj9fs: secret "image-registry-tls" not found
May 20 20:20:24.128527 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:24.128443    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert podName:b77a7447-7dda-48f7-ae38-5aa565402fc3 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:28.128423248 +0000 UTC m=+42.159589071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-9rqk8" (UID: "b77a7447-7dda-48f7-ae38-5aa565402fc3") : secret "networking-console-plugin-cert" not found
May 20 20:20:24.128527 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:24.128460    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls podName:c2ece298-1b7c-43ed-a06d-4f0684ba0180 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:28.128452102 +0000 UTC m=+42.159617907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls") pod "dns-default-ptgqm" (UID: "c2ece298-1b7c-43ed-a06d-4f0684ba0180") : secret "dns-default-metrics-tls" not found
May 20 20:20:24.128527 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:24.128483    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls podName:38f8c7f1-7e2e-4bde-94b6-963844a3bdf0 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:28.128468823 +0000 UTC m=+42.159634645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls") pod "image-registry-8698d89747-fj9fs" (UID: "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0") : secret "image-registry-tls" not found
May 20 20:20:24.128527 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:24.128501    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:20:24.128731 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:24.128547    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert podName:a60784d9-7267-4cdd-bfe1-9828b0ab3ee1 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:28.128534413 +0000 UTC m=+42.159700233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert") pod "ingress-canary-jx4zj" (UID: "a60784d9-7267-4cdd-bfe1-9828b0ab3ee1") : secret "canary-serving-cert" not found
May 20 20:20:24.710072 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:24.710032    2566 generic.go:358] "Generic (PLEG): container finished" podID="203d6be2-2ddd-48be-9d18-8a17fa95d2c3" containerID="df61086e321dd8bdaf266ae839563c7055e4da3016ea6647c5fdebe0e1fce0ac" exitCode=0
May 20 20:20:24.710421 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:24.710105    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpmmg" event={"ID":"203d6be2-2ddd-48be-9d18-8a17fa95d2c3","Type":"ContainerDied","Data":"df61086e321dd8bdaf266ae839563c7055e4da3016ea6647c5fdebe0e1fce0ac"}
May 20 20:20:25.714766 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:25.714730    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpmmg" event={"ID":"203d6be2-2ddd-48be-9d18-8a17fa95d2c3","Type":"ContainerStarted","Data":"4ce264d8b79ee149be409cc9ea11a2e23523015a18a518b9c54804f16aaeab38"}
May 20 20:20:25.739078 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:25.739032    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tpmmg" podStartSLOduration=5.569435703 podStartE2EDuration="39.73900654s" podCreationTimestamp="2026-05-20 20:19:46 +0000 UTC" firstStartedPulling="2026-05-20 20:19:49.147818728 +0000 UTC m=+3.178984533" lastFinishedPulling="2026-05-20 20:20:23.317389561 +0000 UTC m=+37.348555370" observedRunningTime="2026-05-20 20:20:25.7378303 +0000 UTC m=+39.768996126" watchObservedRunningTime="2026-05-20 20:20:25.73900654 +0000 UTC m=+39.770172367"
May 20 20:20:26.242033 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:26.242001    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret\") pod \"global-pull-secret-syncer-btjv5\" (UID: \"137212f9-191f-4845-bf90-69a40a5f1ac0\") " pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:20:26.245806 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:26.245773    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/137212f9-191f-4845-bf90-69a40a5f1ac0-original-pull-secret\") pod \"global-pull-secret-syncer-btjv5\" (UID: \"137212f9-191f-4845-bf90-69a40a5f1ac0\") " pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:20:26.372797 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:26.372763    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btjv5"
May 20 20:20:26.570151 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:26.570123    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-btjv5"]
May 20 20:20:26.573489 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:20:26.573460    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod137212f9_191f_4845_bf90_69a40a5f1ac0.slice/crio-a339ca0ea4272916722965b57a0720619286cc65edd0c9d10f65f472cf797049 WatchSource:0}: Error finding container a339ca0ea4272916722965b57a0720619286cc65edd0c9d10f65f472cf797049: Status 404 returned error can't find the container with id a339ca0ea4272916722965b57a0720619286cc65edd0c9d10f65f472cf797049
May 20 20:20:26.717517 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:26.717481    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-btjv5" event={"ID":"137212f9-191f-4845-bf90-69a40a5f1ac0","Type":"ContainerStarted","Data":"a339ca0ea4272916722965b57a0720619286cc65edd0c9d10f65f472cf797049"}
May 20 20:20:28.159088 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:28.159048    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:28.159546 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:28.159222    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert\") pod \"ingress-canary-jx4zj\" (UID: \"a60784d9-7267-4cdd-bfe1-9828b0ab3ee1\") " pod="openshift-ingress-canary/ingress-canary-jx4zj"
May 20 20:20:28.159546 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:28.159227    2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:20:28.159546 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:28.159253    2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8698d89747-fj9fs: secret "image-registry-tls" not found
May 20 20:20:28.159546 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:28.159268    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-9rqk8\" (UID: \"b77a7447-7dda-48f7-ae38-5aa565402fc3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"
May 20 20:20:28.159546 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:28.159351    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls podName:38f8c7f1-7e2e-4bde-94b6-963844a3bdf0 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:36.159329807 +0000 UTC m=+50.190495616 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls") pod "image-registry-8698d89747-fj9fs" (UID: "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0") : secret "image-registry-tls" not found
May 20 20:20:28.159546 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:28.159366    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 20:20:28.159546 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:28.159407    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:20:28.159546 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:28.159417    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert podName:b77a7447-7dda-48f7-ae38-5aa565402fc3 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:36.159402407 +0000 UTC m=+50.190568217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-9rqk8" (UID: "b77a7447-7dda-48f7-ae38-5aa565402fc3") : secret "networking-console-plugin-cert" not found
May 20 20:20:28.159546 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:28.159367    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:20:28.159546 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:28.159476    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:20:28.159546 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:28.159509    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert podName:a60784d9-7267-4cdd-bfe1-9828b0ab3ee1 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:36.159488711 +0000 UTC m=+50.190654520 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert") pod "ingress-canary-jx4zj" (UID: "a60784d9-7267-4cdd-bfe1-9828b0ab3ee1") : secret "canary-serving-cert" not found
May 20 20:20:28.159546 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:28.159532    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls podName:c2ece298-1b7c-43ed-a06d-4f0684ba0180 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:36.159521394 +0000 UTC m=+50.190687204 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls") pod "dns-default-ptgqm" (UID: "c2ece298-1b7c-43ed-a06d-4f0684ba0180") : secret "dns-default-metrics-tls" not found
May 20 20:20:30.726933 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:30.726830    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-btjv5" event={"ID":"137212f9-191f-4845-bf90-69a40a5f1ac0","Type":"ContainerStarted","Data":"b3a188d9137191a3bba9145bf85da5f7f5a9fc77cc9da0cbdcf9b7201d79e7e8"}
May 20 20:20:30.745220 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:30.745171    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-btjv5" podStartSLOduration=32.938189359 podStartE2EDuration="36.745158209s" podCreationTimestamp="2026-05-20 20:19:54 +0000 UTC" firstStartedPulling="2026-05-20 20:20:26.575124687 +0000 UTC m=+40.606290493" lastFinishedPulling="2026-05-20 20:20:30.382093539 +0000 UTC m=+44.413259343" observedRunningTime="2026-05-20 20:20:30.744156925 +0000 UTC m=+44.775322751" watchObservedRunningTime="2026-05-20 20:20:30.745158209 +0000 UTC m=+44.776324032"
May 20 20:20:36.223178 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:36.223139    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:36.223662 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:36.223196    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert\") pod \"ingress-canary-jx4zj\" (UID: \"a60784d9-7267-4cdd-bfe1-9828b0ab3ee1\") " pod="openshift-ingress-canary/ingress-canary-jx4zj"
May 20 20:20:36.223662 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:36.223221    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-9rqk8\" (UID: \"b77a7447-7dda-48f7-ae38-5aa565402fc3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"
May 20 20:20:36.223662 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:36.223250    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:20:36.223662 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:36.223333    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:20:36.223662 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:36.223362    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 20:20:36.223662 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:36.223380    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls podName:c2ece298-1b7c-43ed-a06d-4f0684ba0180 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:52.223367213 +0000 UTC m=+66.254533030 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls") pod "dns-default-ptgqm" (UID: "c2ece298-1b7c-43ed-a06d-4f0684ba0180") : secret "dns-default-metrics-tls" not found
May 20 20:20:36.223662 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:36.223424    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert podName:b77a7447-7dda-48f7-ae38-5aa565402fc3 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:52.223409911 +0000 UTC m=+66.254575717 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-9rqk8" (UID: "b77a7447-7dda-48f7-ae38-5aa565402fc3") : secret "networking-console-plugin-cert" not found
May 20 20:20:36.223662 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:36.223330    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:20:36.223662 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:36.223460    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert podName:a60784d9-7267-4cdd-bfe1-9828b0ab3ee1 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:52.22345156 +0000 UTC m=+66.254617365 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert") pod "ingress-canary-jx4zj" (UID: "a60784d9-7267-4cdd-bfe1-9828b0ab3ee1") : secret "canary-serving-cert" not found
May 20 20:20:36.223662 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:36.223371    2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:20:36.223662 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:36.223477    2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8698d89747-fj9fs: secret "image-registry-tls" not found
May 20 20:20:36.223662 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:36.223496    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls podName:38f8c7f1-7e2e-4bde-94b6-963844a3bdf0 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:52.223490885 +0000 UTC m=+66.254656690 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls") pod "image-registry-8698d89747-fj9fs" (UID: "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0") : secret "image-registry-tls" not found
May 20 20:20:45.720453 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:45.720417    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-njrxw"
May 20 20:20:52.238849 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:52.238813    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-9rqk8\" (UID: \"b77a7447-7dda-48f7-ae38-5aa565402fc3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"
May 20 20:20:52.238849 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:52.238863    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:20:52.239422 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:52.238987    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:20:52.239422 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:52.238993    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 20:20:52.239422 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:52.239034    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls podName:c2ece298-1b7c-43ed-a06d-4f0684ba0180 nodeName:}" failed. No retries permitted until 2026-05-20 20:21:24.239020166 +0000 UTC m=+98.270185989 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls") pod "dns-default-ptgqm" (UID: "c2ece298-1b7c-43ed-a06d-4f0684ba0180") : secret "dns-default-metrics-tls" not found
May 20 20:20:52.239422 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:52.239026    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:20:52.239422 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:52.239057    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert podName:b77a7447-7dda-48f7-ae38-5aa565402fc3 nodeName:}" failed. No retries permitted until 2026-05-20 20:21:24.239040673 +0000 UTC m=+98.270206496 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-9rqk8" (UID: "b77a7447-7dda-48f7-ae38-5aa565402fc3") : secret "networking-console-plugin-cert" not found
May 20 20:20:52.239422 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:52.239097    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs\") pod \"network-metrics-daemon-lpcq8\" (UID: \"58397932-927e-4bcb-8ccd-3ba17d08a9f0\") " pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:20:52.239422 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:52.239115    2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:20:52.239422 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:52.239127    2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8698d89747-fj9fs: secret "image-registry-tls" not found
May 20 20:20:52.239422 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:52.239145    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert\") pod \"ingress-canary-jx4zj\" (UID: \"a60784d9-7267-4cdd-bfe1-9828b0ab3ee1\") " pod="openshift-ingress-canary/ingress-canary-jx4zj"
May 20 20:20:52.239422 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:52.239174    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls podName:38f8c7f1-7e2e-4bde-94b6-963844a3bdf0 nodeName:}" failed. No retries permitted until 2026-05-20 20:21:24.239161551 +0000 UTC m=+98.270327367 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls") pod "image-registry-8698d89747-fj9fs" (UID: "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0") : secret "image-registry-tls" not found
May 20 20:20:52.239422 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:52.239212    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:20:52.239422 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:52.239247    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert podName:a60784d9-7267-4cdd-bfe1-9828b0ab3ee1 nodeName:}" failed. No retries permitted until 2026-05-20 20:21:24.239236293 +0000 UTC m=+98.270402101 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert") pod "ingress-canary-jx4zj" (UID: "a60784d9-7267-4cdd-bfe1-9828b0ab3ee1") : secret "canary-serving-cert" not found
May 20 20:20:52.241534 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:52.241515    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 20 20:20:52.249915 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:52.249902    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 20 20:20:52.249977 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:20:52.249949    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs podName:58397932-927e-4bcb-8ccd-3ba17d08a9f0 nodeName:}" failed. No retries permitted until 2026-05-20 20:21:56.249938141 +0000 UTC m=+130.281103945 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs") pod "network-metrics-daemon-lpcq8" (UID: "58397932-927e-4bcb-8ccd-3ba17d08a9f0") : secret "metrics-daemon-secret" not found
May 20 20:20:52.440614 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:52.440577    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2xb\" (UniqueName: \"kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb\") pod \"network-check-target-gggx7\" (UID: \"e490d1ca-0378-490c-8a3c-52cb7cc2e4fb\") " pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:20:52.443312 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:52.443294    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 20 20:20:52.453506 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:52.453489    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 20 20:20:52.464213 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:52.464188    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc2xb\" (UniqueName: \"kubernetes.io/projected/e490d1ca-0378-490c-8a3c-52cb7cc2e4fb-kube-api-access-lc2xb\") pod \"network-check-target-gggx7\" (UID: \"e490d1ca-0378-490c-8a3c-52cb7cc2e4fb\") " pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:20:52.470152 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:52.470135    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5c2rk\""
May 20 20:20:52.478167 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:52.478154    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:20:52.645681 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:52.645650    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gggx7"]
May 20 20:20:52.649482 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:20:52.649451    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode490d1ca_0378_490c_8a3c_52cb7cc2e4fb.slice/crio-0b9bd125ad38d2ab82af516692a1f4f8db12af37aa623ab5ef67f8e61d3cb1f5 WatchSource:0}: Error finding container 0b9bd125ad38d2ab82af516692a1f4f8db12af37aa623ab5ef67f8e61d3cb1f5: Status 404 returned error can't find the container with id 0b9bd125ad38d2ab82af516692a1f4f8db12af37aa623ab5ef67f8e61d3cb1f5
May 20 20:20:52.766631 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:52.766592    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gggx7" event={"ID":"e490d1ca-0378-490c-8a3c-52cb7cc2e4fb","Type":"ContainerStarted","Data":"0b9bd125ad38d2ab82af516692a1f4f8db12af37aa623ab5ef67f8e61d3cb1f5"}
May 20 20:20:55.774184 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:55.774098    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gggx7" event={"ID":"e490d1ca-0378-490c-8a3c-52cb7cc2e4fb","Type":"ContainerStarted","Data":"84e92a184caeac70dde49029b5f769b9d48ad4c1d558aed234cec27750fcbf4d"}
May 20 20:20:55.774536 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:55.774337    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:20:55.791704 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:55.791662    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gggx7" podStartSLOduration=67.055179235 podStartE2EDuration="1m9.791652131s" podCreationTimestamp="2026-05-20 20:19:46 +0000 UTC" firstStartedPulling="2026-05-20 20:20:52.651101112 +0000 UTC m=+66.682266917" lastFinishedPulling="2026-05-20 20:20:55.387573995 +0000 UTC m=+69.418739813" observedRunningTime="2026-05-20 20:20:55.790278585 +0000 UTC m=+69.821444411" watchObservedRunningTime="2026-05-20 20:20:55.791652131 +0000 UTC m=+69.822817958"
May 20 20:20:58.092293 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:58.092257    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7"]
May 20 20:20:58.093977 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:58.093960    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7"
May 20 20:20:58.098667 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:58.098646    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 20 20:20:58.099196 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:58.099177    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 20 20:20:58.099305 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:58.099285    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 20 20:20:58.099575 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:58.099556    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 20 20:20:58.118776 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:58.118748    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7"]
May 20 20:20:58.184440 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:58.184412    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9kpq\" (UniqueName: \"kubernetes.io/projected/ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b-kube-api-access-d9kpq\") pod \"klusterlet-addon-workmgr-564f7b8f54-26mv7\" (UID: \"ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7"
May 20 20:20:58.184562 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:58.184446    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b-tmp\") pod \"klusterlet-addon-workmgr-564f7b8f54-26mv7\" (UID: \"ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7"
May 20 20:20:58.184607 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:58.184557    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b-klusterlet-config\") pod \"klusterlet-addon-workmgr-564f7b8f54-26mv7\" (UID: \"ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7"
May 20 20:20:58.285346 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:58.285302    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b-klusterlet-config\") pod \"klusterlet-addon-workmgr-564f7b8f54-26mv7\" (UID: \"ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7"
May 20 20:20:58.285471 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:58.285362    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9kpq\" (UniqueName: \"kubernetes.io/projected/ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b-kube-api-access-d9kpq\") pod \"klusterlet-addon-workmgr-564f7b8f54-26mv7\" (UID: \"ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7"
May 20 20:20:58.285471 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:58.285384    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b-tmp\") pod \"klusterlet-addon-workmgr-564f7b8f54-26mv7\" (UID: \"ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7"
May 20 20:20:58.285782 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:58.285763    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b-tmp\") pod \"klusterlet-addon-workmgr-564f7b8f54-26mv7\" (UID: \"ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7"
May 20 20:20:58.287785 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:58.287767    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b-klusterlet-config\") pod \"klusterlet-addon-workmgr-564f7b8f54-26mv7\" (UID: \"ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7"
May 20 20:20:58.293938 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:58.293911    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9kpq\" (UniqueName: \"kubernetes.io/projected/ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b-kube-api-access-d9kpq\") pod \"klusterlet-addon-workmgr-564f7b8f54-26mv7\" (UID: \"ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7"
May 20 20:20:58.402950 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:58.402857    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7"
May 20 20:20:58.527754 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:58.527727    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7"]
May 20 20:20:58.530667 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:20:58.530641    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee2e9b9f_e02c_4ca6_994d_84f7979a1e2b.slice/crio-a0797f9532a55ee64a4530144994496f3e1e13a8d06bd801b4d3b208da1fe704 WatchSource:0}: Error finding container a0797f9532a55ee64a4530144994496f3e1e13a8d06bd801b4d3b208da1fe704: Status 404 returned error can't find the container with id a0797f9532a55ee64a4530144994496f3e1e13a8d06bd801b4d3b208da1fe704
May 20 20:20:58.780170 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:20:58.780082    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7" event={"ID":"ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b","Type":"ContainerStarted","Data":"a0797f9532a55ee64a4530144994496f3e1e13a8d06bd801b4d3b208da1fe704"}
May 20 20:21:02.790093 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:21:02.789998    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7" event={"ID":"ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b","Type":"ContainerStarted","Data":"cdc542f41b7eeb8676451bff884c8670b01b2054c5bbe3c8a44c6e2f490123a3"}
May 20 20:21:02.790531 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:21:02.790239    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7"
May 20 20:21:02.791742 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:21:02.791719    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7"
May 20 20:21:02.810518 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:21:02.810474    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7" podStartSLOduration=0.891419809 podStartE2EDuration="4.810461964s" podCreationTimestamp="2026-05-20 20:20:58 +0000 UTC" firstStartedPulling="2026-05-20 20:20:58.532335029 +0000 UTC m=+72.563500834" lastFinishedPulling="2026-05-20 20:21:02.451377175 +0000 UTC m=+76.482542989" observedRunningTime="2026-05-20 20:21:02.809202967 +0000 UTC m=+76.840368793" watchObservedRunningTime="2026-05-20 20:21:02.810461964 +0000 UTC m=+76.841627790"
May 20 20:21:24.281815 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:21:24.281771    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert\") pod \"ingress-canary-jx4zj\" (UID: \"a60784d9-7267-4cdd-bfe1-9828b0ab3ee1\") " pod="openshift-ingress-canary/ingress-canary-jx4zj"
May 20 20:21:24.281815 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:21:24.281829    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-9rqk8\" (UID: \"b77a7447-7dda-48f7-ae38-5aa565402fc3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"
May 20 20:21:24.282396 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:21:24.281856    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:21:24.282396 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:21:24.281944    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:21:24.282396 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:21:24.281958    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:21:24.282396 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:21:24.281964    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 20:21:24.282396 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:21:24.282008    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls podName:c2ece298-1b7c-43ed-a06d-4f0684ba0180 nodeName:}" failed. No retries permitted until 2026-05-20 20:22:28.28199145 +0000 UTC m=+162.313157261 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls") pod "dns-default-ptgqm" (UID: "c2ece298-1b7c-43ed-a06d-4f0684ba0180") : secret "dns-default-metrics-tls" not found
May 20 20:21:24.282396 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:21:24.282038    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert podName:b77a7447-7dda-48f7-ae38-5aa565402fc3 nodeName:}" failed. No retries permitted until 2026-05-20 20:22:28.282017167 +0000 UTC m=+162.313182987 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-9rqk8" (UID: "b77a7447-7dda-48f7-ae38-5aa565402fc3") : secret "networking-console-plugin-cert" not found
May 20 20:21:24.282396 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:21:24.282056    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert podName:a60784d9-7267-4cdd-bfe1-9828b0ab3ee1 nodeName:}" failed. No retries permitted until 2026-05-20 20:22:28.282047964 +0000 UTC m=+162.313213768 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert") pod "ingress-canary-jx4zj" (UID: "a60784d9-7267-4cdd-bfe1-9828b0ab3ee1") : secret "canary-serving-cert" not found
May 20 20:21:24.282396 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:21:24.282088    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:21:24.282396 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:21:24.282201    2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:21:24.282396 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:21:24.282220    2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8698d89747-fj9fs: secret "image-registry-tls" not found
May 20 20:21:24.282396 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:21:24.282266    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls podName:38f8c7f1-7e2e-4bde-94b6-963844a3bdf0 nodeName:}" failed. No retries permitted until 2026-05-20 20:22:28.28225595 +0000 UTC m=+162.313421755 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls") pod "image-registry-8698d89747-fj9fs" (UID: "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0") : secret "image-registry-tls" not found
May 20 20:21:26.778133 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:21:26.778104    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gggx7"
May 20 20:21:56.316018 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:21:56.315958    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs\") pod \"network-metrics-daemon-lpcq8\" (UID: \"58397932-927e-4bcb-8ccd-3ba17d08a9f0\") " pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:21:56.316504 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:21:56.316106    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 20 20:21:56.316504 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:21:56.316182    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs podName:58397932-927e-4bcb-8ccd-3ba17d08a9f0 nodeName:}" failed. No retries permitted until 2026-05-20 20:23:58.316167183 +0000 UTC m=+252.347332988 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs") pod "network-metrics-daemon-lpcq8" (UID: "58397932-927e-4bcb-8ccd-3ba17d08a9f0") : secret "metrics-daemon-secret" not found
May 20 20:22:23.360884 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:23.360816    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8698d89747-fj9fs" podUID="38f8c7f1-7e2e-4bde-94b6-963844a3bdf0"
May 20 20:22:23.389104 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:23.389075    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ptgqm" podUID="c2ece298-1b7c-43ed-a06d-4f0684ba0180"
May 20 20:22:23.397262 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:23.397226    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8" podUID="b77a7447-7dda-48f7-ae38-5aa565402fc3"
May 20 20:22:23.403574 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:23.403539    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-jx4zj" podUID="a60784d9-7267-4cdd-bfe1-9828b0ab3ee1"
May 20 20:22:23.430819 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.430782    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-6grhs"]
May 20 20:22:23.432656 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.432640    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-6grhs"
May 20 20:22:23.438120 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.438094    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 20 20:22:23.438311 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.438191    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 20 20:22:23.438999 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.438814    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 20 20:22:23.438999 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.438835    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 20 20:22:23.438999 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.438924    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wppr8\""
May 20 20:22:23.449747 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.449716    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-6grhs"]
May 20 20:22:23.510917 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.510862    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2edf8992-3677-4bdd-a809-e15044dd2758-config\") pod \"service-ca-operator-57b5b68b8-6grhs\" (UID: \"2edf8992-3677-4bdd-a809-e15044dd2758\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-6grhs"
May 20 20:22:23.511095 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.511047    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fg6f\" (UniqueName: \"kubernetes.io/projected/2edf8992-3677-4bdd-a809-e15044dd2758-kube-api-access-5fg6f\") pod \"service-ca-operator-57b5b68b8-6grhs\" (UID: \"2edf8992-3677-4bdd-a809-e15044dd2758\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-6grhs"
May 20 20:22:23.511095 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.511089    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2edf8992-3677-4bdd-a809-e15044dd2758-serving-cert\") pod \"service-ca-operator-57b5b68b8-6grhs\" (UID: \"2edf8992-3677-4bdd-a809-e15044dd2758\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-6grhs"
May 20 20:22:23.539147 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.539100    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-djnfn"]
May 20 20:22:23.540971 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.540956    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-749647ff5d-8v29b"]
May 20 20:22:23.541118 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.541101    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-djnfn"
May 20 20:22:23.542644 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.542625    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:23.545155 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.545134    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9wwdc\""
May 20 20:22:23.545324 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.545310    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 20 20:22:23.545441 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.545426    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 20 20:22:23.545550 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.545534    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 20 20:22:23.546035 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.546022    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 20 20:22:23.546100 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.546038    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 20 20:22:23.546394 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.546380    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 20 20:22:23.546544 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.546509    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-n56sn\""
May 20 20:22:23.546644 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.546565    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 20 20:22:23.547642 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.547615    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 20 20:22:23.548003 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.547921    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 20 20:22:23.555711 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.555687    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-djnfn"]
May 20 20:22:23.556707 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.556685    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-749647ff5d-8v29b"]
May 20 20:22:23.562825 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:23.562791    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lpcq8" podUID="58397932-927e-4bcb-8ccd-3ba17d08a9f0"
May 20 20:22:23.611598 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.611499    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9fgz\" (UniqueName: \"kubernetes.io/projected/5d27558d-7a25-4579-8a85-5cabee8215cb-kube-api-access-x9fgz\") pod \"cluster-samples-operator-697587599-djnfn\" (UID: \"5d27558d-7a25-4579-8a85-5cabee8215cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-djnfn"
May 20 20:22:23.611598 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.611544    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-stats-auth\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:23.611598 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.611574    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2edf8992-3677-4bdd-a809-e15044dd2758-serving-cert\") pod \"service-ca-operator-57b5b68b8-6grhs\" (UID: \"2edf8992-3677-4bdd-a809-e15044dd2758\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-6grhs"
May 20 20:22:23.611598 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.611598    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2edf8992-3677-4bdd-a809-e15044dd2758-config\") pod \"service-ca-operator-57b5b68b8-6grhs\" (UID: \"2edf8992-3677-4bdd-a809-e15044dd2758\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-6grhs"
May 20 20:22:23.611928 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.611653    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d27558d-7a25-4579-8a85-5cabee8215cb-samples-operator-tls\") pod \"cluster-samples-operator-697587599-djnfn\" (UID: \"5d27558d-7a25-4579-8a85-5cabee8215cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-djnfn"
May 20 20:22:23.611928 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.611682    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:23.611928 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.611727    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scqgc\" (UniqueName: \"kubernetes.io/projected/eed2efee-a682-4683-9b34-4449d997843b-kube-api-access-scqgc\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:23.611928 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.611754    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-default-certificate\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:23.611928 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.611812    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:23.611928 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.611927    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5fg6f\" (UniqueName: \"kubernetes.io/projected/2edf8992-3677-4bdd-a809-e15044dd2758-kube-api-access-5fg6f\") pod \"service-ca-operator-57b5b68b8-6grhs\" (UID: \"2edf8992-3677-4bdd-a809-e15044dd2758\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-6grhs"
May 20 20:22:23.612214 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.612191    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2edf8992-3677-4bdd-a809-e15044dd2758-config\") pod \"service-ca-operator-57b5b68b8-6grhs\" (UID: \"2edf8992-3677-4bdd-a809-e15044dd2758\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-6grhs"
May 20 20:22:23.613866 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.613846    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2edf8992-3677-4bdd-a809-e15044dd2758-serving-cert\") pod \"service-ca-operator-57b5b68b8-6grhs\" (UID: \"2edf8992-3677-4bdd-a809-e15044dd2758\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-6grhs"
May 20 20:22:23.619710 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.619682    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fg6f\" (UniqueName: \"kubernetes.io/projected/2edf8992-3677-4bdd-a809-e15044dd2758-kube-api-access-5fg6f\") pod \"service-ca-operator-57b5b68b8-6grhs\" (UID: \"2edf8992-3677-4bdd-a809-e15044dd2758\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-6grhs"
May 20 20:22:23.712742 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.712707    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9fgz\" (UniqueName: \"kubernetes.io/projected/5d27558d-7a25-4579-8a85-5cabee8215cb-kube-api-access-x9fgz\") pod \"cluster-samples-operator-697587599-djnfn\" (UID: \"5d27558d-7a25-4579-8a85-5cabee8215cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-djnfn"
May 20 20:22:23.712742 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.712749    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-stats-auth\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:23.713099 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.712809    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d27558d-7a25-4579-8a85-5cabee8215cb-samples-operator-tls\") pod \"cluster-samples-operator-697587599-djnfn\" (UID: \"5d27558d-7a25-4579-8a85-5cabee8215cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-djnfn"
May 20 20:22:23.713099 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.712837    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:23.713099 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.712884    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scqgc\" (UniqueName: \"kubernetes.io/projected/eed2efee-a682-4683-9b34-4449d997843b-kube-api-access-scqgc\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:23.713099 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.712926    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-default-certificate\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:23.713099 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.712955    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:23.713099 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:23.712977    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 20 20:22:23.713099 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:23.712988    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 20:22:23.713099 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:23.713056    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs podName:eed2efee-a682-4683-9b34-4449d997843b nodeName:}" failed. No retries permitted until 2026-05-20 20:22:24.213033557 +0000 UTC m=+158.244199363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs") pod "router-default-749647ff5d-8v29b" (UID: "eed2efee-a682-4683-9b34-4449d997843b") : secret "router-metrics-certs-default" not found
May 20 20:22:23.713099 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:23.713091    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d27558d-7a25-4579-8a85-5cabee8215cb-samples-operator-tls podName:5d27558d-7a25-4579-8a85-5cabee8215cb nodeName:}" failed. No retries permitted until 2026-05-20 20:22:24.213079525 +0000 UTC m=+158.244245344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5d27558d-7a25-4579-8a85-5cabee8215cb-samples-operator-tls") pod "cluster-samples-operator-697587599-djnfn" (UID: "5d27558d-7a25-4579-8a85-5cabee8215cb") : secret "samples-operator-tls" not found
May 20 20:22:23.713425 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:23.713119    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle podName:eed2efee-a682-4683-9b34-4449d997843b nodeName:}" failed. No retries permitted until 2026-05-20 20:22:24.213102649 +0000 UTC m=+158.244268487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle") pod "router-default-749647ff5d-8v29b" (UID: "eed2efee-a682-4683-9b34-4449d997843b") : configmap references non-existent config key: service-ca.crt
May 20 20:22:23.715294 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.715269    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-default-certificate\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:23.715401 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.715278    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-stats-auth\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:23.721351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.721326    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9fgz\" (UniqueName: \"kubernetes.io/projected/5d27558d-7a25-4579-8a85-5cabee8215cb-kube-api-access-x9fgz\") pod \"cluster-samples-operator-697587599-djnfn\" (UID: \"5d27558d-7a25-4579-8a85-5cabee8215cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-djnfn"
May 20 20:22:23.721786 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.721764    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scqgc\" (UniqueName: \"kubernetes.io/projected/eed2efee-a682-4683-9b34-4449d997843b-kube-api-access-scqgc\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:23.740927 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.740885    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-6grhs"
May 20 20:22:23.865886 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.865803    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-6grhs"]
May 20 20:22:23.870229 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:22:23.870196    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2edf8992_3677_4bdd_a809_e15044dd2758.slice/crio-d2c7dec87cd3f450e959b1165f8ca02f8672c9a3ceb64635884952b188dd519c WatchSource:0}: Error finding container d2c7dec87cd3f450e959b1165f8ca02f8672c9a3ceb64635884952b188dd519c: Status 404 returned error can't find the container with id d2c7dec87cd3f450e959b1165f8ca02f8672c9a3ceb64635884952b188dd519c
May 20 20:22:23.941638 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.941608    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ptgqm"
May 20 20:22:23.941638 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.941620    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-6grhs" event={"ID":"2edf8992-3677-4bdd-a809-e15044dd2758","Type":"ContainerStarted","Data":"d2c7dec87cd3f450e959b1165f8ca02f8672c9a3ceb64635884952b188dd519c"}
May 20 20:22:23.941882 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.941636    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jx4zj"
May 20 20:22:23.941882 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.941608    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"
May 20 20:22:23.941882 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:23.941723    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:22:24.217282 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:24.217189    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d27558d-7a25-4579-8a85-5cabee8215cb-samples-operator-tls\") pod \"cluster-samples-operator-697587599-djnfn\" (UID: \"5d27558d-7a25-4579-8a85-5cabee8215cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-djnfn"
May 20 20:22:24.217282 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:24.217233    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:24.217485 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:24.217285    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:24.217485 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:24.217342    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 20:22:24.217485 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:24.217399    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 20 20:22:24.217485 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:24.217410    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d27558d-7a25-4579-8a85-5cabee8215cb-samples-operator-tls podName:5d27558d-7a25-4579-8a85-5cabee8215cb nodeName:}" failed. No retries permitted until 2026-05-20 20:22:25.217393428 +0000 UTC m=+159.248559251 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5d27558d-7a25-4579-8a85-5cabee8215cb-samples-operator-tls") pod "cluster-samples-operator-697587599-djnfn" (UID: "5d27558d-7a25-4579-8a85-5cabee8215cb") : secret "samples-operator-tls" not found
May 20 20:22:24.217485 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:24.217470    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs podName:eed2efee-a682-4683-9b34-4449d997843b nodeName:}" failed. No retries permitted until 2026-05-20 20:22:25.21745092 +0000 UTC m=+159.248616739 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs") pod "router-default-749647ff5d-8v29b" (UID: "eed2efee-a682-4683-9b34-4449d997843b") : secret "router-metrics-certs-default" not found
May 20 20:22:24.217485 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:24.217486    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle podName:eed2efee-a682-4683-9b34-4449d997843b nodeName:}" failed. No retries permitted until 2026-05-20 20:22:25.217476746 +0000 UTC m=+159.248642557 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle") pod "router-default-749647ff5d-8v29b" (UID: "eed2efee-a682-4683-9b34-4449d997843b") : configmap references non-existent config key: service-ca.crt
May 20 20:22:25.227621 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:25.227568    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d27558d-7a25-4579-8a85-5cabee8215cb-samples-operator-tls\") pod \"cluster-samples-operator-697587599-djnfn\" (UID: \"5d27558d-7a25-4579-8a85-5cabee8215cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-djnfn"
May 20 20:22:25.227621 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:25.227626    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:25.228128 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:25.227681    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:25.228128 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:25.227716    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 20:22:25.228128 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:25.227780    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d27558d-7a25-4579-8a85-5cabee8215cb-samples-operator-tls podName:5d27558d-7a25-4579-8a85-5cabee8215cb nodeName:}" failed. No retries permitted until 2026-05-20 20:22:27.227764772 +0000 UTC m=+161.258930590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5d27558d-7a25-4579-8a85-5cabee8215cb-samples-operator-tls") pod "cluster-samples-operator-697587599-djnfn" (UID: "5d27558d-7a25-4579-8a85-5cabee8215cb") : secret "samples-operator-tls" not found
May 20 20:22:25.228128 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:25.227802    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 20 20:22:25.228128 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:25.227838    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle podName:eed2efee-a682-4683-9b34-4449d997843b nodeName:}" failed. No retries permitted until 2026-05-20 20:22:27.227822764 +0000 UTC m=+161.258988593 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle") pod "router-default-749647ff5d-8v29b" (UID: "eed2efee-a682-4683-9b34-4449d997843b") : configmap references non-existent config key: service-ca.crt
May 20 20:22:25.228128 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:25.227859    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs podName:eed2efee-a682-4683-9b34-4449d997843b nodeName:}" failed. No retries permitted until 2026-05-20 20:22:27.227848888 +0000 UTC m=+161.259014696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs") pod "router-default-749647ff5d-8v29b" (UID: "eed2efee-a682-4683-9b34-4449d997843b") : secret "router-metrics-certs-default" not found
May 20 20:22:26.948777 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:26.948689    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-6grhs" event={"ID":"2edf8992-3677-4bdd-a809-e15044dd2758","Type":"ContainerStarted","Data":"1915333b7bb0067630f324b7b3610bffe3aaee9ae16e3ce7f42b650c6d3ef8f7"}
May 20 20:22:26.969067 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:26.969012    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-6grhs" podStartSLOduration=1.20415658 podStartE2EDuration="3.96899566s" podCreationTimestamp="2026-05-20 20:22:23 +0000 UTC" firstStartedPulling="2026-05-20 20:22:23.872218272 +0000 UTC m=+157.903384078" lastFinishedPulling="2026-05-20 20:22:26.637057338 +0000 UTC m=+160.668223158" observedRunningTime="2026-05-20 20:22:26.96856101 +0000 UTC m=+160.999726839" watchObservedRunningTime="2026-05-20 20:22:26.96899566 +0000 UTC m=+161.000161486"
May 20 20:22:27.246663 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:27.246569    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d27558d-7a25-4579-8a85-5cabee8215cb-samples-operator-tls\") pod \"cluster-samples-operator-697587599-djnfn\" (UID: \"5d27558d-7a25-4579-8a85-5cabee8215cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-djnfn"
May 20 20:22:27.246663 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:27.246614    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:27.246663 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:27.246657    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:27.246882 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:27.246722    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 20:22:27.246882 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:27.246783    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 20 20:22:27.246882 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:27.246789    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d27558d-7a25-4579-8a85-5cabee8215cb-samples-operator-tls podName:5d27558d-7a25-4579-8a85-5cabee8215cb nodeName:}" failed. No retries permitted until 2026-05-20 20:22:31.24677326 +0000 UTC m=+165.277939079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5d27558d-7a25-4579-8a85-5cabee8215cb-samples-operator-tls") pod "cluster-samples-operator-697587599-djnfn" (UID: "5d27558d-7a25-4579-8a85-5cabee8215cb") : secret "samples-operator-tls" not found
May 20 20:22:27.246882 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:27.246834    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle podName:eed2efee-a682-4683-9b34-4449d997843b nodeName:}" failed. No retries permitted until 2026-05-20 20:22:31.246822322 +0000 UTC m=+165.277988127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle") pod "router-default-749647ff5d-8v29b" (UID: "eed2efee-a682-4683-9b34-4449d997843b") : configmap references non-existent config key: service-ca.crt
May 20 20:22:27.246882 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:27.246847    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs podName:eed2efee-a682-4683-9b34-4449d997843b nodeName:}" failed. No retries permitted until 2026-05-20 20:22:31.246839059 +0000 UTC m=+165.278004863 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs") pod "router-default-749647ff5d-8v29b" (UID: "eed2efee-a682-4683-9b34-4449d997843b") : secret "router-metrics-certs-default" not found
May 20 20:22:28.354818 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:28.354770    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-9rqk8\" (UID: \"b77a7447-7dda-48f7-ae38-5aa565402fc3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"
May 20 20:22:28.355289 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:28.354837    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:22:28.355289 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:28.354930    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:22:28.355289 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:28.354938    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 20:22:28.355289 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:28.354975    2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:22:28.355289 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:28.354986    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert\") pod \"ingress-canary-jx4zj\" (UID: \"a60784d9-7267-4cdd-bfe1-9828b0ab3ee1\") " pod="openshift-ingress-canary/ingress-canary-jx4zj"
May 20 20:22:28.355289 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:28.354997    2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8698d89747-fj9fs: secret "image-registry-tls" not found
May 20 20:22:28.355289 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:28.355005    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert podName:b77a7447-7dda-48f7-ae38-5aa565402fc3 nodeName:}" failed. No retries permitted until 2026-05-20 20:24:30.354983462 +0000 UTC m=+284.386149284 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-9rqk8" (UID: "b77a7447-7dda-48f7-ae38-5aa565402fc3") : secret "networking-console-plugin-cert" not found
May 20 20:22:28.355289 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:28.355071    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:22:28.355289 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:28.355081    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:22:28.355289 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:28.355075    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls podName:38f8c7f1-7e2e-4bde-94b6-963844a3bdf0 nodeName:}" failed. No retries permitted until 2026-05-20 20:24:30.355057551 +0000 UTC m=+284.386223358 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls") pod "image-registry-8698d89747-fj9fs" (UID: "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0") : secret "image-registry-tls" not found
May 20 20:22:28.355289 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:28.355130    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert podName:a60784d9-7267-4cdd-bfe1-9828b0ab3ee1 nodeName:}" failed. No retries permitted until 2026-05-20 20:24:30.35511978 +0000 UTC m=+284.386285587 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert") pod "ingress-canary-jx4zj" (UID: "a60784d9-7267-4cdd-bfe1-9828b0ab3ee1") : secret "canary-serving-cert" not found
May 20 20:22:28.355289 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:28.355142    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls podName:c2ece298-1b7c-43ed-a06d-4f0684ba0180 nodeName:}" failed. No retries permitted until 2026-05-20 20:24:30.355136039 +0000 UTC m=+284.386301844 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls") pod "dns-default-ptgqm" (UID: "c2ece298-1b7c-43ed-a06d-4f0684ba0180") : secret "dns-default-metrics-tls" not found
May 20 20:22:29.501445 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:29.501416    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nkc5b_6cc19b57-f3ee-428d-a00e-b5ec641fd9bd/dns-node-resolver/0.log"
May 20 20:22:30.901555 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:30.901525    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rpxfx_8eed8f09-7a8b-414c-b186-0733b5881f70/node-ca/0.log"
May 20 20:22:31.279722 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:31.279635    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d27558d-7a25-4579-8a85-5cabee8215cb-samples-operator-tls\") pod \"cluster-samples-operator-697587599-djnfn\" (UID: \"5d27558d-7a25-4579-8a85-5cabee8215cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-djnfn"
May 20 20:22:31.279722 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:31.279678    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:31.279922 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:31.279724    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:31.279922 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:31.279795    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 20:22:31.279922 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:31.279804    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 20 20:22:31.279922 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:31.279862    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d27558d-7a25-4579-8a85-5cabee8215cb-samples-operator-tls podName:5d27558d-7a25-4579-8a85-5cabee8215cb nodeName:}" failed. No retries permitted until 2026-05-20 20:22:39.279844784 +0000 UTC m=+173.311010594 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5d27558d-7a25-4579-8a85-5cabee8215cb-samples-operator-tls") pod "cluster-samples-operator-697587599-djnfn" (UID: "5d27558d-7a25-4579-8a85-5cabee8215cb") : secret "samples-operator-tls" not found
May 20 20:22:31.279922 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:31.279877    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs podName:eed2efee-a682-4683-9b34-4449d997843b nodeName:}" failed. No retries permitted until 2026-05-20 20:22:39.279870708 +0000 UTC m=+173.311036513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs") pod "router-default-749647ff5d-8v29b" (UID: "eed2efee-a682-4683-9b34-4449d997843b") : secret "router-metrics-certs-default" not found
May 20 20:22:31.279922 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:31.279887    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle podName:eed2efee-a682-4683-9b34-4449d997843b nodeName:}" failed. No retries permitted until 2026-05-20 20:22:39.279882157 +0000 UTC m=+173.311047962 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle") pod "router-default-749647ff5d-8v29b" (UID: "eed2efee-a682-4683-9b34-4449d997843b") : configmap references non-existent config key: service-ca.crt
May 20 20:22:37.552586 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:37.552496    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:22:39.346699 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:39.346655    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d27558d-7a25-4579-8a85-5cabee8215cb-samples-operator-tls\") pod \"cluster-samples-operator-697587599-djnfn\" (UID: \"5d27558d-7a25-4579-8a85-5cabee8215cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-djnfn"
May 20 20:22:39.346699 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:39.346700    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:39.347200 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:39.346793    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 20 20:22:39.347200 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:39.346853    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs podName:eed2efee-a682-4683-9b34-4449d997843b nodeName:}" failed. No retries permitted until 2026-05-20 20:22:55.34683762 +0000 UTC m=+189.378003428 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs") pod "router-default-749647ff5d-8v29b" (UID: "eed2efee-a682-4683-9b34-4449d997843b") : secret "router-metrics-certs-default" not found
May 20 20:22:39.347200 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:39.346851    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:39.347200 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:22:39.347027    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle podName:eed2efee-a682-4683-9b34-4449d997843b nodeName:}" failed. No retries permitted until 2026-05-20 20:22:55.347014935 +0000 UTC m=+189.378180739 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle") pod "router-default-749647ff5d-8v29b" (UID: "eed2efee-a682-4683-9b34-4449d997843b") : configmap references non-existent config key: service-ca.crt
May 20 20:22:39.349158 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:39.349135    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d27558d-7a25-4579-8a85-5cabee8215cb-samples-operator-tls\") pod \"cluster-samples-operator-697587599-djnfn\" (UID: \"5d27558d-7a25-4579-8a85-5cabee8215cb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-djnfn"
May 20 20:22:39.451607 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:39.451548    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-djnfn"
May 20 20:22:39.581181 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:39.581148    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-djnfn"]
May 20 20:22:39.974746 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:39.974661    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-djnfn" event={"ID":"5d27558d-7a25-4579-8a85-5cabee8215cb","Type":"ContainerStarted","Data":"544df6c71285828864a76e6c7ccc755f6be00c154ed00973ad269e8431c2f88d"}
May 20 20:22:41.981693 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:41.981659    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-djnfn" event={"ID":"5d27558d-7a25-4579-8a85-5cabee8215cb","Type":"ContainerStarted","Data":"c27eb411c2db920419e03f7cbeb5616360b17a419dc11da26554c39acab1b01a"}
May 20 20:22:41.981693 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:41.981695    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-djnfn" event={"ID":"5d27558d-7a25-4579-8a85-5cabee8215cb","Type":"ContainerStarted","Data":"49072c664760957163ea932f4616b345e28d838a210878f680f8bef622869181"}
May 20 20:22:41.999480 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:41.999433    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-djnfn" podStartSLOduration=17.540179047 podStartE2EDuration="18.999418277s" podCreationTimestamp="2026-05-20 20:22:23 +0000 UTC" firstStartedPulling="2026-05-20 20:22:39.621445565 +0000 UTC m=+173.652611369" lastFinishedPulling="2026-05-20 20:22:41.080684788 +0000 UTC m=+175.111850599" observedRunningTime="2026-05-20 20:22:41.999110023 +0000 UTC m=+176.030275850" watchObservedRunningTime="2026-05-20 20:22:41.999418277 +0000 UTC m=+176.030584103"
May 20 20:22:51.420324 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.420290    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bgtlz"]
May 20 20:22:51.423532 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.423512    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bgtlz"
May 20 20:22:51.426605 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.426582    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 20 20:22:51.427610 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.427579    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rrmkh\""
May 20 20:22:51.427610 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.427596    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 20 20:22:51.427766 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.427626    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 20 20:22:51.427766 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.427647    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 20 20:22:51.436492 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.436471    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bgtlz"]
May 20 20:22:51.543156 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.543115    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1490f9a1-4fa6-4042-8959-52e224a5823b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgtlz\" (UID: \"1490f9a1-4fa6-4042-8959-52e224a5823b\") " pod="openshift-insights/insights-runtime-extractor-bgtlz"
May 20 20:22:51.543323 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.543174    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1490f9a1-4fa6-4042-8959-52e224a5823b-crio-socket\") pod \"insights-runtime-extractor-bgtlz\" (UID: \"1490f9a1-4fa6-4042-8959-52e224a5823b\") " pod="openshift-insights/insights-runtime-extractor-bgtlz"
May 20 20:22:51.543323 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.543217    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1490f9a1-4fa6-4042-8959-52e224a5823b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgtlz\" (UID: \"1490f9a1-4fa6-4042-8959-52e224a5823b\") " pod="openshift-insights/insights-runtime-extractor-bgtlz"
May 20 20:22:51.543323 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.543305    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qphhv\" (UniqueName: \"kubernetes.io/projected/1490f9a1-4fa6-4042-8959-52e224a5823b-kube-api-access-qphhv\") pod \"insights-runtime-extractor-bgtlz\" (UID: \"1490f9a1-4fa6-4042-8959-52e224a5823b\") " pod="openshift-insights/insights-runtime-extractor-bgtlz"
May 20 20:22:51.543429 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.543381    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1490f9a1-4fa6-4042-8959-52e224a5823b-data-volume\") pod \"insights-runtime-extractor-bgtlz\" (UID: \"1490f9a1-4fa6-4042-8959-52e224a5823b\") " pod="openshift-insights/insights-runtime-extractor-bgtlz"
May 20 20:22:51.644001 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.643960    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1490f9a1-4fa6-4042-8959-52e224a5823b-data-volume\") pod \"insights-runtime-extractor-bgtlz\" (UID: \"1490f9a1-4fa6-4042-8959-52e224a5823b\") " pod="openshift-insights/insights-runtime-extractor-bgtlz"
May 20 20:22:51.644001 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.644011    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1490f9a1-4fa6-4042-8959-52e224a5823b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgtlz\" (UID: \"1490f9a1-4fa6-4042-8959-52e224a5823b\") " pod="openshift-insights/insights-runtime-extractor-bgtlz"
May 20 20:22:51.644245 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.644052    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1490f9a1-4fa6-4042-8959-52e224a5823b-crio-socket\") pod \"insights-runtime-extractor-bgtlz\" (UID: \"1490f9a1-4fa6-4042-8959-52e224a5823b\") " pod="openshift-insights/insights-runtime-extractor-bgtlz"
May 20 20:22:51.644245 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.644070    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1490f9a1-4fa6-4042-8959-52e224a5823b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgtlz\" (UID: \"1490f9a1-4fa6-4042-8959-52e224a5823b\") " pod="openshift-insights/insights-runtime-extractor-bgtlz"
May 20 20:22:51.644245 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.644126    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qphhv\" (UniqueName: \"kubernetes.io/projected/1490f9a1-4fa6-4042-8959-52e224a5823b-kube-api-access-qphhv\") pod \"insights-runtime-extractor-bgtlz\" (UID: \"1490f9a1-4fa6-4042-8959-52e224a5823b\") " pod="openshift-insights/insights-runtime-extractor-bgtlz"
May 20 20:22:51.644245 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.644186    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1490f9a1-4fa6-4042-8959-52e224a5823b-crio-socket\") pod \"insights-runtime-extractor-bgtlz\" (UID: \"1490f9a1-4fa6-4042-8959-52e224a5823b\") " pod="openshift-insights/insights-runtime-extractor-bgtlz"
May 20 20:22:51.644450 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.644410    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1490f9a1-4fa6-4042-8959-52e224a5823b-data-volume\") pod \"insights-runtime-extractor-bgtlz\" (UID: \"1490f9a1-4fa6-4042-8959-52e224a5823b\") " pod="openshift-insights/insights-runtime-extractor-bgtlz"
May 20 20:22:51.644637 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.644618    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1490f9a1-4fa6-4042-8959-52e224a5823b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgtlz\" (UID: \"1490f9a1-4fa6-4042-8959-52e224a5823b\") " pod="openshift-insights/insights-runtime-extractor-bgtlz"
May 20 20:22:51.646330 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.646310    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1490f9a1-4fa6-4042-8959-52e224a5823b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgtlz\" (UID: \"1490f9a1-4fa6-4042-8959-52e224a5823b\") " pod="openshift-insights/insights-runtime-extractor-bgtlz"
May 20 20:22:51.652687 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.652665    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qphhv\" (UniqueName: \"kubernetes.io/projected/1490f9a1-4fa6-4042-8959-52e224a5823b-kube-api-access-qphhv\") pod \"insights-runtime-extractor-bgtlz\" (UID: \"1490f9a1-4fa6-4042-8959-52e224a5823b\") " pod="openshift-insights/insights-runtime-extractor-bgtlz"
May 20 20:22:51.731948 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.731828    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bgtlz"
May 20 20:22:51.851790 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:51.851757    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bgtlz"]
May 20 20:22:51.855256 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:22:51.855227    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1490f9a1_4fa6_4042_8959_52e224a5823b.slice/crio-c706b03080dcc7f8bef0f1f187ee8f581251b59c8bfc03bdd6258a8ad00255f2 WatchSource:0}: Error finding container c706b03080dcc7f8bef0f1f187ee8f581251b59c8bfc03bdd6258a8ad00255f2: Status 404 returned error can't find the container with id c706b03080dcc7f8bef0f1f187ee8f581251b59c8bfc03bdd6258a8ad00255f2
May 20 20:22:52.006817 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:52.006728    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bgtlz" event={"ID":"1490f9a1-4fa6-4042-8959-52e224a5823b","Type":"ContainerStarted","Data":"0f17a0ae560776dc99f8a9c718dfd3ae7a63892fa50b5d6f122375a0a57eca70"}
May 20 20:22:52.006817 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:52.006763    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bgtlz" event={"ID":"1490f9a1-4fa6-4042-8959-52e224a5823b","Type":"ContainerStarted","Data":"c706b03080dcc7f8bef0f1f187ee8f581251b59c8bfc03bdd6258a8ad00255f2"}
May 20 20:22:53.010812 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:53.010775    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bgtlz" event={"ID":"1490f9a1-4fa6-4042-8959-52e224a5823b","Type":"ContainerStarted","Data":"a2b0118c853db2afad64822ea09a6d7441abc3a22ac174522de5266bb6fbab78"}
May 20 20:22:54.015467 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:54.015432    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bgtlz" event={"ID":"1490f9a1-4fa6-4042-8959-52e224a5823b","Type":"ContainerStarted","Data":"c6d9e37f0eced0a49793f3de81136e1f343f8f99fec841e36f6d3a79bc242bbc"}
May 20 20:22:54.034688 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:54.034642    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bgtlz" podStartSLOduration=1.099365919 podStartE2EDuration="3.034628748s" podCreationTimestamp="2026-05-20 20:22:51 +0000 UTC" firstStartedPulling="2026-05-20 20:22:51.912269573 +0000 UTC m=+185.943435382" lastFinishedPulling="2026-05-20 20:22:53.847532403 +0000 UTC m=+187.878698211" observedRunningTime="2026-05-20 20:22:54.03340246 +0000 UTC m=+188.064568288" watchObservedRunningTime="2026-05-20 20:22:54.034628748 +0000 UTC m=+188.065794574"
May 20 20:22:55.375866 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:55.375811    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:55.376358 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:55.375976    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:55.376523 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:55.376506    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eed2efee-a682-4683-9b34-4449d997843b-service-ca-bundle\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:55.378330 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:55.378303    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eed2efee-a682-4683-9b34-4449d997843b-metrics-certs\") pod \"router-default-749647ff5d-8v29b\" (UID: \"eed2efee-a682-4683-9b34-4449d997843b\") " pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:55.658526 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:55.658440    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-n56sn\""
May 20 20:22:55.667295 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:55.667271    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:55.791780 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:55.791750    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-749647ff5d-8v29b"]
May 20 20:22:55.794567 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:22:55.794524    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeed2efee_a682_4683_9b34_4449d997843b.slice/crio-261bf5b0d175171b4f74cf6274e77d4d8a58822a92f8c3e7da712146e13e6129 WatchSource:0}: Error finding container 261bf5b0d175171b4f74cf6274e77d4d8a58822a92f8c3e7da712146e13e6129: Status 404 returned error can't find the container with id 261bf5b0d175171b4f74cf6274e77d4d8a58822a92f8c3e7da712146e13e6129
May 20 20:22:56.021360 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:56.021286    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-749647ff5d-8v29b" event={"ID":"eed2efee-a682-4683-9b34-4449d997843b","Type":"ContainerStarted","Data":"a94519fdbb0e70530110de8cb19b5d1a82eb6bc1a714b4561165bca59197d286"}
May 20 20:22:56.021360 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:56.021319    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-749647ff5d-8v29b" event={"ID":"eed2efee-a682-4683-9b34-4449d997843b","Type":"ContainerStarted","Data":"261bf5b0d175171b4f74cf6274e77d4d8a58822a92f8c3e7da712146e13e6129"}
May 20 20:22:56.040689 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:56.040631    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-749647ff5d-8v29b" podStartSLOduration=33.040611864 podStartE2EDuration="33.040611864s" podCreationTimestamp="2026-05-20 20:22:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:22:56.039849822 +0000 UTC m=+190.071015649" watchObservedRunningTime="2026-05-20 20:22:56.040611864 +0000 UTC m=+190.071777692"
May 20 20:22:56.667907 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:56.667859    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:56.670536 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:56.670511    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:57.028512 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:57.028424    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:22:57.029803 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:22:57.029778    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-749647ff5d-8v29b"
May 20 20:23:01.448833 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.448798    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-kcw58"]
May 20 20:23:01.451254 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.451239    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-kcw58"
May 20 20:23:01.453502 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.453481    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 20 20:23:01.454497 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.454472    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 20 20:23:01.454497 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.454490    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 20 20:23:01.454686 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.454545    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-lfwkn\""
May 20 20:23:01.454686 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.454576    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 20 20:23:01.454686 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.454598    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 20 20:23:01.459914 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.459878    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-kcw58"]
May 20 20:23:01.522420 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.522391    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0fc9ae2-95a2-429e-8520-ab39e2528804-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-kcw58\" (UID: \"e0fc9ae2-95a2-429e-8520-ab39e2528804\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kcw58"
May 20 20:23:01.522575 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.522428    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0fc9ae2-95a2-429e-8520-ab39e2528804-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-kcw58\" (UID: \"e0fc9ae2-95a2-429e-8520-ab39e2528804\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kcw58"
May 20 20:23:01.522575 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.522449    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0fc9ae2-95a2-429e-8520-ab39e2528804-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-kcw58\" (UID: \"e0fc9ae2-95a2-429e-8520-ab39e2528804\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kcw58"
May 20 20:23:01.522575 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.522528    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvk7v\" (UniqueName: \"kubernetes.io/projected/e0fc9ae2-95a2-429e-8520-ab39e2528804-kube-api-access-gvk7v\") pod \"prometheus-operator-7779bbdd78-kcw58\" (UID: \"e0fc9ae2-95a2-429e-8520-ab39e2528804\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kcw58"
May 20 20:23:01.623182 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.623152    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0fc9ae2-95a2-429e-8520-ab39e2528804-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-kcw58\" (UID: \"e0fc9ae2-95a2-429e-8520-ab39e2528804\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kcw58"
May 20 20:23:01.623182 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.623191    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0fc9ae2-95a2-429e-8520-ab39e2528804-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-kcw58\" (UID: \"e0fc9ae2-95a2-429e-8520-ab39e2528804\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kcw58"
May 20 20:23:01.623418 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.623211    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0fc9ae2-95a2-429e-8520-ab39e2528804-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-kcw58\" (UID: \"e0fc9ae2-95a2-429e-8520-ab39e2528804\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kcw58"
May 20 20:23:01.623418 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.623241    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gvk7v\" (UniqueName: \"kubernetes.io/projected/e0fc9ae2-95a2-429e-8520-ab39e2528804-kube-api-access-gvk7v\") pod \"prometheus-operator-7779bbdd78-kcw58\" (UID: \"e0fc9ae2-95a2-429e-8520-ab39e2528804\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kcw58"
May 20 20:23:01.623865 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.623841    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0fc9ae2-95a2-429e-8520-ab39e2528804-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-kcw58\" (UID: \"e0fc9ae2-95a2-429e-8520-ab39e2528804\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kcw58"
May 20 20:23:01.625608 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.625583    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0fc9ae2-95a2-429e-8520-ab39e2528804-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-kcw58\" (UID: \"e0fc9ae2-95a2-429e-8520-ab39e2528804\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kcw58"
May 20 20:23:01.625763 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.625744    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0fc9ae2-95a2-429e-8520-ab39e2528804-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-kcw58\" (UID: \"e0fc9ae2-95a2-429e-8520-ab39e2528804\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kcw58"
May 20 20:23:01.631616 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.631596    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvk7v\" (UniqueName: \"kubernetes.io/projected/e0fc9ae2-95a2-429e-8520-ab39e2528804-kube-api-access-gvk7v\") pod \"prometheus-operator-7779bbdd78-kcw58\" (UID: \"e0fc9ae2-95a2-429e-8520-ab39e2528804\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-kcw58"
May 20 20:23:01.760340 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.760262    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-kcw58"
May 20 20:23:01.880870 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:01.880750    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-kcw58"]
May 20 20:23:01.883244 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:23:01.883216    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0fc9ae2_95a2_429e_8520_ab39e2528804.slice/crio-9aa12eac05160713467ea02606b388d97f83a91cd7fe413384140929cc6d95da WatchSource:0}: Error finding container 9aa12eac05160713467ea02606b388d97f83a91cd7fe413384140929cc6d95da: Status 404 returned error can't find the container with id 9aa12eac05160713467ea02606b388d97f83a91cd7fe413384140929cc6d95da
May 20 20:23:02.041404 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:02.041326    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-kcw58" event={"ID":"e0fc9ae2-95a2-429e-8520-ab39e2528804","Type":"ContainerStarted","Data":"9aa12eac05160713467ea02606b388d97f83a91cd7fe413384140929cc6d95da"}
May 20 20:23:02.791435 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:02.791332    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7" podUID="ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused"
May 20 20:23:03.048619 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:03.048538    2566 generic.go:358] "Generic (PLEG): container finished" podID="ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b" containerID="cdc542f41b7eeb8676451bff884c8670b01b2054c5bbe3c8a44c6e2f490123a3" exitCode=1
May 20 20:23:03.048619 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:03.048603    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7" event={"ID":"ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b","Type":"ContainerDied","Data":"cdc542f41b7eeb8676451bff884c8670b01b2054c5bbe3c8a44c6e2f490123a3"}
May 20 20:23:03.048987 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:03.048967    2566 scope.go:117] "RemoveContainer" containerID="cdc542f41b7eeb8676451bff884c8670b01b2054c5bbe3c8a44c6e2f490123a3"
May 20 20:23:04.052024 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:04.051983    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-kcw58" event={"ID":"e0fc9ae2-95a2-429e-8520-ab39e2528804","Type":"ContainerStarted","Data":"7bafc6327b2682d6a7a72ed61b0833adb9a01c715b36b7e41753b237017b69df"}
May 20 20:23:04.052024 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:04.052028    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-kcw58" event={"ID":"e0fc9ae2-95a2-429e-8520-ab39e2528804","Type":"ContainerStarted","Data":"4403e5cbff92dc0533b8979023957c74531036ed1763bbd29d610a7860957211"}
May 20 20:23:04.053376 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:04.053354    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7" event={"ID":"ee2e9b9f-e02c-4ca6-994d-84f7979a1e2b","Type":"ContainerStarted","Data":"bea7364cdd1dadf3b316648d5e14534c536eacf67d50f16ac9a75b5e5519dce0"}
May 20 20:23:04.053608 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:04.053591    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7"
May 20 20:23:04.054140 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:04.054125    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-564f7b8f54-26mv7"
May 20 20:23:04.087684 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:04.087635    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-kcw58" podStartSLOduration=1.962898075 podStartE2EDuration="3.087625062s" podCreationTimestamp="2026-05-20 20:23:01 +0000 UTC" firstStartedPulling="2026-05-20 20:23:01.885070652 +0000 UTC m=+195.916236458" lastFinishedPulling="2026-05-20 20:23:03.009797637 +0000 UTC m=+197.040963445" observedRunningTime="2026-05-20 20:23:04.086761083 +0000 UTC m=+198.117926910" watchObservedRunningTime="2026-05-20 20:23:04.087625062 +0000 UTC m=+198.118790889"
May 20 20:23:05.806453 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.806422    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5z82t"]
May 20 20:23:05.808449 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.808432    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.810784 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.810759    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 20 20:23:05.810784 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.810775    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 20 20:23:05.810993 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.810813    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 20 20:23:05.810993 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.810885    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t9tjz\""
May 20 20:23:05.855912 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.855861    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ed9197d-241f-42d8-8659-c108228b25f7-node-exporter-tls\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.856109 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.855946    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ed9197d-241f-42d8-8659-c108228b25f7-sys\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.856109 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.855975    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ed9197d-241f-42d8-8659-c108228b25f7-node-exporter-wtmp\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.856109 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.856048    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ed9197d-241f-42d8-8659-c108228b25f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.856109 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.856096    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ed9197d-241f-42d8-8659-c108228b25f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.856382 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.856146    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ed9197d-241f-42d8-8659-c108228b25f7-node-exporter-textfile\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.856382 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.856197    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ed9197d-241f-42d8-8659-c108228b25f7-root\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.856382 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.856266    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ed9197d-241f-42d8-8659-c108228b25f7-metrics-client-ca\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.856382 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.856326    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4zqf\" (UniqueName: \"kubernetes.io/projected/8ed9197d-241f-42d8-8659-c108228b25f7-kube-api-access-c4zqf\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.957526 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.957482    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ed9197d-241f-42d8-8659-c108228b25f7-node-exporter-tls\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.957717 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.957556    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ed9197d-241f-42d8-8659-c108228b25f7-sys\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.957717 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.957586    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ed9197d-241f-42d8-8659-c108228b25f7-node-exporter-wtmp\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.957717 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.957616    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ed9197d-241f-42d8-8659-c108228b25f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.957717 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:23:05.957650    2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 20 20:23:05.957717 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:23:05.957713    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed9197d-241f-42d8-8659-c108228b25f7-node-exporter-tls podName:8ed9197d-241f-42d8-8659-c108228b25f7 nodeName:}" failed. No retries permitted until 2026-05-20 20:23:06.457694246 +0000 UTC m=+200.488860055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8ed9197d-241f-42d8-8659-c108228b25f7-node-exporter-tls") pod "node-exporter-5z82t" (UID: "8ed9197d-241f-42d8-8659-c108228b25f7") : secret "node-exporter-tls" not found
May 20 20:23:05.958009 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.957737    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ed9197d-241f-42d8-8659-c108228b25f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.958009 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.957754    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ed9197d-241f-42d8-8659-c108228b25f7-node-exporter-wtmp\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.958009 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.957784    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ed9197d-241f-42d8-8659-c108228b25f7-node-exporter-textfile\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.958009 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.957796    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ed9197d-241f-42d8-8659-c108228b25f7-sys\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.958009 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.957817    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ed9197d-241f-42d8-8659-c108228b25f7-root\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.958009 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.957869    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ed9197d-241f-42d8-8659-c108228b25f7-root\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.958009 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.957914    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ed9197d-241f-42d8-8659-c108228b25f7-metrics-client-ca\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.958009 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.957969    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c4zqf\" (UniqueName: \"kubernetes.io/projected/8ed9197d-241f-42d8-8659-c108228b25f7-kube-api-access-c4zqf\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.958401 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.958153    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ed9197d-241f-42d8-8659-c108228b25f7-node-exporter-textfile\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.958486 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.958465    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ed9197d-241f-42d8-8659-c108228b25f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.958537 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.958469    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ed9197d-241f-42d8-8659-c108228b25f7-metrics-client-ca\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.960000 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.959981    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ed9197d-241f-42d8-8659-c108228b25f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:05.965936 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:05.965917    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4zqf\" (UniqueName: \"kubernetes.io/projected/8ed9197d-241f-42d8-8659-c108228b25f7-kube-api-access-c4zqf\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:06.462211 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.462178    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ed9197d-241f-42d8-8659-c108228b25f7-node-exporter-tls\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:06.464437 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.464419    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ed9197d-241f-42d8-8659-c108228b25f7-node-exporter-tls\") pod \"node-exporter-5z82t\" (UID: \"8ed9197d-241f-42d8-8659-c108228b25f7\") " pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:06.717271 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.717190    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5z82t"
May 20 20:23:06.724565 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:23:06.724537    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed9197d_241f_42d8_8659_c108228b25f7.slice/crio-3cd36e797a347d90e8b34c639192c3c872d02d54e9125d383f22b877a54a0ef7 WatchSource:0}: Error finding container 3cd36e797a347d90e8b34c639192c3c872d02d54e9125d383f22b877a54a0ef7: Status 404 returned error can't find the container with id 3cd36e797a347d90e8b34c639192c3c872d02d54e9125d383f22b877a54a0ef7
May 20 20:23:06.874653 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.874619    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 20 20:23:06.882354 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.882324    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:06.884632 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.884614    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 20 20:23:06.884764 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.884639    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 20 20:23:06.884764 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.884674    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 20 20:23:06.884764 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.884755    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 20 20:23:06.884933 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.884768    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 20 20:23:06.885102 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.885081    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 20 20:23:06.885220 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.885105    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s8glg\""
May 20 20:23:06.885220 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.885137    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 20 20:23:06.885350 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.885272    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 20 20:23:06.885409 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.885381    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 20 20:23:06.890563 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.890540    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 20 20:23:06.965763 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.965726    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c626470-719c-47f0-a32e-ac9f9b4db6fa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:06.965958 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.965768    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c626470-719c-47f0-a32e-ac9f9b4db6fa-config-out\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:06.965958 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.965795    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:06.965958 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.965818    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:06.965958 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.965841    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:06.966123 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.966007    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:06.966123 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.966053    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c626470-719c-47f0-a32e-ac9f9b4db6fa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:06.966123 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.966079    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c626470-719c-47f0-a32e-ac9f9b4db6fa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:06.966123 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.966095    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhdwh\" (UniqueName: \"kubernetes.io/projected/4c626470-719c-47f0-a32e-ac9f9b4db6fa-kube-api-access-zhdwh\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:06.966290 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.966142    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c626470-719c-47f0-a32e-ac9f9b4db6fa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:06.966290 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.966164    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-web-config\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:06.966290 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.966191    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:06.966290 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:06.966229    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.061149 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.061063    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5z82t" event={"ID":"8ed9197d-241f-42d8-8659-c108228b25f7","Type":"ContainerStarted","Data":"3cd36e797a347d90e8b34c639192c3c872d02d54e9125d383f22b877a54a0ef7"}
May 20 20:23:07.067510 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.067483    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c626470-719c-47f0-a32e-ac9f9b4db6fa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.067654 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.067528    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c626470-719c-47f0-a32e-ac9f9b4db6fa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.067654 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.067548    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zhdwh\" (UniqueName: \"kubernetes.io/projected/4c626470-719c-47f0-a32e-ac9f9b4db6fa-kube-api-access-zhdwh\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.067654 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.067587    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c626470-719c-47f0-a32e-ac9f9b4db6fa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.067654 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.067620    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-web-config\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.067654 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.067653    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.067930 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.067682    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.067930 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.067812    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c626470-719c-47f0-a32e-ac9f9b4db6fa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.067930 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.067849    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c626470-719c-47f0-a32e-ac9f9b4db6fa-config-out\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.067930 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.067879    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.067930 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.067927    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.068121 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.067930    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c626470-719c-47f0-a32e-ac9f9b4db6fa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.068121 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.067953    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.068121 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.068019    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.068753 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.068730    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c626470-719c-47f0-a32e-ac9f9b4db6fa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.068884 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.068741    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c626470-719c-47f0-a32e-ac9f9b4db6fa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.070991 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.070944    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.071100 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.071013    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.071240 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.071218    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.071316 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.071252    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-web-config\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.071415 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.071395    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.071477 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.071455    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c626470-719c-47f0-a32e-ac9f9b4db6fa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.071534 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.071483    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.071766 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.071745    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.072926 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.072911    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c626470-719c-47f0-a32e-ac9f9b4db6fa-config-out\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.077004 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.076983    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhdwh\" (UniqueName: \"kubernetes.io/projected/4c626470-719c-47f0-a32e-ac9f9b4db6fa-kube-api-access-zhdwh\") pod \"alertmanager-main-0\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.195946 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.195911    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 20 20:23:07.335330 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:07.335254    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 20 20:23:07.338519 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:23:07.338487    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c626470_719c_47f0_a32e_ac9f9b4db6fa.slice/crio-8ca0a209462368e6dbd0a67202984156a5fdf191077b6e79c2f16af0bc0ace4a WatchSource:0}: Error finding container 8ca0a209462368e6dbd0a67202984156a5fdf191077b6e79c2f16af0bc0ace4a: Status 404 returned error can't find the container with id 8ca0a209462368e6dbd0a67202984156a5fdf191077b6e79c2f16af0bc0ace4a
May 20 20:23:08.065565 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:08.065468    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c626470-719c-47f0-a32e-ac9f9b4db6fa","Type":"ContainerStarted","Data":"8ca0a209462368e6dbd0a67202984156a5fdf191077b6e79c2f16af0bc0ace4a"}
May 20 20:23:08.067351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:08.067322    2566 generic.go:358] "Generic (PLEG): container finished" podID="8ed9197d-241f-42d8-8659-c108228b25f7" containerID="8fcf8f8963dc5cf438d35f35d91f3dfbfdc35ff150b8e0140d544d25e59daefa" exitCode=0
May 20 20:23:08.067486 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:08.067390    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5z82t" event={"ID":"8ed9197d-241f-42d8-8659-c108228b25f7","Type":"ContainerDied","Data":"8fcf8f8963dc5cf438d35f35d91f3dfbfdc35ff150b8e0140d544d25e59daefa"}
May 20 20:23:09.071470 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:09.071432    2566 generic.go:358] "Generic (PLEG): container finished" podID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerID="e6c650dcdad5cdbdb12415495e44b885e1e753e6d7bbf453e57325d109f21037" exitCode=0
May 20 20:23:09.071962 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:09.071527    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c626470-719c-47f0-a32e-ac9f9b4db6fa","Type":"ContainerDied","Data":"e6c650dcdad5cdbdb12415495e44b885e1e753e6d7bbf453e57325d109f21037"}
May 20 20:23:09.073546 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:09.073526    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5z82t" event={"ID":"8ed9197d-241f-42d8-8659-c108228b25f7","Type":"ContainerStarted","Data":"b4b760e70fa4fd70796763242477d8f363ebe029072f27c71782a68cfe9c0177"}
May 20 20:23:09.073632 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:09.073556    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5z82t" event={"ID":"8ed9197d-241f-42d8-8659-c108228b25f7","Type":"ContainerStarted","Data":"abad41239cbd398cfa6acc309e0dd922eacaaeffc4dad4d468710673e6183797"}
May 20 20:23:09.114367 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:09.114319    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5z82t" podStartSLOduration=3.032316511 podStartE2EDuration="4.114305041s" podCreationTimestamp="2026-05-20 20:23:05 +0000 UTC" firstStartedPulling="2026-05-20 20:23:06.726299211 +0000 UTC m=+200.757465017" lastFinishedPulling="2026-05-20 20:23:07.808287733 +0000 UTC m=+201.839453547" observedRunningTime="2026-05-20 20:23:09.114202143 +0000 UTC m=+203.145367994" watchObservedRunningTime="2026-05-20 20:23:09.114305041 +0000 UTC m=+203.145470867"
May 20 20:23:10.584469 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:10.584437    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-kngww"]
May 20 20:23:10.586361 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:10.586341    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kngww"
May 20 20:23:10.589503 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:10.589435    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-xbzwk\""
May 20 20:23:10.589662 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:10.589639    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 20 20:23:10.594811 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:10.594789    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-kngww"]
May 20 20:23:10.701535 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:10.701459    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7485cb5e-0ab0-402c-a156-8f50b837f2e9-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-kngww\" (UID: \"7485cb5e-0ab0-402c-a156-8f50b837f2e9\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-kngww"
May 20 20:23:10.802137 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:10.802110    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7485cb5e-0ab0-402c-a156-8f50b837f2e9-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-kngww\" (UID: \"7485cb5e-0ab0-402c-a156-8f50b837f2e9\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-kngww"
May 20 20:23:10.802257 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:23:10.802242    2566 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 20 20:23:10.802311 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:23:10.802301    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7485cb5e-0ab0-402c-a156-8f50b837f2e9-monitoring-plugin-cert podName:7485cb5e-0ab0-402c-a156-8f50b837f2e9 nodeName:}" failed. No retries permitted until 2026-05-20 20:23:11.302281888 +0000 UTC m=+205.333447708 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/7485cb5e-0ab0-402c-a156-8f50b837f2e9-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-kngww" (UID: "7485cb5e-0ab0-402c-a156-8f50b837f2e9") : secret "monitoring-plugin-cert" not found
May 20 20:23:11.081539 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:11.081505    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c626470-719c-47f0-a32e-ac9f9b4db6fa","Type":"ContainerStarted","Data":"2eea265c5503ab2af1e4e7ee4bb1ee76248a8846cd3212ec80abd5d7a9312972"}
May 20 20:23:11.081539 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:11.081539    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c626470-719c-47f0-a32e-ac9f9b4db6fa","Type":"ContainerStarted","Data":"276392acec6c4f2a0d804b1cc2ff3e8c2f572bd8cfa659e17ed52db6e49d4b23"}
May 20 20:23:11.081539 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:11.081548    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c626470-719c-47f0-a32e-ac9f9b4db6fa","Type":"ContainerStarted","Data":"dd0e89803dde27fb50e2e6380cc7d25fc876e3dcff2dfc337317215875b8c1b7"}
May 20 20:23:11.081759 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:11.081557    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c626470-719c-47f0-a32e-ac9f9b4db6fa","Type":"ContainerStarted","Data":"96eff699dd9635e527c4bd36a1256aa49eb974b971f5ee8bb088ffb528672269"}
May 20 20:23:11.081759 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:11.081565    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c626470-719c-47f0-a32e-ac9f9b4db6fa","Type":"ContainerStarted","Data":"5ac43d301de370f4aea79b0345616f31d4a7187752dbf9e37a5e460e66523197"}
May 20 20:23:11.307946 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:11.307830    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7485cb5e-0ab0-402c-a156-8f50b837f2e9-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-kngww\" (UID: \"7485cb5e-0ab0-402c-a156-8f50b837f2e9\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-kngww"
May 20 20:23:11.310252 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:11.310228    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7485cb5e-0ab0-402c-a156-8f50b837f2e9-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-kngww\" (UID: \"7485cb5e-0ab0-402c-a156-8f50b837f2e9\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-kngww"
May 20 20:23:11.497144 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:11.497100    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kngww"
May 20 20:23:11.633992 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:11.633933    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-kngww"]
May 20 20:23:11.636814 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:23:11.636760    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7485cb5e_0ab0_402c_a156_8f50b837f2e9.slice/crio-009e1fa704afe116a309e2f43f78640fff426752b3bb7301691bb97aa09a2764 WatchSource:0}: Error finding container 009e1fa704afe116a309e2f43f78640fff426752b3bb7301691bb97aa09a2764: Status 404 returned error can't find the container with id 009e1fa704afe116a309e2f43f78640fff426752b3bb7301691bb97aa09a2764
May 20 20:23:12.088235 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:12.088194    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c626470-719c-47f0-a32e-ac9f9b4db6fa","Type":"ContainerStarted","Data":"fd84554d6595d4a93fcd0bd9a6d849b2a1b47d647da66067dfb5f30692d5f239"}
May 20 20:23:12.089352 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:12.089326    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kngww" event={"ID":"7485cb5e-0ab0-402c-a156-8f50b837f2e9","Type":"ContainerStarted","Data":"009e1fa704afe116a309e2f43f78640fff426752b3bb7301691bb97aa09a2764"}
May 20 20:23:12.114491 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:12.114389    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.649123342 podStartE2EDuration="6.114370286s" podCreationTimestamp="2026-05-20 20:23:06 +0000 UTC" firstStartedPulling="2026-05-20 20:23:07.340474112 +0000 UTC m=+201.371639918" lastFinishedPulling="2026-05-20 20:23:11.805721036 +0000 UTC m=+205.836886862" observedRunningTime="2026-05-20 20:23:12.112994891 +0000 UTC m=+206.144160722" watchObservedRunningTime="2026-05-20 20:23:12.114370286 +0000 UTC m=+206.145536114"
May 20 20:23:13.093448 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:13.093412    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kngww" event={"ID":"7485cb5e-0ab0-402c-a156-8f50b837f2e9","Type":"ContainerStarted","Data":"a9f9ab4756859ba689debcd31ead2711c6e4bba1845eb06bac2df534c67259c0"}
May 20 20:23:13.093871 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:13.093740    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kngww"
May 20 20:23:13.098191 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:13.098169    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kngww"
May 20 20:23:13.111307 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:13.111270    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kngww" podStartSLOduration=1.884359 podStartE2EDuration="3.111258128s" podCreationTimestamp="2026-05-20 20:23:10 +0000 UTC" firstStartedPulling="2026-05-20 20:23:11.639346196 +0000 UTC m=+205.670512003" lastFinishedPulling="2026-05-20 20:23:12.866245323 +0000 UTC m=+206.897411131" observedRunningTime="2026-05-20 20:23:13.110518712 +0000 UTC m=+207.141684540" watchObservedRunningTime="2026-05-20 20:23:13.111258128 +0000 UTC m=+207.142423955"
May 20 20:23:28.150691 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.150655    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b5b7dc7f5-b8clh"]
May 20 20:23:28.155132 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.155114    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:28.157519 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.157495    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 20 20:23:28.157646 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.157629    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 20 20:23:28.157705 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.157641    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 20 20:23:28.157705 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.157641    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 20 20:23:28.157804 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.157641    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 20 20:23:28.158436 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.158420    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xv7dt\""
May 20 20:23:28.158559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.158544    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 20 20:23:28.158620 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.158608    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 20 20:23:28.164631 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.164612    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b5b7dc7f5-b8clh"]
May 20 20:23:28.252973 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.252936    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g55q\" (UniqueName: \"kubernetes.io/projected/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-kube-api-access-9g55q\") pod \"console-6b5b7dc7f5-b8clh\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") " pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:28.253137 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.253006    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-oauth-serving-cert\") pod \"console-6b5b7dc7f5-b8clh\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") " pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:28.253137 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.253037    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-console-oauth-config\") pod \"console-6b5b7dc7f5-b8clh\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") " pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:28.253137 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.253076    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-console-config\") pod \"console-6b5b7dc7f5-b8clh\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") " pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:28.253137 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.253127    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-service-ca\") pod \"console-6b5b7dc7f5-b8clh\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") " pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:28.253267 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.253145    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-console-serving-cert\") pod \"console-6b5b7dc7f5-b8clh\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") " pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:28.354491 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.354450    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-console-config\") pod \"console-6b5b7dc7f5-b8clh\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") " pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:28.354491 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.354495    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-service-ca\") pod \"console-6b5b7dc7f5-b8clh\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") " pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:28.354730 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.354515    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-console-serving-cert\") pod \"console-6b5b7dc7f5-b8clh\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") " pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:28.354730 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.354560    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9g55q\" (UniqueName: \"kubernetes.io/projected/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-kube-api-access-9g55q\") pod \"console-6b5b7dc7f5-b8clh\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") " pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:28.354730 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.354604    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-oauth-serving-cert\") pod \"console-6b5b7dc7f5-b8clh\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") " pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:28.354730 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.354625    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-console-oauth-config\") pod \"console-6b5b7dc7f5-b8clh\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") " pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:28.355313 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.355287    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-service-ca\") pod \"console-6b5b7dc7f5-b8clh\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") " pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:28.355417 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.355292    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-console-config\") pod \"console-6b5b7dc7f5-b8clh\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") " pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:28.355417 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.355358    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-oauth-serving-cert\") pod \"console-6b5b7dc7f5-b8clh\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") " pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:28.356952 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.356931    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-console-oauth-config\") pod \"console-6b5b7dc7f5-b8clh\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") " pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:28.357039 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.357010    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-console-serving-cert\") pod \"console-6b5b7dc7f5-b8clh\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") " pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:28.361958 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.361938    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g55q\" (UniqueName: \"kubernetes.io/projected/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-kube-api-access-9g55q\") pod \"console-6b5b7dc7f5-b8clh\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") " pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:28.463545 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.463445    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:28.585842 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:28.585814    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b5b7dc7f5-b8clh"]
May 20 20:23:28.589630 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:23:28.589599    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b4d1bd1_46fe_4501_bcc2_c515f22ea07d.slice/crio-42b1e3b77f93123e6d4f3bbc134da70cf74f4f1bdf1c34d4c1881c11669a7d6b WatchSource:0}: Error finding container 42b1e3b77f93123e6d4f3bbc134da70cf74f4f1bdf1c34d4c1881c11669a7d6b: Status 404 returned error can't find the container with id 42b1e3b77f93123e6d4f3bbc134da70cf74f4f1bdf1c34d4c1881c11669a7d6b
May 20 20:23:29.136239 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:29.136197    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5b7dc7f5-b8clh" event={"ID":"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d","Type":"ContainerStarted","Data":"42b1e3b77f93123e6d4f3bbc134da70cf74f4f1bdf1c34d4c1881c11669a7d6b"}
May 20 20:23:32.144665 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:32.144628    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5b7dc7f5-b8clh" event={"ID":"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d","Type":"ContainerStarted","Data":"6e2f7eec46d9fdf60fb4e62dd4bbec2b305523e62c5da448e017499d184fc4a2"}
May 20 20:23:32.161558 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:32.161511    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6b5b7dc7f5-b8clh" podStartSLOduration=1.5633745430000001 podStartE2EDuration="4.16149735s" podCreationTimestamp="2026-05-20 20:23:28 +0000 UTC" firstStartedPulling="2026-05-20 20:23:28.591447059 +0000 UTC m=+222.622612864" lastFinishedPulling="2026-05-20 20:23:31.189569861 +0000 UTC m=+225.220735671" observedRunningTime="2026-05-20 20:23:32.160350117 +0000 UTC m=+226.191515944" watchObservedRunningTime="2026-05-20 20:23:32.16149735 +0000 UTC m=+226.192663177"
May 20 20:23:38.463575 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:38.463545    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:38.463575 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:38.463581    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:23:38.464689 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:38.464665    2566 patch_prober.go:28] interesting pod/console-6b5b7dc7f5-b8clh container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body=
May 20 20:23:38.464784 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:38.464718    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6b5b7dc7f5-b8clh" podUID="3b4d1bd1-46fe-4501-bcc2-c515f22ea07d" containerName="console" probeResult="failure" output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused"
May 20 20:23:43.174086 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:43.174053    2566 generic.go:358] "Generic (PLEG): container finished" podID="2edf8992-3677-4bdd-a809-e15044dd2758" containerID="1915333b7bb0067630f324b7b3610bffe3aaee9ae16e3ce7f42b650c6d3ef8f7" exitCode=0
May 20 20:23:43.174433 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:43.174116    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-6grhs" event={"ID":"2edf8992-3677-4bdd-a809-e15044dd2758","Type":"ContainerDied","Data":"1915333b7bb0067630f324b7b3610bffe3aaee9ae16e3ce7f42b650c6d3ef8f7"}
May 20 20:23:43.174433 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:43.174414    2566 scope.go:117] "RemoveContainer" containerID="1915333b7bb0067630f324b7b3610bffe3aaee9ae16e3ce7f42b650c6d3ef8f7"
May 20 20:23:43.400296 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:43.400268    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nkc5b_6cc19b57-f3ee-428d-a00e-b5ec641fd9bd/dns-node-resolver/0.log"
May 20 20:23:44.178192 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:44.178160    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-6grhs" event={"ID":"2edf8992-3677-4bdd-a809-e15044dd2758","Type":"ContainerStarted","Data":"7876f66ae2d410cbce31e0a1b547c7b1debf1961abd99c880188d71597c03cf4"}
May 20 20:23:44.799762 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:44.799734    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rpxfx_8eed8f09-7a8b-414c-b186-0733b5881f70/node-ca/0.log"
May 20 20:23:45.001335 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:45.001310    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-749647ff5d-8v29b_eed2efee-a682-4683-9b34-4449d997843b/router/0.log"
May 20 20:23:48.464057 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:48.464022    2566 patch_prober.go:28] interesting pod/console-6b5b7dc7f5-b8clh container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body=
May 20 20:23:48.464418 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:48.464081    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6b5b7dc7f5-b8clh" podUID="3b4d1bd1-46fe-4501-bcc2-c515f22ea07d" containerName="console" probeResult="failure" output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused"
May 20 20:23:58.319350 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:58.319308    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs\") pod \"network-metrics-daemon-lpcq8\" (UID: \"58397932-927e-4bcb-8ccd-3ba17d08a9f0\") " pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:23:58.321586 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:58.321554    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58397932-927e-4bcb-8ccd-3ba17d08a9f0-metrics-certs\") pod \"network-metrics-daemon-lpcq8\" (UID: \"58397932-927e-4bcb-8ccd-3ba17d08a9f0\") " pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:23:58.463876 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:58.463846    2566 patch_prober.go:28] interesting pod/console-6b5b7dc7f5-b8clh container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body=
May 20 20:23:58.464048 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:58.463925    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6b5b7dc7f5-b8clh" podUID="3b4d1bd1-46fe-4501-bcc2-c515f22ea07d" containerName="console" probeResult="failure" output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused"
May 20 20:23:58.555527 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:58.555500    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qsfbr\""
May 20 20:23:58.563612 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:58.563594    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lpcq8"
May 20 20:23:58.700762 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:58.700729    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lpcq8"]
May 20 20:23:58.703336 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:23:58.703309    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58397932_927e_4bcb_8ccd_3ba17d08a9f0.slice/crio-d08fe7f4748e7174b2f278ee555bb1aaa4838385beaf89bc91fa952acade1915 WatchSource:0}: Error finding container d08fe7f4748e7174b2f278ee555bb1aaa4838385beaf89bc91fa952acade1915: Status 404 returned error can't find the container with id d08fe7f4748e7174b2f278ee555bb1aaa4838385beaf89bc91fa952acade1915
May 20 20:23:59.225745 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:23:59.225696    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lpcq8" event={"ID":"58397932-927e-4bcb-8ccd-3ba17d08a9f0","Type":"ContainerStarted","Data":"d08fe7f4748e7174b2f278ee555bb1aaa4838385beaf89bc91fa952acade1915"}
May 20 20:24:00.233383 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:00.233344    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lpcq8" event={"ID":"58397932-927e-4bcb-8ccd-3ba17d08a9f0","Type":"ContainerStarted","Data":"145b88963cf855d2590eb90b6461cd8432191a8d10991ad5aa687b6aec16e573"}
May 20 20:24:00.233383 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:00.233382    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lpcq8" event={"ID":"58397932-927e-4bcb-8ccd-3ba17d08a9f0","Type":"ContainerStarted","Data":"8d2f3a638d94dab8cc92396f869300324efc66c043911bc9996b495428009954"}
May 20 20:24:00.251499 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:00.251453    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lpcq8" podStartSLOduration=253.282774432 podStartE2EDuration="4m14.251439481s" podCreationTimestamp="2026-05-20 20:19:46 +0000 UTC" firstStartedPulling="2026-05-20 20:23:58.705307633 +0000 UTC m=+252.736473441" lastFinishedPulling="2026-05-20 20:23:59.673972686 +0000 UTC m=+253.705138490" observedRunningTime="2026-05-20 20:24:00.250217483 +0000 UTC m=+254.281383310" watchObservedRunningTime="2026-05-20 20:24:00.251439481 +0000 UTC m=+254.282605307"
May 20 20:24:08.464046 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:08.464008    2566 patch_prober.go:28] interesting pod/console-6b5b7dc7f5-b8clh container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body=
May 20 20:24:08.464497 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:08.464066    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6b5b7dc7f5-b8clh" podUID="3b4d1bd1-46fe-4501-bcc2-c515f22ea07d" containerName="console" probeResult="failure" output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused"
May 20 20:24:18.464349 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:18.464313    2566 patch_prober.go:28] interesting pod/console-6b5b7dc7f5-b8clh container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body=
May 20 20:24:18.464825 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:18.464384    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6b5b7dc7f5-b8clh" podUID="3b4d1bd1-46fe-4501-bcc2-c515f22ea07d" containerName="console" probeResult="failure" output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused"
May 20 20:24:23.230728 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.230688    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b5b7dc7f5-b8clh"]
May 20 20:24:23.260471 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.260444    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d7dd5d75b-p4q9h"]
May 20 20:24:23.264740 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.264722    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.272069 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.272045    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d7dd5d75b-p4q9h"]
May 20 20:24:23.272211 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.272193    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 20 20:24:23.432665 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.432626    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-trusted-ca-bundle\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.432851 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.432688    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-service-ca\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.432851 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.432710    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-oauth-serving-cert\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.432851 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.432744    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36c57b90-1212-408e-864f-b56ec812bbac-console-oauth-config\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.432851 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.432762    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsxfg\" (UniqueName: \"kubernetes.io/projected/36c57b90-1212-408e-864f-b56ec812bbac-kube-api-access-hsxfg\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.432851 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.432840    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36c57b90-1212-408e-864f-b56ec812bbac-console-serving-cert\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.433097 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.432854    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-console-config\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.534073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.533989    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36c57b90-1212-408e-864f-b56ec812bbac-console-serving-cert\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.534073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.534027    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-console-config\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.534299 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.534080    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-trusted-ca-bundle\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.534299 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.534117    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-service-ca\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.534299 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.534143    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-oauth-serving-cert\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.534458 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.534306    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36c57b90-1212-408e-864f-b56ec812bbac-console-oauth-config\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.534458 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.534347    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hsxfg\" (UniqueName: \"kubernetes.io/projected/36c57b90-1212-408e-864f-b56ec812bbac-kube-api-access-hsxfg\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.535044 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.535019    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-oauth-serving-cert\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.535044 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.535038    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-service-ca\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.535189 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.535046    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-trusted-ca-bundle\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.535249 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.535228    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-console-config\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.536637 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.536614    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36c57b90-1212-408e-864f-b56ec812bbac-console-serving-cert\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.536732 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.536713    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36c57b90-1212-408e-864f-b56ec812bbac-console-oauth-config\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.542592 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.542572    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsxfg\" (UniqueName: \"kubernetes.io/projected/36c57b90-1212-408e-864f-b56ec812bbac-kube-api-access-hsxfg\") pod \"console-5d7dd5d75b-p4q9h\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") " pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.574357 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.574323    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:23.697877 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:23.697856    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d7dd5d75b-p4q9h"]
May 20 20:24:23.700229 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:24:23.700200    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c57b90_1212_408e_864f_b56ec812bbac.slice/crio-1186138a63e375eb09786004dc827f2ff379b26da85c09dc39e9d0a62142c61b WatchSource:0}: Error finding container 1186138a63e375eb09786004dc827f2ff379b26da85c09dc39e9d0a62142c61b: Status 404 returned error can't find the container with id 1186138a63e375eb09786004dc827f2ff379b26da85c09dc39e9d0a62142c61b
May 20 20:24:24.296904 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:24.296868    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7dd5d75b-p4q9h" event={"ID":"36c57b90-1212-408e-864f-b56ec812bbac","Type":"ContainerStarted","Data":"7c6e4be13afdda0678a592eb75644e6abd6347234e1f04505e1f5c6998b5b329"}
May 20 20:24:24.297385 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:24.296919    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7dd5d75b-p4q9h" event={"ID":"36c57b90-1212-408e-864f-b56ec812bbac","Type":"ContainerStarted","Data":"1186138a63e375eb09786004dc827f2ff379b26da85c09dc39e9d0a62142c61b"}
May 20 20:24:26.169483 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:26.169402    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5d7dd5d75b-p4q9h" podStartSLOduration=3.169381833 podStartE2EDuration="3.169381833s" podCreationTimestamp="2026-05-20 20:24:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:24:24.314390383 +0000 UTC m=+278.345556210" watchObservedRunningTime="2026-05-20 20:24:26.169381833 +0000 UTC m=+280.200547661"
May 20 20:24:26.170200 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:26.170180    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 20 20:24:26.170613 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:26.170589    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="alertmanager" containerID="cri-o://5ac43d301de370f4aea79b0345616f31d4a7187752dbf9e37a5e460e66523197" gracePeriod=120
May 20 20:24:26.170683 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:26.170642    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="kube-rbac-proxy-metric" containerID="cri-o://2eea265c5503ab2af1e4e7ee4bb1ee76248a8846cd3212ec80abd5d7a9312972" gracePeriod=120
May 20 20:24:26.170751 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:26.170705    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="prom-label-proxy" containerID="cri-o://fd84554d6595d4a93fcd0bd9a6d849b2a1b47d647da66067dfb5f30692d5f239" gracePeriod=120
May 20 20:24:26.170811 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:26.170698    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="kube-rbac-proxy-web" containerID="cri-o://dd0e89803dde27fb50e2e6380cc7d25fc876e3dcff2dfc337317215875b8c1b7" gracePeriod=120
May 20 20:24:26.170862 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:26.170717    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="config-reloader" containerID="cri-o://96eff699dd9635e527c4bd36a1256aa49eb974b971f5ee8bb088ffb528672269" gracePeriod=120
May 20 20:24:26.170862 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:26.170720    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="kube-rbac-proxy" containerID="cri-o://276392acec6c4f2a0d804b1cc2ff3e8c2f572bd8cfa659e17ed52db6e49d4b23" gracePeriod=120
May 20 20:24:26.304431 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:26.304401    2566 generic.go:358] "Generic (PLEG): container finished" podID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerID="fd84554d6595d4a93fcd0bd9a6d849b2a1b47d647da66067dfb5f30692d5f239" exitCode=0
May 20 20:24:26.304431 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:26.304424    2566 generic.go:358] "Generic (PLEG): container finished" podID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerID="276392acec6c4f2a0d804b1cc2ff3e8c2f572bd8cfa659e17ed52db6e49d4b23" exitCode=0
May 20 20:24:26.304431 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:26.304433    2566 generic.go:358] "Generic (PLEG): container finished" podID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerID="96eff699dd9635e527c4bd36a1256aa49eb974b971f5ee8bb088ffb528672269" exitCode=0
May 20 20:24:26.304604 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:26.304439    2566 generic.go:358] "Generic (PLEG): container finished" podID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerID="5ac43d301de370f4aea79b0345616f31d4a7187752dbf9e37a5e460e66523197" exitCode=0
May 20 20:24:26.304604 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:26.304468    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c626470-719c-47f0-a32e-ac9f9b4db6fa","Type":"ContainerDied","Data":"fd84554d6595d4a93fcd0bd9a6d849b2a1b47d647da66067dfb5f30692d5f239"}
May 20 20:24:26.304604 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:26.304503    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c626470-719c-47f0-a32e-ac9f9b4db6fa","Type":"ContainerDied","Data":"276392acec6c4f2a0d804b1cc2ff3e8c2f572bd8cfa659e17ed52db6e49d4b23"}
May 20 20:24:26.304604 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:26.304513    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c626470-719c-47f0-a32e-ac9f9b4db6fa","Type":"ContainerDied","Data":"96eff699dd9635e527c4bd36a1256aa49eb974b971f5ee8bb088ffb528672269"}
May 20 20:24:26.304604 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:26.304522    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c626470-719c-47f0-a32e-ac9f9b4db6fa","Type":"ContainerDied","Data":"5ac43d301de370f4aea79b0345616f31d4a7187752dbf9e37a5e460e66523197"}
May 20 20:24:26.943086 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:24:26.943021    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8" podUID="b77a7447-7dda-48f7-ae38-5aa565402fc3"
May 20 20:24:26.943086 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:24:26.943021    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ptgqm" podUID="c2ece298-1b7c-43ed-a06d-4f0684ba0180"
May 20 20:24:26.943311 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:24:26.943021    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8698d89747-fj9fs" podUID="38f8c7f1-7e2e-4bde-94b6-963844a3bdf0"
May 20 20:24:26.943311 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:24:26.943034    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-jx4zj" podUID="a60784d9-7267-4cdd-bfe1-9828b0ab3ee1"
May 20 20:24:27.310912 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.310869    2566 generic.go:358] "Generic (PLEG): container finished" podID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerID="2eea265c5503ab2af1e4e7ee4bb1ee76248a8846cd3212ec80abd5d7a9312972" exitCode=0
May 20 20:24:27.310912 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.310905    2566 generic.go:358] "Generic (PLEG): container finished" podID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerID="dd0e89803dde27fb50e2e6380cc7d25fc876e3dcff2dfc337317215875b8c1b7" exitCode=0
May 20 20:24:27.311385 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.310925    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c626470-719c-47f0-a32e-ac9f9b4db6fa","Type":"ContainerDied","Data":"2eea265c5503ab2af1e4e7ee4bb1ee76248a8846cd3212ec80abd5d7a9312972"}
May 20 20:24:27.311385 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.310962    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c626470-719c-47f0-a32e-ac9f9b4db6fa","Type":"ContainerDied","Data":"dd0e89803dde27fb50e2e6380cc7d25fc876e3dcff2dfc337317215875b8c1b7"}
May 20 20:24:27.311385 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.311021    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jx4zj"
May 20 20:24:27.311385 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.311030    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ptgqm"
May 20 20:24:27.311385 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.311031    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"
May 20 20:24:27.311385 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.311031    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:24:27.407613 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.407593    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:27.572268 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.572162    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c626470-719c-47f0-a32e-ac9f9b4db6fa-config-out\") pod \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") "
May 20 20:24:27.572268 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.572230    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhdwh\" (UniqueName: \"kubernetes.io/projected/4c626470-719c-47f0-a32e-ac9f9b4db6fa-kube-api-access-zhdwh\") pod \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") "
May 20 20:24:27.572268 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.572258    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c626470-719c-47f0-a32e-ac9f9b4db6fa-alertmanager-trusted-ca-bundle\") pod \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") "
May 20 20:24:27.572550 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.572286    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") "
May 20 20:24:27.572550 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.572307    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-main-tls\") pod \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") "
May 20 20:24:27.572550 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.572335    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-kube-rbac-proxy-web\") pod \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") "
May 20 20:24:27.572550 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.572414    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c626470-719c-47f0-a32e-ac9f9b4db6fa-alertmanager-main-db\") pod \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") "
May 20 20:24:27.572550 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.572492    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c626470-719c-47f0-a32e-ac9f9b4db6fa-metrics-client-ca\") pod \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") "
May 20 20:24:27.572550 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.572520    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-config-volume\") pod \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") "
May 20 20:24:27.572830 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.572576    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c626470-719c-47f0-a32e-ac9f9b4db6fa-tls-assets\") pod \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") "
May 20 20:24:27.572830 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.572605    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-web-config\") pod \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") "
May 20 20:24:27.572830 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.572665    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-kube-rbac-proxy\") pod \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") "
May 20 20:24:27.572830 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.572689    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-cluster-tls-config\") pod \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\" (UID: \"4c626470-719c-47f0-a32e-ac9f9b4db6fa\") "
May 20 20:24:27.572830 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.572811    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c626470-719c-47f0-a32e-ac9f9b4db6fa-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4c626470-719c-47f0-a32e-ac9f9b4db6fa" (UID: "4c626470-719c-47f0-a32e-ac9f9b4db6fa"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:24:27.572830 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.572816    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c626470-719c-47f0-a32e-ac9f9b4db6fa-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4c626470-719c-47f0-a32e-ac9f9b4db6fa" (UID: "4c626470-719c-47f0-a32e-ac9f9b4db6fa"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:24:27.573160 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.573030    2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c626470-719c-47f0-a32e-ac9f9b4db6fa-alertmanager-main-db\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:24:27.573160 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.573051    2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c626470-719c-47f0-a32e-ac9f9b4db6fa-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:24:27.574455 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.574423    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c626470-719c-47f0-a32e-ac9f9b4db6fa-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4c626470-719c-47f0-a32e-ac9f9b4db6fa" (UID: "4c626470-719c-47f0-a32e-ac9f9b4db6fa"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:24:27.575099 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.575073    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4c626470-719c-47f0-a32e-ac9f9b4db6fa" (UID: "4c626470-719c-47f0-a32e-ac9f9b4db6fa"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:24:27.575206 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.575154    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4c626470-719c-47f0-a32e-ac9f9b4db6fa" (UID: "4c626470-719c-47f0-a32e-ac9f9b4db6fa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:24:27.575686 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.575658    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c626470-719c-47f0-a32e-ac9f9b4db6fa-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4c626470-719c-47f0-a32e-ac9f9b4db6fa" (UID: "4c626470-719c-47f0-a32e-ac9f9b4db6fa"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:24:27.575772 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.575716    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c626470-719c-47f0-a32e-ac9f9b4db6fa-config-out" (OuterVolumeSpecName: "config-out") pod "4c626470-719c-47f0-a32e-ac9f9b4db6fa" (UID: "4c626470-719c-47f0-a32e-ac9f9b4db6fa"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:24:27.575867 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.575848    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c626470-719c-47f0-a32e-ac9f9b4db6fa-kube-api-access-zhdwh" (OuterVolumeSpecName: "kube-api-access-zhdwh") pod "4c626470-719c-47f0-a32e-ac9f9b4db6fa" (UID: "4c626470-719c-47f0-a32e-ac9f9b4db6fa"). InnerVolumeSpecName "kube-api-access-zhdwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:24:27.576081 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.576049    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4c626470-719c-47f0-a32e-ac9f9b4db6fa" (UID: "4c626470-719c-47f0-a32e-ac9f9b4db6fa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:24:27.576141 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.576118    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4c626470-719c-47f0-a32e-ac9f9b4db6fa" (UID: "4c626470-719c-47f0-a32e-ac9f9b4db6fa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:24:27.576867 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.576844    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-config-volume" (OuterVolumeSpecName: "config-volume") pod "4c626470-719c-47f0-a32e-ac9f9b4db6fa" (UID: "4c626470-719c-47f0-a32e-ac9f9b4db6fa"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:24:27.579533 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.579502    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4c626470-719c-47f0-a32e-ac9f9b4db6fa" (UID: "4c626470-719c-47f0-a32e-ac9f9b4db6fa"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:24:27.586204 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.586182    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-web-config" (OuterVolumeSpecName: "web-config") pod "4c626470-719c-47f0-a32e-ac9f9b4db6fa" (UID: "4c626470-719c-47f0-a32e-ac9f9b4db6fa"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:24:27.674253 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.674221    2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c626470-719c-47f0-a32e-ac9f9b4db6fa-tls-assets\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:24:27.674253 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.674248    2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-web-config\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:24:27.674253 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.674259    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:24:27.674530 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.674269    2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-cluster-tls-config\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:24:27.674530 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.674279    2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c626470-719c-47f0-a32e-ac9f9b4db6fa-config-out\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:24:27.674530 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.674287    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhdwh\" (UniqueName: \"kubernetes.io/projected/4c626470-719c-47f0-a32e-ac9f9b4db6fa-kube-api-access-zhdwh\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:24:27.674530 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.674299    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:24:27.674530 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.674308    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-main-tls\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:24:27.674530 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.674317    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:24:27.674530 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.674326    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c626470-719c-47f0-a32e-ac9f9b4db6fa-metrics-client-ca\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:24:27.674530 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:27.674334    2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c626470-719c-47f0-a32e-ac9f9b4db6fa-config-volume\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:24:28.320658 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.320624    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c626470-719c-47f0-a32e-ac9f9b4db6fa","Type":"ContainerDied","Data":"8ca0a209462368e6dbd0a67202984156a5fdf191077b6e79c2f16af0bc0ace4a"}
May 20 20:24:28.320658 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.320666    2566 scope.go:117] "RemoveContainer" containerID="fd84554d6595d4a93fcd0bd9a6d849b2a1b47d647da66067dfb5f30692d5f239"
May 20 20:24:28.321135 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.320719    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.328687 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.328668    2566 scope.go:117] "RemoveContainer" containerID="2eea265c5503ab2af1e4e7ee4bb1ee76248a8846cd3212ec80abd5d7a9312972"
May 20 20:24:28.335293 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.335274    2566 scope.go:117] "RemoveContainer" containerID="276392acec6c4f2a0d804b1cc2ff3e8c2f572bd8cfa659e17ed52db6e49d4b23"
May 20 20:24:28.341146 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.341131    2566 scope.go:117] "RemoveContainer" containerID="dd0e89803dde27fb50e2e6380cc7d25fc876e3dcff2dfc337317215875b8c1b7"
May 20 20:24:28.345537 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.345517    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 20 20:24:28.347743 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.347728    2566 scope.go:117] "RemoveContainer" containerID="96eff699dd9635e527c4bd36a1256aa49eb974b971f5ee8bb088ffb528672269"
May 20 20:24:28.352662 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.352640    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 20 20:24:28.354515 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.354498    2566 scope.go:117] "RemoveContainer" containerID="5ac43d301de370f4aea79b0345616f31d4a7187752dbf9e37a5e460e66523197"
May 20 20:24:28.360535 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.360519    2566 scope.go:117] "RemoveContainer" containerID="e6c650dcdad5cdbdb12415495e44b885e1e753e6d7bbf453e57325d109f21037"
May 20 20:24:28.378136 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378112    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 20 20:24:28.378432 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378420    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="alertmanager"
May 20 20:24:28.378472 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378434    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="alertmanager"
May 20 20:24:28.378472 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378441    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="kube-rbac-proxy"
May 20 20:24:28.378472 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378447    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="kube-rbac-proxy"
May 20 20:24:28.378472 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378456    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="prom-label-proxy"
May 20 20:24:28.378472 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378465    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="prom-label-proxy"
May 20 20:24:28.378659 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378480    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="kube-rbac-proxy-web"
May 20 20:24:28.378659 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378485    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="kube-rbac-proxy-web"
May 20 20:24:28.378659 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378492    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="config-reloader"
May 20 20:24:28.378659 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378497    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="config-reloader"
May 20 20:24:28.378659 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378505    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="init-config-reloader"
May 20 20:24:28.378659 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378511    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="init-config-reloader"
May 20 20:24:28.378659 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378516    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="kube-rbac-proxy-metric"
May 20 20:24:28.378659 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378521    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="kube-rbac-proxy-metric"
May 20 20:24:28.378659 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378572    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="kube-rbac-proxy"
May 20 20:24:28.378659 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378579    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="kube-rbac-proxy-metric"
May 20 20:24:28.378659 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378584    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="alertmanager"
May 20 20:24:28.378659 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378590    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="prom-label-proxy"
May 20 20:24:28.378659 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378597    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="config-reloader"
May 20 20:24:28.378659 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.378603    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" containerName="kube-rbac-proxy-web"
May 20 20:24:28.383555 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.383537    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.386111 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.386040    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 20 20:24:28.386241 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.386197    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 20 20:24:28.386241 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.386203    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 20 20:24:28.386241 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.386196    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 20 20:24:28.386468 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.386432    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 20 20:24:28.386468 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.386437    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 20 20:24:28.386587 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.386479    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 20 20:24:28.386587 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.386437    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 20 20:24:28.386587 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.386460    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s8glg\""
May 20 20:24:28.392037 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.392007    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 20 20:24:28.393545 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.393525    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 20 20:24:28.557610 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.557537    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c626470-719c-47f0-a32e-ac9f9b4db6fa" path="/var/lib/kubelet/pods/4c626470-719c-47f0-a32e-ac9f9b4db6fa/volumes"
May 20 20:24:28.582136 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.582116    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.582222 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.582154    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.582222 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.582176    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1895a777-02b2-4648-b215-8bcd867a544c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.582299 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.582220    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1895a777-02b2-4648-b215-8bcd867a544c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.582299 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.582249    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1895a777-02b2-4648-b215-8bcd867a544c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.582401 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.582354    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.582455 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.582411    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-config-volume\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.582455 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.582444    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1895a777-02b2-4648-b215-8bcd867a544c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.582557 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.582480    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1895a777-02b2-4648-b215-8bcd867a544c-config-out\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.582557 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.582505    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9djfr\" (UniqueName: \"kubernetes.io/projected/1895a777-02b2-4648-b215-8bcd867a544c-kube-api-access-9djfr\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.582557 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.582538    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.582693 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.582617    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.582693 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.582666    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-web-config\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.683825 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.683789    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.683993 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.683839    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.683993 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.683927    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1895a777-02b2-4648-b215-8bcd867a544c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.683993 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.683963    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1895a777-02b2-4648-b215-8bcd867a544c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.683993 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.683979    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1895a777-02b2-4648-b215-8bcd867a544c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.684197 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.684014    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.684197 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.684041    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-config-volume\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.684197 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.684066    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1895a777-02b2-4648-b215-8bcd867a544c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.684197 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.684104    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1895a777-02b2-4648-b215-8bcd867a544c-config-out\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.684197 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.684127    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9djfr\" (UniqueName: \"kubernetes.io/projected/1895a777-02b2-4648-b215-8bcd867a544c-kube-api-access-9djfr\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.684197 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.684155    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.684483 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.684199    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.684483 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.684352    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1895a777-02b2-4648-b215-8bcd867a544c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.685205 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.684791    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1895a777-02b2-4648-b215-8bcd867a544c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.685205 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.685047    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1895a777-02b2-4648-b215-8bcd867a544c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.687049 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.687023    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1895a777-02b2-4648-b215-8bcd867a544c-config-out\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.687176 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.687090    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-web-config\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.687344 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.687282    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.687451 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.687372    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-config-volume\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.687624 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.687598    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.687725 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.687659    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.687787 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.687764    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1895a777-02b2-4648-b215-8bcd867a544c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.688018 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.687993    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.688231 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.688211    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.689260 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.689242    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1895a777-02b2-4648-b215-8bcd867a544c-web-config\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.692737 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.692712    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9djfr\" (UniqueName: \"kubernetes.io/projected/1895a777-02b2-4648-b215-8bcd867a544c-kube-api-access-9djfr\") pod \"alertmanager-main-0\" (UID: \"1895a777-02b2-4648-b215-8bcd867a544c\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.692856 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.692843    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 20 20:24:28.823597 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:28.823569    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 20 20:24:28.826041 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:24:28.826006    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1895a777_02b2_4648_b215_8bcd867a544c.slice/crio-5e7852a2254eea9c85c3c2bf969c6ffb2cf33774c2840c99ee3be531f54c088a WatchSource:0}: Error finding container 5e7852a2254eea9c85c3c2bf969c6ffb2cf33774c2840c99ee3be531f54c088a: Status 404 returned error can't find the container with id 5e7852a2254eea9c85c3c2bf969c6ffb2cf33774c2840c99ee3be531f54c088a
May 20 20:24:29.324722 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:29.324688    2566 generic.go:358] "Generic (PLEG): container finished" podID="1895a777-02b2-4648-b215-8bcd867a544c" containerID="9a5b77c0ca9287eddf1a1efce06fb132a88bcf3fc53143128ddf97b1f69c7a05" exitCode=0
May 20 20:24:29.325162 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:29.324740    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1895a777-02b2-4648-b215-8bcd867a544c","Type":"ContainerDied","Data":"9a5b77c0ca9287eddf1a1efce06fb132a88bcf3fc53143128ddf97b1f69c7a05"}
May 20 20:24:29.325162 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:29.324782    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1895a777-02b2-4648-b215-8bcd867a544c","Type":"ContainerStarted","Data":"5e7852a2254eea9c85c3c2bf969c6ffb2cf33774c2840c99ee3be531f54c088a"}
May 20 20:24:30.331227 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.331185    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1895a777-02b2-4648-b215-8bcd867a544c","Type":"ContainerStarted","Data":"0fd56c588e4c407ff93d824952fd9366c29e77736d7e5c41b7c8feaf305720c0"}
May 20 20:24:30.331607 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.331234    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1895a777-02b2-4648-b215-8bcd867a544c","Type":"ContainerStarted","Data":"736d6d95fd4a0263c95c7f0c7463a5cbff31f94b8da2c576921c7b13cab7160f"}
May 20 20:24:30.331607 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.331248    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1895a777-02b2-4648-b215-8bcd867a544c","Type":"ContainerStarted","Data":"791c75709157cf7b0f7ba267067484c7deffbbc5bdecd41196b143476b24ea55"}
May 20 20:24:30.331607 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.331261    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1895a777-02b2-4648-b215-8bcd867a544c","Type":"ContainerStarted","Data":"47330f5af46b97641ea06c39ecdc4200b03b194f2920a4f4996c55242c8f3294"}
May 20 20:24:30.331607 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.331273    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1895a777-02b2-4648-b215-8bcd867a544c","Type":"ContainerStarted","Data":"51ef0c323de4f75367c5f66a0e56b882ce7e2d567a1f6547707863f1d87bcfdd"}
May 20 20:24:30.331607 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.331284    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1895a777-02b2-4648-b215-8bcd867a544c","Type":"ContainerStarted","Data":"9070952b6e525b34166e3eddcbdf7e77afb738690e1123146b206d7d4f62a832"}
May 20 20:24:30.359585 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.359532    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.359516603 podStartE2EDuration="2.359516603s" podCreationTimestamp="2026-05-20 20:24:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:24:30.359249663 +0000 UTC m=+284.390415492" watchObservedRunningTime="2026-05-20 20:24:30.359516603 +0000 UTC m=+284.390682430"
May 20 20:24:30.404234 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.404201    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-9rqk8\" (UID: \"b77a7447-7dda-48f7-ae38-5aa565402fc3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"
May 20 20:24:30.404413 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.404361    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:24:30.404521 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.404503    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:24:30.404674 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.404655    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert\") pod \"ingress-canary-jx4zj\" (UID: \"a60784d9-7267-4cdd-bfe1-9828b0ab3ee1\") " pod="openshift-ingress-canary/ingress-canary-jx4zj"
May 20 20:24:30.407440 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.407393    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls\") pod \"image-registry-8698d89747-fj9fs\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") " pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:24:30.408077 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.408020    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a60784d9-7267-4cdd-bfe1-9828b0ab3ee1-cert\") pod \"ingress-canary-jx4zj\" (UID: \"a60784d9-7267-4cdd-bfe1-9828b0ab3ee1\") " pod="openshift-ingress-canary/ingress-canary-jx4zj"
May 20 20:24:30.408077 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.408031    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b77a7447-7dda-48f7-ae38-5aa565402fc3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-9rqk8\" (UID: \"b77a7447-7dda-48f7-ae38-5aa565402fc3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"
May 20 20:24:30.408362 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.408343    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2ece298-1b7c-43ed-a06d-4f0684ba0180-metrics-tls\") pod \"dns-default-ptgqm\" (UID: \"c2ece298-1b7c-43ed-a06d-4f0684ba0180\") " pod="openshift-dns/dns-default-ptgqm"
May 20 20:24:30.614755 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.614720    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lck56\""
May 20 20:24:30.614974 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.614793    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6s6vr\""
May 20 20:24:30.614974 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.614720    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8wmjb\""
May 20 20:24:30.615153 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.615111    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-98fhr\""
May 20 20:24:30.623291 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.623264    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"
May 20 20:24:30.623291 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.623279    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jx4zj"
May 20 20:24:30.623449 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.623307    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ptgqm"
May 20 20:24:30.623449 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.623268    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:24:30.796638 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.795527    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jx4zj"]
May 20 20:24:30.798363 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:24:30.798337    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda60784d9_7267_4cdd_bfe1_9828b0ab3ee1.slice/crio-d9aa1716445dc99ca5b9e870e242fb024d863a605de91221537827e77ab55bce WatchSource:0}: Error finding container d9aa1716445dc99ca5b9e870e242fb024d863a605de91221537827e77ab55bce: Status 404 returned error can't find the container with id d9aa1716445dc99ca5b9e870e242fb024d863a605de91221537827e77ab55bce
May 20 20:24:30.813353 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:30.813330    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8"]
May 20 20:24:30.815770 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:24:30.815734    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb77a7447_7dda_48f7_ae38_5aa565402fc3.slice/crio-5dbba5bff8d38eed206a498b5756418fd4e73b7c5e185338085353c2b9e43022 WatchSource:0}: Error finding container 5dbba5bff8d38eed206a498b5756418fd4e73b7c5e185338085353c2b9e43022: Status 404 returned error can't find the container with id 5dbba5bff8d38eed206a498b5756418fd4e73b7c5e185338085353c2b9e43022
May 20 20:24:31.042922 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:31.042879    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ptgqm"]
May 20 20:24:31.045461 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:31.045425    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8698d89747-fj9fs"]
May 20 20:24:31.046036 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:24:31.045980    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ece298_1b7c_43ed_a06d_4f0684ba0180.slice/crio-ffeb70f30747f24d9ee7ba78a14f095f39e3272991adeb5fc9535a1c37162b40 WatchSource:0}: Error finding container ffeb70f30747f24d9ee7ba78a14f095f39e3272991adeb5fc9535a1c37162b40: Status 404 returned error can't find the container with id ffeb70f30747f24d9ee7ba78a14f095f39e3272991adeb5fc9535a1c37162b40
May 20 20:24:31.047930 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:24:31.047906    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38f8c7f1_7e2e_4bde_94b6_963844a3bdf0.slice/crio-444628c17f302e9e32a3087af21eb38126b453954f7b94de7c4a1e17c9b0d84f WatchSource:0}: Error finding container 444628c17f302e9e32a3087af21eb38126b453954f7b94de7c4a1e17c9b0d84f: Status 404 returned error can't find the container with id 444628c17f302e9e32a3087af21eb38126b453954f7b94de7c4a1e17c9b0d84f
May 20 20:24:31.337000 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:31.336880    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jx4zj" event={"ID":"a60784d9-7267-4cdd-bfe1-9828b0ab3ee1","Type":"ContainerStarted","Data":"d9aa1716445dc99ca5b9e870e242fb024d863a605de91221537827e77ab55bce"}
May 20 20:24:31.339504 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:31.339225    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8698d89747-fj9fs" event={"ID":"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0","Type":"ContainerStarted","Data":"7d52d4d51bccc3a3b24953660de59e8d27973048d3ec8b5e0e32edf7e2976543"}
May 20 20:24:31.339504 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:31.339262    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8698d89747-fj9fs" event={"ID":"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0","Type":"ContainerStarted","Data":"444628c17f302e9e32a3087af21eb38126b453954f7b94de7c4a1e17c9b0d84f"}
May 20 20:24:31.340057 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:31.340026    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:24:31.341685 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:31.341631    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ptgqm" event={"ID":"c2ece298-1b7c-43ed-a06d-4f0684ba0180","Type":"ContainerStarted","Data":"ffeb70f30747f24d9ee7ba78a14f095f39e3272991adeb5fc9535a1c37162b40"}
May 20 20:24:31.343124 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:31.343104    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8" event={"ID":"b77a7447-7dda-48f7-ae38-5aa565402fc3","Type":"ContainerStarted","Data":"5dbba5bff8d38eed206a498b5756418fd4e73b7c5e185338085353c2b9e43022"}
May 20 20:24:31.372832 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:31.372769    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8698d89747-fj9fs" podStartSLOduration=284.372753866 podStartE2EDuration="4m44.372753866s" podCreationTimestamp="2026-05-20 20:19:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:24:31.371240702 +0000 UTC m=+285.402406532" watchObservedRunningTime="2026-05-20 20:24:31.372753866 +0000 UTC m=+285.403919700"
May 20 20:24:32.348760 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:32.348725    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8" event={"ID":"b77a7447-7dda-48f7-ae38-5aa565402fc3","Type":"ContainerStarted","Data":"1e80ebe352ab0048d8db3d3ac6c5b82538d12f7859ea7af9c11873720bf114cc"}
May 20 20:24:32.363662 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:32.363584    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-9rqk8" podStartSLOduration=267.209430542 podStartE2EDuration="4m28.363570327s" podCreationTimestamp="2026-05-20 20:20:04 +0000 UTC" firstStartedPulling="2026-05-20 20:24:30.817974642 +0000 UTC m=+284.849140447" lastFinishedPulling="2026-05-20 20:24:31.972114413 +0000 UTC m=+286.003280232" observedRunningTime="2026-05-20 20:24:32.362648775 +0000 UTC m=+286.393814603" watchObservedRunningTime="2026-05-20 20:24:32.363570327 +0000 UTC m=+286.394736192"
May 20 20:24:33.353544 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:33.353484    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jx4zj" event={"ID":"a60784d9-7267-4cdd-bfe1-9828b0ab3ee1","Type":"ContainerStarted","Data":"036feaeb3f649b8731010eaf528920d69498103a6f14eac0eba30a5428303923"}
May 20 20:24:33.374979 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:33.374932    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jx4zj" podStartSLOduration=251.534889546 podStartE2EDuration="4m13.374917816s" podCreationTimestamp="2026-05-20 20:20:20 +0000 UTC" firstStartedPulling="2026-05-20 20:24:30.800163816 +0000 UTC m=+284.831329622" lastFinishedPulling="2026-05-20 20:24:32.640192072 +0000 UTC m=+286.671357892" observedRunningTime="2026-05-20 20:24:33.373526067 +0000 UTC m=+287.404691895" watchObservedRunningTime="2026-05-20 20:24:33.374917816 +0000 UTC m=+287.406083643"
May 20 20:24:33.574768 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:33.574728    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:33.574997 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:33.574782    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:33.576551 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:33.576518    2566 patch_prober.go:28] interesting pod/console-5d7dd5d75b-p4q9h container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body=
May 20 20:24:33.576669 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:33.576575    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5d7dd5d75b-p4q9h" podUID="36c57b90-1212-408e-864f-b56ec812bbac" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused"
May 20 20:24:34.358365 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:34.358325    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ptgqm" event={"ID":"c2ece298-1b7c-43ed-a06d-4f0684ba0180","Type":"ContainerStarted","Data":"00e4085f7984c3e2963eed87dbf527610f46de0229573a310148f05c38dbfb7c"}
May 20 20:24:34.358365 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:34.358366    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ptgqm" event={"ID":"c2ece298-1b7c-43ed-a06d-4f0684ba0180","Type":"ContainerStarted","Data":"ab60f80712179aaaa8e72bdd27bd0f87e93e286084ad8ff4b57b3a4930dbc6e8"}
May 20 20:24:34.358783 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:34.358563    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ptgqm"
May 20 20:24:34.376059 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:34.376022    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-ptgqm" podStartSLOduration=251.765321922 podStartE2EDuration="4m14.376010402s" podCreationTimestamp="2026-05-20 20:20:20 +0000 UTC" firstStartedPulling="2026-05-20 20:24:31.048011693 +0000 UTC m=+285.079177499" lastFinishedPulling="2026-05-20 20:24:33.658700172 +0000 UTC m=+287.689865979" observedRunningTime="2026-05-20 20:24:34.37426373 +0000 UTC m=+288.405429558" watchObservedRunningTime="2026-05-20 20:24:34.376010402 +0000 UTC m=+288.407176272"
May 20 20:24:43.575264 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:43.575233    2566 patch_prober.go:28] interesting pod/console-5d7dd5d75b-p4q9h container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body=
May 20 20:24:43.575709 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:43.575280    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5d7dd5d75b-p4q9h" podUID="36c57b90-1212-408e-864f-b56ec812bbac" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused"
May 20 20:24:44.363775 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:44.363747    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ptgqm"
May 20 20:24:46.451199 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:46.451175    2566 kubelet.go:1628] "Image garbage collection succeeded"
May 20 20:24:48.249287 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.249221    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6b5b7dc7f5-b8clh" podUID="3b4d1bd1-46fe-4501-bcc2-c515f22ea07d" containerName="console" containerID="cri-o://6e2f7eec46d9fdf60fb4e62dd4bbec2b305523e62c5da448e017499d184fc4a2" gracePeriod=15
May 20 20:24:48.400833 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.400804    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b5b7dc7f5-b8clh_3b4d1bd1-46fe-4501-bcc2-c515f22ea07d/console/0.log"
May 20 20:24:48.401029 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.400849    2566 generic.go:358] "Generic (PLEG): container finished" podID="3b4d1bd1-46fe-4501-bcc2-c515f22ea07d" containerID="6e2f7eec46d9fdf60fb4e62dd4bbec2b305523e62c5da448e017499d184fc4a2" exitCode=2
May 20 20:24:48.401029 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.400933    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5b7dc7f5-b8clh" event={"ID":"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d","Type":"ContainerDied","Data":"6e2f7eec46d9fdf60fb4e62dd4bbec2b305523e62c5da448e017499d184fc4a2"}
May 20 20:24:48.486566 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.486543    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b5b7dc7f5-b8clh_3b4d1bd1-46fe-4501-bcc2-c515f22ea07d/console/0.log"
May 20 20:24:48.486674 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.486601    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:24:48.567510 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.567438    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-console-oauth-config\") pod \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") "
May 20 20:24:48.567510 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.567475    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-service-ca\") pod \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") "
May 20 20:24:48.567693 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.567603    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-oauth-serving-cert\") pod \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") "
May 20 20:24:48.567693 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.567645    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-console-config\") pod \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") "
May 20 20:24:48.567693 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.567672    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-console-serving-cert\") pod \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") "
May 20 20:24:48.567811 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.567706    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9g55q\" (UniqueName: \"kubernetes.io/projected/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-kube-api-access-9g55q\") pod \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\" (UID: \"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d\") "
May 20 20:24:48.567963 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.567926    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-service-ca" (OuterVolumeSpecName: "service-ca") pod "3b4d1bd1-46fe-4501-bcc2-c515f22ea07d" (UID: "3b4d1bd1-46fe-4501-bcc2-c515f22ea07d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:24:48.568064 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.567986    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3b4d1bd1-46fe-4501-bcc2-c515f22ea07d" (UID: "3b4d1bd1-46fe-4501-bcc2-c515f22ea07d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:24:48.568064 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.568010    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-console-config" (OuterVolumeSpecName: "console-config") pod "3b4d1bd1-46fe-4501-bcc2-c515f22ea07d" (UID: "3b4d1bd1-46fe-4501-bcc2-c515f22ea07d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:24:48.569712 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.569688    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3b4d1bd1-46fe-4501-bcc2-c515f22ea07d" (UID: "3b4d1bd1-46fe-4501-bcc2-c515f22ea07d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:24:48.569807 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.569727    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3b4d1bd1-46fe-4501-bcc2-c515f22ea07d" (UID: "3b4d1bd1-46fe-4501-bcc2-c515f22ea07d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:24:48.569807 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.569737    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-kube-api-access-9g55q" (OuterVolumeSpecName: "kube-api-access-9g55q") pod "3b4d1bd1-46fe-4501-bcc2-c515f22ea07d" (UID: "3b4d1bd1-46fe-4501-bcc2-c515f22ea07d"). InnerVolumeSpecName "kube-api-access-9g55q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:24:48.669344 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.669308    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-oauth-serving-cert\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:24:48.669344 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.669338    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-console-config\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:24:48.669344 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.669348    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-console-serving-cert\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:24:48.669579 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.669357    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9g55q\" (UniqueName: \"kubernetes.io/projected/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-kube-api-access-9g55q\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:24:48.669579 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.669368    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-console-oauth-config\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:24:48.669579 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:48.669377    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d-service-ca\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:24:49.404404 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:49.404378    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b5b7dc7f5-b8clh_3b4d1bd1-46fe-4501-bcc2-c515f22ea07d/console/0.log"
May 20 20:24:49.404833 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:49.404462    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5b7dc7f5-b8clh" event={"ID":"3b4d1bd1-46fe-4501-bcc2-c515f22ea07d","Type":"ContainerDied","Data":"42b1e3b77f93123e6d4f3bbc134da70cf74f4f1bdf1c34d4c1881c11669a7d6b"}
May 20 20:24:49.404833 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:49.404487    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5b7dc7f5-b8clh"
May 20 20:24:49.404833 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:49.404500    2566 scope.go:117] "RemoveContainer" containerID="6e2f7eec46d9fdf60fb4e62dd4bbec2b305523e62c5da448e017499d184fc4a2"
May 20 20:24:49.424814 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:49.424778    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b5b7dc7f5-b8clh"]
May 20 20:24:49.428830 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:49.428809    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b5b7dc7f5-b8clh"]
May 20 20:24:50.557175 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:50.557137    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b4d1bd1-46fe-4501-bcc2-c515f22ea07d" path="/var/lib/kubelet/pods/3b4d1bd1-46fe-4501-bcc2-c515f22ea07d/volumes"
May 20 20:24:50.627573 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:50.627541    2566 patch_prober.go:28] interesting pod/image-registry-8698d89747-fj9fs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 20 20:24:50.627748 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:50.627590    2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8698d89747-fj9fs" podUID="38f8c7f1-7e2e-4bde-94b6-963844a3bdf0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:24:51.843040 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:51.842992    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8698d89747-fj9fs"]
May 20 20:24:51.847222 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:51.847193    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:24:53.578766 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:53.578735    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:24:53.582641 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:24:53.582619    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:25:16.862128 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:16.862065    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8698d89747-fj9fs" podUID="38f8c7f1-7e2e-4bde-94b6-963844a3bdf0" containerName="registry" containerID="cri-o://7d52d4d51bccc3a3b24953660de59e8d27973048d3ec8b5e0e32edf7e2976543" gracePeriod=30
May 20 20:25:17.103290 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.103268    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:25:17.210460 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.210386    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-image-registry-private-configuration\") pod \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") "
May 20 20:25:17.210460 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.210422    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs57z\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-kube-api-access-fs57z\") pod \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") "
May 20 20:25:17.210460 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.210439    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls\") pod \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") "
May 20 20:25:17.210667 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.210470    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-certificates\") pod \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") "
May 20 20:25:17.210667 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.210591    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-ca-trust-extracted\") pod \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") "
May 20 20:25:17.210747 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.210664    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-installation-pull-secrets\") pod \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") "
May 20 20:25:17.210747 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.210701    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-bound-sa-token\") pod \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") "
May 20 20:25:17.210747 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.210739    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-trusted-ca\") pod \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\" (UID: \"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0\") "
May 20 20:25:17.211242 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.210935    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0" (UID: "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:25:17.211242 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.211015    2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-certificates\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:25:17.211417 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.211270    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0" (UID: "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:25:17.213252 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.213200    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0" (UID: "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:25:17.213252 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.213210    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-kube-api-access-fs57z" (OuterVolumeSpecName: "kube-api-access-fs57z") pod "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0" (UID: "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0"). InnerVolumeSpecName "kube-api-access-fs57z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:25:17.213252 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.213216    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0" (UID: "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:25:17.213426 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.213339    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0" (UID: "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:25:17.213426 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.213359    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0" (UID: "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:25:17.218977 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.218951    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0" (UID: "38f8c7f1-7e2e-4bde-94b6-963844a3bdf0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:25:17.312047 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.312014    2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-image-registry-private-configuration\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:25:17.312047 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.312043    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs57z\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-kube-api-access-fs57z\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:25:17.312215 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.312057    2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-registry-tls\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:25:17.312215 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.312070    2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-ca-trust-extracted\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:25:17.312215 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.312083    2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-installation-pull-secrets\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:25:17.312215 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.312095    2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-bound-sa-token\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:25:17.312215 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.312107    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0-trusted-ca\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:25:17.488012 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.487927    2566 generic.go:358] "Generic (PLEG): container finished" podID="38f8c7f1-7e2e-4bde-94b6-963844a3bdf0" containerID="7d52d4d51bccc3a3b24953660de59e8d27973048d3ec8b5e0e32edf7e2976543" exitCode=0
May 20 20:25:17.488132 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.488020    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8698d89747-fj9fs" event={"ID":"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0","Type":"ContainerDied","Data":"7d52d4d51bccc3a3b24953660de59e8d27973048d3ec8b5e0e32edf7e2976543"}
May 20 20:25:17.488132 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.488028    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8698d89747-fj9fs"
May 20 20:25:17.488132 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.488067    2566 scope.go:117] "RemoveContainer" containerID="7d52d4d51bccc3a3b24953660de59e8d27973048d3ec8b5e0e32edf7e2976543"
May 20 20:25:17.488287 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.488058    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8698d89747-fj9fs" event={"ID":"38f8c7f1-7e2e-4bde-94b6-963844a3bdf0","Type":"ContainerDied","Data":"444628c17f302e9e32a3087af21eb38126b453954f7b94de7c4a1e17c9b0d84f"}
May 20 20:25:17.496841 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.496825    2566 scope.go:117] "RemoveContainer" containerID="7d52d4d51bccc3a3b24953660de59e8d27973048d3ec8b5e0e32edf7e2976543"
May 20 20:25:17.497131 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:25:17.497109    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d52d4d51bccc3a3b24953660de59e8d27973048d3ec8b5e0e32edf7e2976543\": container with ID starting with 7d52d4d51bccc3a3b24953660de59e8d27973048d3ec8b5e0e32edf7e2976543 not found: ID does not exist" containerID="7d52d4d51bccc3a3b24953660de59e8d27973048d3ec8b5e0e32edf7e2976543"
May 20 20:25:17.497187 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.497140    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d52d4d51bccc3a3b24953660de59e8d27973048d3ec8b5e0e32edf7e2976543"} err="failed to get container status \"7d52d4d51bccc3a3b24953660de59e8d27973048d3ec8b5e0e32edf7e2976543\": rpc error: code = NotFound desc = could not find container \"7d52d4d51bccc3a3b24953660de59e8d27973048d3ec8b5e0e32edf7e2976543\": container with ID starting with 7d52d4d51bccc3a3b24953660de59e8d27973048d3ec8b5e0e32edf7e2976543 not found: ID does not exist"
May 20 20:25:17.511623 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.511599    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8698d89747-fj9fs"]
May 20 20:25:17.516646 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:17.516627    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8698d89747-fj9fs"]
May 20 20:25:18.556650 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:25:18.556618    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38f8c7f1-7e2e-4bde-94b6-963844a3bdf0" path="/var/lib/kubelet/pods/38f8c7f1-7e2e-4bde-94b6-963844a3bdf0/volumes"
May 20 20:26:36.556794 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.556760    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k"]
May 20 20:26:36.557320 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.557139    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38f8c7f1-7e2e-4bde-94b6-963844a3bdf0" containerName="registry"
May 20 20:26:36.557320 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.557156    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="38f8c7f1-7e2e-4bde-94b6-963844a3bdf0" containerName="registry"
May 20 20:26:36.557320 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.557183    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b4d1bd1-46fe-4501-bcc2-c515f22ea07d" containerName="console"
May 20 20:26:36.557320 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.557191    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b4d1bd1-46fe-4501-bcc2-c515f22ea07d" containerName="console"
May 20 20:26:36.557320 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.557258    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="38f8c7f1-7e2e-4bde-94b6-963844a3bdf0" containerName="registry"
May 20 20:26:36.557320 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.557275    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b4d1bd1-46fe-4501-bcc2-c515f22ea07d" containerName="console"
May 20 20:26:36.560129 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.560107    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k"
May 20 20:26:36.562438 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.562422    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 20:26:36.562543 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.562452    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cf5mm\""
May 20 20:26:36.563223 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.563209    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 20:26:36.568337 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.568318    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k"]
May 20 20:26:36.591880 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.591855    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e43cc7c4-26c8-49db-b830-865150b21667-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k\" (UID: \"e43cc7c4-26c8-49db-b830-865150b21667\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k"
May 20 20:26:36.591983 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.591934    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg7b5\" (UniqueName: \"kubernetes.io/projected/e43cc7c4-26c8-49db-b830-865150b21667-kube-api-access-rg7b5\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k\" (UID: \"e43cc7c4-26c8-49db-b830-865150b21667\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k"
May 20 20:26:36.591983 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.591979    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e43cc7c4-26c8-49db-b830-865150b21667-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k\" (UID: \"e43cc7c4-26c8-49db-b830-865150b21667\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k"
May 20 20:26:36.692979 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.692934    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rg7b5\" (UniqueName: \"kubernetes.io/projected/e43cc7c4-26c8-49db-b830-865150b21667-kube-api-access-rg7b5\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k\" (UID: \"e43cc7c4-26c8-49db-b830-865150b21667\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k"
May 20 20:26:36.693120 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.692999    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e43cc7c4-26c8-49db-b830-865150b21667-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k\" (UID: \"e43cc7c4-26c8-49db-b830-865150b21667\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k"
May 20 20:26:36.693120 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.693027    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e43cc7c4-26c8-49db-b830-865150b21667-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k\" (UID: \"e43cc7c4-26c8-49db-b830-865150b21667\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k"
May 20 20:26:36.693353 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.693339    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e43cc7c4-26c8-49db-b830-865150b21667-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k\" (UID: \"e43cc7c4-26c8-49db-b830-865150b21667\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k"
May 20 20:26:36.693388 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.693366    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e43cc7c4-26c8-49db-b830-865150b21667-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k\" (UID: \"e43cc7c4-26c8-49db-b830-865150b21667\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k"
May 20 20:26:36.701391 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.701366    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg7b5\" (UniqueName: \"kubernetes.io/projected/e43cc7c4-26c8-49db-b830-865150b21667-kube-api-access-rg7b5\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k\" (UID: \"e43cc7c4-26c8-49db-b830-865150b21667\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k"
May 20 20:26:36.870463 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.870431    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k"
May 20 20:26:36.994979 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.994945    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k"]
May 20 20:26:36.998058 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:26:36.998032    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode43cc7c4_26c8_49db_b830_865150b21667.slice/crio-c8e624837bdd9842bc079c96a85ffe589291f62768b742dd70a1664c2acb7f60 WatchSource:0}: Error finding container c8e624837bdd9842bc079c96a85ffe589291f62768b742dd70a1664c2acb7f60: Status 404 returned error can't find the container with id c8e624837bdd9842bc079c96a85ffe589291f62768b742dd70a1664c2acb7f60
May 20 20:26:36.999722 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:36.999708    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 20:26:37.706916 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:37.706866    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k" event={"ID":"e43cc7c4-26c8-49db-b830-865150b21667","Type":"ContainerStarted","Data":"c8e624837bdd9842bc079c96a85ffe589291f62768b742dd70a1664c2acb7f60"}
May 20 20:26:42.721703 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:42.721669    2566 generic.go:358] "Generic (PLEG): container finished" podID="e43cc7c4-26c8-49db-b830-865150b21667" containerID="b89dc312797045307476937a951abf5bbdf10d2a917198bea2a45357df050e50" exitCode=0
May 20 20:26:42.722090 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:42.721719    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k" event={"ID":"e43cc7c4-26c8-49db-b830-865150b21667","Type":"ContainerDied","Data":"b89dc312797045307476937a951abf5bbdf10d2a917198bea2a45357df050e50"}
May 20 20:26:44.729165 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:44.729133    2566 generic.go:358] "Generic (PLEG): container finished" podID="e43cc7c4-26c8-49db-b830-865150b21667" containerID="7d4ffacede960e932ad6f337563792d6e2162d371b1cd19f91e8aebb76c041d7" exitCode=0
May 20 20:26:44.729559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:44.729187    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k" event={"ID":"e43cc7c4-26c8-49db-b830-865150b21667","Type":"ContainerDied","Data":"7d4ffacede960e932ad6f337563792d6e2162d371b1cd19f91e8aebb76c041d7"}
May 20 20:26:51.750912 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:51.750862    2566 generic.go:358] "Generic (PLEG): container finished" podID="e43cc7c4-26c8-49db-b830-865150b21667" containerID="e9cf7fe17f65a7998af7416ffa5370de0dc4cebffb491284010eac627df8bbc4" exitCode=0
May 20 20:26:51.751363 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:51.750934    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k" event={"ID":"e43cc7c4-26c8-49db-b830-865150b21667","Type":"ContainerDied","Data":"e9cf7fe17f65a7998af7416ffa5370de0dc4cebffb491284010eac627df8bbc4"}
May 20 20:26:52.878363 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:52.878341    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k"
May 20 20:26:52.923227 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:52.923192    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e43cc7c4-26c8-49db-b830-865150b21667-util\") pod \"e43cc7c4-26c8-49db-b830-865150b21667\" (UID: \"e43cc7c4-26c8-49db-b830-865150b21667\") "
May 20 20:26:52.923363 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:52.923239    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e43cc7c4-26c8-49db-b830-865150b21667-bundle\") pod \"e43cc7c4-26c8-49db-b830-865150b21667\" (UID: \"e43cc7c4-26c8-49db-b830-865150b21667\") "
May 20 20:26:52.923363 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:52.923297    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rg7b5\" (UniqueName: \"kubernetes.io/projected/e43cc7c4-26c8-49db-b830-865150b21667-kube-api-access-rg7b5\") pod \"e43cc7c4-26c8-49db-b830-865150b21667\" (UID: \"e43cc7c4-26c8-49db-b830-865150b21667\") "
May 20 20:26:52.923940 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:52.923916    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43cc7c4-26c8-49db-b830-865150b21667-bundle" (OuterVolumeSpecName: "bundle") pod "e43cc7c4-26c8-49db-b830-865150b21667" (UID: "e43cc7c4-26c8-49db-b830-865150b21667"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:26:52.925360 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:52.925337    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e43cc7c4-26c8-49db-b830-865150b21667-kube-api-access-rg7b5" (OuterVolumeSpecName: "kube-api-access-rg7b5") pod "e43cc7c4-26c8-49db-b830-865150b21667" (UID: "e43cc7c4-26c8-49db-b830-865150b21667"). InnerVolumeSpecName "kube-api-access-rg7b5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:26:52.928569 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:52.928525    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43cc7c4-26c8-49db-b830-865150b21667-util" (OuterVolumeSpecName: "util") pod "e43cc7c4-26c8-49db-b830-865150b21667" (UID: "e43cc7c4-26c8-49db-b830-865150b21667"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:26:53.024341 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:53.024272    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e43cc7c4-26c8-49db-b830-865150b21667-util\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:26:53.024341 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:53.024298    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e43cc7c4-26c8-49db-b830-865150b21667-bundle\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:26:53.024341 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:53.024308    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rg7b5\" (UniqueName: \"kubernetes.io/projected/e43cc7c4-26c8-49db-b830-865150b21667-kube-api-access-rg7b5\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:26:53.759031 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:53.758997    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k" event={"ID":"e43cc7c4-26c8-49db-b830-865150b21667","Type":"ContainerDied","Data":"c8e624837bdd9842bc079c96a85ffe589291f62768b742dd70a1664c2acb7f60"}
May 20 20:26:53.759031 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:53.759013    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djkv2k"
May 20 20:26:53.759031 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:53.759029    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8e624837bdd9842bc079c96a85ffe589291f62768b742dd70a1664c2acb7f60"
May 20 20:26:59.498981 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.498943    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ttq77"]
May 20 20:26:59.499474 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.499244    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43cc7c4-26c8-49db-b830-865150b21667" containerName="extract"
May 20 20:26:59.499474 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.499255    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43cc7c4-26c8-49db-b830-865150b21667" containerName="extract"
May 20 20:26:59.499474 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.499268    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43cc7c4-26c8-49db-b830-865150b21667" containerName="pull"
May 20 20:26:59.499474 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.499274    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43cc7c4-26c8-49db-b830-865150b21667" containerName="pull"
May 20 20:26:59.499474 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.499283    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43cc7c4-26c8-49db-b830-865150b21667" containerName="util"
May 20 20:26:59.499474 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.499287    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43cc7c4-26c8-49db-b830-865150b21667" containerName="util"
May 20 20:26:59.499474 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.499332    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="e43cc7c4-26c8-49db-b830-865150b21667" containerName="extract"
May 20 20:26:59.546307 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.546271    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ttq77"]
May 20 20:26:59.546443 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.546338    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ttq77"
May 20 20:26:59.550324 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.550305    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
May 20 20:26:59.550434 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.550365    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4z6qp\""
May 20 20:26:59.550434 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.550388    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
May 20 20:26:59.683657 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.683624    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt2qh\" (UniqueName: \"kubernetes.io/projected/3ff6ace2-4643-448f-8810-afb5d32a30e5-kube-api-access-rt2qh\") pod \"cert-manager-operator-controller-manager-54b9655956-ttq77\" (UID: \"3ff6ace2-4643-448f-8810-afb5d32a30e5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ttq77"
May 20 20:26:59.683814 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.683665    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ff6ace2-4643-448f-8810-afb5d32a30e5-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-ttq77\" (UID: \"3ff6ace2-4643-448f-8810-afb5d32a30e5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ttq77"
May 20 20:26:59.784429 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.784365    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rt2qh\" (UniqueName: \"kubernetes.io/projected/3ff6ace2-4643-448f-8810-afb5d32a30e5-kube-api-access-rt2qh\") pod \"cert-manager-operator-controller-manager-54b9655956-ttq77\" (UID: \"3ff6ace2-4643-448f-8810-afb5d32a30e5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ttq77"
May 20 20:26:59.784429 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.784398    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ff6ace2-4643-448f-8810-afb5d32a30e5-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-ttq77\" (UID: \"3ff6ace2-4643-448f-8810-afb5d32a30e5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ttq77"
May 20 20:26:59.784698 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.784682    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ff6ace2-4643-448f-8810-afb5d32a30e5-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-ttq77\" (UID: \"3ff6ace2-4643-448f-8810-afb5d32a30e5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ttq77"
May 20 20:26:59.792702 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.792675    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt2qh\" (UniqueName: \"kubernetes.io/projected/3ff6ace2-4643-448f-8810-afb5d32a30e5-kube-api-access-rt2qh\") pod \"cert-manager-operator-controller-manager-54b9655956-ttq77\" (UID: \"3ff6ace2-4643-448f-8810-afb5d32a30e5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ttq77"
May 20 20:26:59.855807 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.855776    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ttq77"
May 20 20:26:59.981786 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:26:59.981761    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ttq77"]
May 20 20:26:59.984413 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:26:59.984385    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff6ace2_4643_448f_8810_afb5d32a30e5.slice/crio-d70ca14d53b15325fc05d9bdc00240d861bb3d35b0b4cff4ffd1fd1f741f1a24 WatchSource:0}: Error finding container d70ca14d53b15325fc05d9bdc00240d861bb3d35b0b4cff4ffd1fd1f741f1a24: Status 404 returned error can't find the container with id d70ca14d53b15325fc05d9bdc00240d861bb3d35b0b4cff4ffd1fd1f741f1a24
May 20 20:27:00.785485 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:00.785447    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ttq77" event={"ID":"3ff6ace2-4643-448f-8810-afb5d32a30e5","Type":"ContainerStarted","Data":"d70ca14d53b15325fc05d9bdc00240d861bb3d35b0b4cff4ffd1fd1f741f1a24"}
May 20 20:27:02.793422 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:02.793386    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ttq77" event={"ID":"3ff6ace2-4643-448f-8810-afb5d32a30e5","Type":"ContainerStarted","Data":"35919581b2a3906fb94d657e569ba026436f82ef4addddb50ab4b0f2ce44738c"}
May 20 20:27:02.816203 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:02.816138    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ttq77" podStartSLOduration=1.8829604199999999 podStartE2EDuration="3.816121059s" podCreationTimestamp="2026-05-20 20:26:59 +0000 UTC" firstStartedPulling="2026-05-20 20:26:59.986771572 +0000 UTC m=+434.017937377" lastFinishedPulling="2026-05-20 20:27:01.919932211 +0000 UTC m=+435.951098016" observedRunningTime="2026-05-20 20:27:02.814451502 +0000 UTC m=+436.845617330" watchObservedRunningTime="2026-05-20 20:27:02.816121059 +0000 UTC m=+436.847286887"
May 20 20:27:03.847329 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:03.847293    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw"]
May 20 20:27:03.863153 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:03.863119    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw"]
May 20 20:27:03.863290 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:03.863180    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw"
May 20 20:27:03.865927 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:03.865884    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 20:27:03.866300 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:03.866280    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 20:27:03.867094 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:03.867071    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cf5mm\""
May 20 20:27:04.023468 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:04.023428    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6dcf05eb-5d8b-4d2d-9726-306320e6b9de-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw\" (UID: \"6dcf05eb-5d8b-4d2d-9726-306320e6b9de\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw"
May 20 20:27:04.023468 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:04.023467    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl7jz\" (UniqueName: \"kubernetes.io/projected/6dcf05eb-5d8b-4d2d-9726-306320e6b9de-kube-api-access-gl7jz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw\" (UID: \"6dcf05eb-5d8b-4d2d-9726-306320e6b9de\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw"
May 20 20:27:04.023673 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:04.023572    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6dcf05eb-5d8b-4d2d-9726-306320e6b9de-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw\" (UID: \"6dcf05eb-5d8b-4d2d-9726-306320e6b9de\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw"
May 20 20:27:04.125052 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:04.124979    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6dcf05eb-5d8b-4d2d-9726-306320e6b9de-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw\" (UID: \"6dcf05eb-5d8b-4d2d-9726-306320e6b9de\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw"
May 20 20:27:04.125197 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:04.125049    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6dcf05eb-5d8b-4d2d-9726-306320e6b9de-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw\" (UID: \"6dcf05eb-5d8b-4d2d-9726-306320e6b9de\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw"
May 20 20:27:04.125197 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:04.125075    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gl7jz\" (UniqueName: \"kubernetes.io/projected/6dcf05eb-5d8b-4d2d-9726-306320e6b9de-kube-api-access-gl7jz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw\" (UID: \"6dcf05eb-5d8b-4d2d-9726-306320e6b9de\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw"
May 20 20:27:04.125351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:04.125330    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6dcf05eb-5d8b-4d2d-9726-306320e6b9de-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw\" (UID: \"6dcf05eb-5d8b-4d2d-9726-306320e6b9de\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw"
May 20 20:27:04.125421 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:04.125402    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6dcf05eb-5d8b-4d2d-9726-306320e6b9de-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw\" (UID: \"6dcf05eb-5d8b-4d2d-9726-306320e6b9de\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw"
May 20 20:27:04.132882 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:04.132858    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl7jz\" (UniqueName: \"kubernetes.io/projected/6dcf05eb-5d8b-4d2d-9726-306320e6b9de-kube-api-access-gl7jz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw\" (UID: \"6dcf05eb-5d8b-4d2d-9726-306320e6b9de\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw"
May 20 20:27:04.172721 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:04.172683    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw"
May 20 20:27:04.299425 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:04.299393    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw"]
May 20 20:27:04.302625 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:27:04.302593    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dcf05eb_5d8b_4d2d_9726_306320e6b9de.slice/crio-4a9d76932d791d04140afb1b10d62031a7b1123e084397d51344306d11b8d5e4 WatchSource:0}: Error finding container 4a9d76932d791d04140afb1b10d62031a7b1123e084397d51344306d11b8d5e4: Status 404 returned error can't find the container with id 4a9d76932d791d04140afb1b10d62031a7b1123e084397d51344306d11b8d5e4
May 20 20:27:04.801086 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:04.801002    2566 generic.go:358] "Generic (PLEG): container finished" podID="6dcf05eb-5d8b-4d2d-9726-306320e6b9de" containerID="6b8bd6166e820076549a428bcb3332e5715a7ebd5ff917874d84837e4b754207" exitCode=0
May 20 20:27:04.801235 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:04.801088    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw" event={"ID":"6dcf05eb-5d8b-4d2d-9726-306320e6b9de","Type":"ContainerDied","Data":"6b8bd6166e820076549a428bcb3332e5715a7ebd5ff917874d84837e4b754207"}
May 20 20:27:04.801235 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:04.801118    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw" event={"ID":"6dcf05eb-5d8b-4d2d-9726-306320e6b9de","Type":"ContainerStarted","Data":"4a9d76932d791d04140afb1b10d62031a7b1123e084397d51344306d11b8d5e4"}
May 20 20:27:07.812136 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:07.812099    2566 generic.go:358] "Generic (PLEG): container finished" podID="6dcf05eb-5d8b-4d2d-9726-306320e6b9de" containerID="9bd9cac9b303e4c7c2135fd35d903f9dfd23722d50e41a74b10f376daa21340c" exitCode=0
May 20 20:27:07.812602 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:07.812184    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw" event={"ID":"6dcf05eb-5d8b-4d2d-9726-306320e6b9de","Type":"ContainerDied","Data":"9bd9cac9b303e4c7c2135fd35d903f9dfd23722d50e41a74b10f376daa21340c"}
May 20 20:27:08.627012 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:08.626978    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-xvt6p"]
May 20 20:27:08.628936 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:08.628921    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-xvt6p"
May 20 20:27:08.631164 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:08.631139    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 20 20:27:08.632128 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:08.632111    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 20 20:27:08.632248 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:08.632189    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-mf98v\""
May 20 20:27:08.640164 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:08.640142    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-xvt6p"]
May 20 20:27:08.765403 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:08.765376    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpfpc\" (UniqueName: \"kubernetes.io/projected/cce66068-86fb-4ccb-b436-5f290621e095-kube-api-access-xpfpc\") pod \"cert-manager-cainjector-68b757865b-xvt6p\" (UID: \"cce66068-86fb-4ccb-b436-5f290621e095\") " pod="cert-manager/cert-manager-cainjector-68b757865b-xvt6p"
May 20 20:27:08.765533 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:08.765420    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cce66068-86fb-4ccb-b436-5f290621e095-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-xvt6p\" (UID: \"cce66068-86fb-4ccb-b436-5f290621e095\") " pod="cert-manager/cert-manager-cainjector-68b757865b-xvt6p"
May 20 20:27:08.817156 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:08.817133    2566 generic.go:358] "Generic (PLEG): container finished" podID="6dcf05eb-5d8b-4d2d-9726-306320e6b9de" containerID="75daa3eb5a503ef0c68fa45f5f1cc44ab81737e2f90194d8f99d3e6e64538d2d" exitCode=0
May 20 20:27:08.817460 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:08.817214    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw" event={"ID":"6dcf05eb-5d8b-4d2d-9726-306320e6b9de","Type":"ContainerDied","Data":"75daa3eb5a503ef0c68fa45f5f1cc44ab81737e2f90194d8f99d3e6e64538d2d"}
May 20 20:27:08.866355 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:08.866334    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cce66068-86fb-4ccb-b436-5f290621e095-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-xvt6p\" (UID: \"cce66068-86fb-4ccb-b436-5f290621e095\") " pod="cert-manager/cert-manager-cainjector-68b757865b-xvt6p"
May 20 20:27:08.866442 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:08.866397    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpfpc\" (UniqueName: \"kubernetes.io/projected/cce66068-86fb-4ccb-b436-5f290621e095-kube-api-access-xpfpc\") pod \"cert-manager-cainjector-68b757865b-xvt6p\" (UID: \"cce66068-86fb-4ccb-b436-5f290621e095\") " pod="cert-manager/cert-manager-cainjector-68b757865b-xvt6p"
May 20 20:27:08.875599 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:08.875574    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cce66068-86fb-4ccb-b436-5f290621e095-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-xvt6p\" (UID: \"cce66068-86fb-4ccb-b436-5f290621e095\") " pod="cert-manager/cert-manager-cainjector-68b757865b-xvt6p"
May 20 20:27:08.875675 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:08.875634    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpfpc\" (UniqueName: \"kubernetes.io/projected/cce66068-86fb-4ccb-b436-5f290621e095-kube-api-access-xpfpc\") pod \"cert-manager-cainjector-68b757865b-xvt6p\" (UID: \"cce66068-86fb-4ccb-b436-5f290621e095\") " pod="cert-manager/cert-manager-cainjector-68b757865b-xvt6p"
May 20 20:27:08.947704 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:08.947652    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-xvt6p"
May 20 20:27:09.067272 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:09.067245    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-xvt6p"]
May 20 20:27:09.070875 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:27:09.070843    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcce66068_86fb_4ccb_b436_5f290621e095.slice/crio-e423858e6c47ba13784056f31d5d8c4ece165de0bfbc8508c6192ec26345f472 WatchSource:0}: Error finding container e423858e6c47ba13784056f31d5d8c4ece165de0bfbc8508c6192ec26345f472: Status 404 returned error can't find the container with id e423858e6c47ba13784056f31d5d8c4ece165de0bfbc8508c6192ec26345f472
May 20 20:27:09.822357 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:09.822310    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-xvt6p" event={"ID":"cce66068-86fb-4ccb-b436-5f290621e095","Type":"ContainerStarted","Data":"e423858e6c47ba13784056f31d5d8c4ece165de0bfbc8508c6192ec26345f472"}
May 20 20:27:09.968075 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:09.968052    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw"
May 20 20:27:10.080774 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:10.080701    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6dcf05eb-5d8b-4d2d-9726-306320e6b9de-util\") pod \"6dcf05eb-5d8b-4d2d-9726-306320e6b9de\" (UID: \"6dcf05eb-5d8b-4d2d-9726-306320e6b9de\") "
May 20 20:27:10.080774 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:10.080768    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6dcf05eb-5d8b-4d2d-9726-306320e6b9de-bundle\") pod \"6dcf05eb-5d8b-4d2d-9726-306320e6b9de\" (UID: \"6dcf05eb-5d8b-4d2d-9726-306320e6b9de\") "
May 20 20:27:10.080996 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:10.080806    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl7jz\" (UniqueName: \"kubernetes.io/projected/6dcf05eb-5d8b-4d2d-9726-306320e6b9de-kube-api-access-gl7jz\") pod \"6dcf05eb-5d8b-4d2d-9726-306320e6b9de\" (UID: \"6dcf05eb-5d8b-4d2d-9726-306320e6b9de\") "
May 20 20:27:10.081207 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:10.081164    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dcf05eb-5d8b-4d2d-9726-306320e6b9de-bundle" (OuterVolumeSpecName: "bundle") pod "6dcf05eb-5d8b-4d2d-9726-306320e6b9de" (UID: "6dcf05eb-5d8b-4d2d-9726-306320e6b9de"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:27:10.083123 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:10.083094    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dcf05eb-5d8b-4d2d-9726-306320e6b9de-kube-api-access-gl7jz" (OuterVolumeSpecName: "kube-api-access-gl7jz") pod "6dcf05eb-5d8b-4d2d-9726-306320e6b9de" (UID: "6dcf05eb-5d8b-4d2d-9726-306320e6b9de"). InnerVolumeSpecName "kube-api-access-gl7jz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:27:10.085964 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:10.085918    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dcf05eb-5d8b-4d2d-9726-306320e6b9de-util" (OuterVolumeSpecName: "util") pod "6dcf05eb-5d8b-4d2d-9726-306320e6b9de" (UID: "6dcf05eb-5d8b-4d2d-9726-306320e6b9de"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:27:10.182320 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:10.182286    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6dcf05eb-5d8b-4d2d-9726-306320e6b9de-util\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:27:10.182320 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:10.182313    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6dcf05eb-5d8b-4d2d-9726-306320e6b9de-bundle\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:27:10.182320 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:10.182322    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl7jz\" (UniqueName: \"kubernetes.io/projected/6dcf05eb-5d8b-4d2d-9726-306320e6b9de-kube-api-access-gl7jz\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:27:10.827829 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:10.827742    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw" event={"ID":"6dcf05eb-5d8b-4d2d-9726-306320e6b9de","Type":"ContainerDied","Data":"4a9d76932d791d04140afb1b10d62031a7b1123e084397d51344306d11b8d5e4"}
May 20 20:27:10.827829 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:10.827781    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a9d76932d791d04140afb1b10d62031a7b1123e084397d51344306d11b8d5e4"
May 20 20:27:10.827829 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:10.827807    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw2hhw"
May 20 20:27:11.832975 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:11.832878    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-xvt6p" event={"ID":"cce66068-86fb-4ccb-b436-5f290621e095","Type":"ContainerStarted","Data":"5b50e29390e8de4a0c99a40a3e256f5edb6ed65a8cb72f21c33d991093f3e1a0"}
May 20 20:27:11.849021 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:11.848967    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-xvt6p" podStartSLOduration=1.5156252810000002 podStartE2EDuration="3.848953355s" podCreationTimestamp="2026-05-20 20:27:08 +0000 UTC" firstStartedPulling="2026-05-20 20:27:09.072783169 +0000 UTC m=+443.103948974" lastFinishedPulling="2026-05-20 20:27:11.406111232 +0000 UTC m=+445.437277048" observedRunningTime="2026-05-20 20:27:11.848066369 +0000 UTC m=+445.879232273" watchObservedRunningTime="2026-05-20 20:27:11.848953355 +0000 UTC m=+445.880119181"
May 20 20:27:17.123442 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.123410    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-jns6c"]
May 20 20:27:17.123803 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.123724    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dcf05eb-5d8b-4d2d-9726-306320e6b9de" containerName="util"
May 20 20:27:17.123803 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.123736    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dcf05eb-5d8b-4d2d-9726-306320e6b9de" containerName="util"
May 20 20:27:17.123803 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.123749    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dcf05eb-5d8b-4d2d-9726-306320e6b9de" containerName="pull"
May 20 20:27:17.123803 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.123754    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dcf05eb-5d8b-4d2d-9726-306320e6b9de" containerName="pull"
May 20 20:27:17.123803 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.123771    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dcf05eb-5d8b-4d2d-9726-306320e6b9de" containerName="extract"
May 20 20:27:17.123803 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.123777    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dcf05eb-5d8b-4d2d-9726-306320e6b9de" containerName="extract"
May 20 20:27:17.124004 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.123822    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="6dcf05eb-5d8b-4d2d-9726-306320e6b9de" containerName="extract"
May 20 20:27:17.125619 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.125603    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jns6c"
May 20 20:27:17.128137 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.128113    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 20 20:27:17.128907 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.128874    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rdm5v\""
May 20 20:27:17.128999 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.128907    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 20 20:27:17.134700 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.134678    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-jns6c"]
May 20 20:27:17.138984 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.138943    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh77b\" (UniqueName: \"kubernetes.io/projected/8d0c7939-640b-485e-8cf9-86de758b08c5-kube-api-access-zh77b\") pod \"openshift-lws-operator-bfc7f696d-jns6c\" (UID: \"8d0c7939-640b-485e-8cf9-86de758b08c5\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jns6c"
May 20 20:27:17.139076 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.139009    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d0c7939-640b-485e-8cf9-86de758b08c5-tmp\") pod \"openshift-lws-operator-bfc7f696d-jns6c\" (UID: \"8d0c7939-640b-485e-8cf9-86de758b08c5\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jns6c"
May 20 20:27:17.239622 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.239593    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zh77b\" (UniqueName: \"kubernetes.io/projected/8d0c7939-640b-485e-8cf9-86de758b08c5-kube-api-access-zh77b\") pod \"openshift-lws-operator-bfc7f696d-jns6c\" (UID: \"8d0c7939-640b-485e-8cf9-86de758b08c5\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jns6c"
May 20 20:27:17.239726 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.239636    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d0c7939-640b-485e-8cf9-86de758b08c5-tmp\") pod \"openshift-lws-operator-bfc7f696d-jns6c\" (UID: \"8d0c7939-640b-485e-8cf9-86de758b08c5\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jns6c"
May 20 20:27:17.239977 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.239962    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d0c7939-640b-485e-8cf9-86de758b08c5-tmp\") pod \"openshift-lws-operator-bfc7f696d-jns6c\" (UID: \"8d0c7939-640b-485e-8cf9-86de758b08c5\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jns6c"
May 20 20:27:17.249864 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.249840    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh77b\" (UniqueName: \"kubernetes.io/projected/8d0c7939-640b-485e-8cf9-86de758b08c5-kube-api-access-zh77b\") pod \"openshift-lws-operator-bfc7f696d-jns6c\" (UID: \"8d0c7939-640b-485e-8cf9-86de758b08c5\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jns6c"
May 20 20:27:17.435488 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.435413    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jns6c"
May 20 20:27:17.556638 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.556608    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-jns6c"]
May 20 20:27:17.559860 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:27:17.559834    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d0c7939_640b_485e_8cf9_86de758b08c5.slice/crio-2ab524d04299af10826c96c3463ba6f1e685859354b9043a2f6d3ecebcaa228c WatchSource:0}: Error finding container 2ab524d04299af10826c96c3463ba6f1e685859354b9043a2f6d3ecebcaa228c: Status 404 returned error can't find the container with id 2ab524d04299af10826c96c3463ba6f1e685859354b9043a2f6d3ecebcaa228c
May 20 20:27:17.854815 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.854777    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jns6c" event={"ID":"8d0c7939-640b-485e-8cf9-86de758b08c5","Type":"ContainerStarted","Data":"2ab524d04299af10826c96c3463ba6f1e685859354b9043a2f6d3ecebcaa228c"}
May 20 20:27:17.917829 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.917802    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-rc9v4"]
May 20 20:27:17.920424 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.920404    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-rc9v4"
May 20 20:27:17.922677 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.922651    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kdgc2\""
May 20 20:27:17.928926 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.928885    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-rc9v4"]
May 20 20:27:17.945759 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.945733    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b5wm\" (UniqueName: \"kubernetes.io/projected/be49e547-36b1-4a3b-8ea6-069eac30d21d-kube-api-access-5b5wm\") pod \"cert-manager-79c8d999ff-rc9v4\" (UID: \"be49e547-36b1-4a3b-8ea6-069eac30d21d\") " pod="cert-manager/cert-manager-79c8d999ff-rc9v4"
May 20 20:27:17.945846 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:17.945776    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be49e547-36b1-4a3b-8ea6-069eac30d21d-bound-sa-token\") pod \"cert-manager-79c8d999ff-rc9v4\" (UID: \"be49e547-36b1-4a3b-8ea6-069eac30d21d\") " pod="cert-manager/cert-manager-79c8d999ff-rc9v4"
May 20 20:27:18.046471 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:18.046441    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5b5wm\" (UniqueName: \"kubernetes.io/projected/be49e547-36b1-4a3b-8ea6-069eac30d21d-kube-api-access-5b5wm\") pod \"cert-manager-79c8d999ff-rc9v4\" (UID: \"be49e547-36b1-4a3b-8ea6-069eac30d21d\") " pod="cert-manager/cert-manager-79c8d999ff-rc9v4"
May 20 20:27:18.046559 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:18.046491    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be49e547-36b1-4a3b-8ea6-069eac30d21d-bound-sa-token\") pod \"cert-manager-79c8d999ff-rc9v4\" (UID: \"be49e547-36b1-4a3b-8ea6-069eac30d21d\") " pod="cert-manager/cert-manager-79c8d999ff-rc9v4"
May 20 20:27:18.054306 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:18.054283    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be49e547-36b1-4a3b-8ea6-069eac30d21d-bound-sa-token\") pod \"cert-manager-79c8d999ff-rc9v4\" (UID: \"be49e547-36b1-4a3b-8ea6-069eac30d21d\") " pod="cert-manager/cert-manager-79c8d999ff-rc9v4"
May 20 20:27:18.054489 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:18.054468    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b5wm\" (UniqueName: \"kubernetes.io/projected/be49e547-36b1-4a3b-8ea6-069eac30d21d-kube-api-access-5b5wm\") pod \"cert-manager-79c8d999ff-rc9v4\" (UID: \"be49e547-36b1-4a3b-8ea6-069eac30d21d\") " pod="cert-manager/cert-manager-79c8d999ff-rc9v4"
May 20 20:27:18.230452 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:18.230367    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-rc9v4"
May 20 20:27:18.367425 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:18.367397    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-rc9v4"]
May 20 20:27:18.369298 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:27:18.369269    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe49e547_36b1_4a3b_8ea6_069eac30d21d.slice/crio-3f05532bd8f504a027ecd62022d9f4869eb5a073a714030c84f6ad0a61721df1 WatchSource:0}: Error finding container 3f05532bd8f504a027ecd62022d9f4869eb5a073a714030c84f6ad0a61721df1: Status 404 returned error can't find the container with id 3f05532bd8f504a027ecd62022d9f4869eb5a073a714030c84f6ad0a61721df1
May 20 20:27:18.860170 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:18.860134    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-rc9v4" event={"ID":"be49e547-36b1-4a3b-8ea6-069eac30d21d","Type":"ContainerStarted","Data":"5203428049d82ed3750ee2c5a06c060c6d03b0858241cc832e7bf353d31751cc"}
May 20 20:27:18.860334 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:18.860178    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-rc9v4" event={"ID":"be49e547-36b1-4a3b-8ea6-069eac30d21d","Type":"ContainerStarted","Data":"3f05532bd8f504a027ecd62022d9f4869eb5a073a714030c84f6ad0a61721df1"}
May 20 20:27:18.875521 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:18.875433    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-rc9v4" podStartSLOduration=1.875419151 podStartE2EDuration="1.875419151s" podCreationTimestamp="2026-05-20 20:27:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:27:18.874323934 +0000 UTC m=+452.905489778" watchObservedRunningTime="2026-05-20 20:27:18.875419151 +0000 UTC m=+452.906584981"
May 20 20:27:19.865592 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:19.865549    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jns6c" event={"ID":"8d0c7939-640b-485e-8cf9-86de758b08c5","Type":"ContainerStarted","Data":"c6e7e22eb5ee0db132697b231c07a0ec4776efafd11c0718f21db4c768b42bdd"}
May 20 20:27:19.882755 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:19.882707    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-jns6c" podStartSLOduration=1.144122185 podStartE2EDuration="2.88269333s" podCreationTimestamp="2026-05-20 20:27:17 +0000 UTC" firstStartedPulling="2026-05-20 20:27:17.561729509 +0000 UTC m=+451.592895315" lastFinishedPulling="2026-05-20 20:27:19.300300644 +0000 UTC m=+453.331466460" observedRunningTime="2026-05-20 20:27:19.880972258 +0000 UTC m=+453.912138086" watchObservedRunningTime="2026-05-20 20:27:19.88269333 +0000 UTC m=+453.913859156"
May 20 20:27:22.579681 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:22.579647    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb"]
May 20 20:27:22.581740 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:22.581724    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb"
May 20 20:27:22.583966 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:22.583943    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 20:27:22.584110 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:22.583983    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 20:27:22.584865 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:22.584845    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cf5mm\""
May 20 20:27:22.590335 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:22.590316    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb"]
May 20 20:27:22.682360 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:22.682321    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19384a8a-2a27-4ff5-8caf-e2f6addcca18-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb\" (UID: \"19384a8a-2a27-4ff5-8caf-e2f6addcca18\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb"
May 20 20:27:22.682511 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:22.682378    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19384a8a-2a27-4ff5-8caf-e2f6addcca18-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb\" (UID: \"19384a8a-2a27-4ff5-8caf-e2f6addcca18\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb"
May 20 20:27:22.682511 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:22.682469    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmbjj\" (UniqueName: \"kubernetes.io/projected/19384a8a-2a27-4ff5-8caf-e2f6addcca18-kube-api-access-zmbjj\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb\" (UID: \"19384a8a-2a27-4ff5-8caf-e2f6addcca18\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb"
May 20 20:27:22.783712 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:22.783680    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19384a8a-2a27-4ff5-8caf-e2f6addcca18-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb\" (UID: \"19384a8a-2a27-4ff5-8caf-e2f6addcca18\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb"
May 20 20:27:22.783860 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:22.783727    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19384a8a-2a27-4ff5-8caf-e2f6addcca18-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb\" (UID: \"19384a8a-2a27-4ff5-8caf-e2f6addcca18\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb"
May 20 20:27:22.783860 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:22.783843    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmbjj\" (UniqueName: \"kubernetes.io/projected/19384a8a-2a27-4ff5-8caf-e2f6addcca18-kube-api-access-zmbjj\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb\" (UID: \"19384a8a-2a27-4ff5-8caf-e2f6addcca18\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb"
May 20 20:27:22.784126 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:22.784108    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19384a8a-2a27-4ff5-8caf-e2f6addcca18-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb\" (UID: \"19384a8a-2a27-4ff5-8caf-e2f6addcca18\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb"
May 20 20:27:22.784164 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:22.784119    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19384a8a-2a27-4ff5-8caf-e2f6addcca18-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb\" (UID: \"19384a8a-2a27-4ff5-8caf-e2f6addcca18\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb"
May 20 20:27:22.793185 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:22.793162    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmbjj\" (UniqueName: \"kubernetes.io/projected/19384a8a-2a27-4ff5-8caf-e2f6addcca18-kube-api-access-zmbjj\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb\" (UID: \"19384a8a-2a27-4ff5-8caf-e2f6addcca18\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb"
May 20 20:27:22.891878 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:22.891850    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb"
May 20 20:27:23.018551 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:23.018523    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb"]
May 20 20:27:23.020641 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:27:23.020613    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19384a8a_2a27_4ff5_8caf_e2f6addcca18.slice/crio-1bf4cd6137d2f17b8c1f6c91e3f782046af30b2bc3db4534d52714ea3a5b43a9 WatchSource:0}: Error finding container 1bf4cd6137d2f17b8c1f6c91e3f782046af30b2bc3db4534d52714ea3a5b43a9: Status 404 returned error can't find the container with id 1bf4cd6137d2f17b8c1f6c91e3f782046af30b2bc3db4534d52714ea3a5b43a9
May 20 20:27:23.879419 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:23.879384    2566 generic.go:358] "Generic (PLEG): container finished" podID="19384a8a-2a27-4ff5-8caf-e2f6addcca18" containerID="ce624c6e847112a4965b9480c9da8536a126df646e5e7f250057273a22998ac2" exitCode=0
May 20 20:27:23.879771 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:23.879445    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb" event={"ID":"19384a8a-2a27-4ff5-8caf-e2f6addcca18","Type":"ContainerDied","Data":"ce624c6e847112a4965b9480c9da8536a126df646e5e7f250057273a22998ac2"}
May 20 20:27:23.879771 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:23.879484    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb" event={"ID":"19384a8a-2a27-4ff5-8caf-e2f6addcca18","Type":"ContainerStarted","Data":"1bf4cd6137d2f17b8c1f6c91e3f782046af30b2bc3db4534d52714ea3a5b43a9"}
May 20 20:27:24.884218 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:24.884186    2566 generic.go:358] "Generic (PLEG): container finished" podID="19384a8a-2a27-4ff5-8caf-e2f6addcca18" containerID="892d585e444175aa40673ce53a23dda90e8229f202f79fb09aed8e5948c43197" exitCode=0
May 20 20:27:24.884592 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:24.884224    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb" event={"ID":"19384a8a-2a27-4ff5-8caf-e2f6addcca18","Type":"ContainerDied","Data":"892d585e444175aa40673ce53a23dda90e8229f202f79fb09aed8e5948c43197"}
May 20 20:27:25.889289 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:25.889256    2566 generic.go:358] "Generic (PLEG): container finished" podID="19384a8a-2a27-4ff5-8caf-e2f6addcca18" containerID="8a88499b1d6ed2db990a029a18ba5da74b983e0ad0b105efb81236ebca0842ff" exitCode=0
May 20 20:27:25.889683 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:25.889300    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb" event={"ID":"19384a8a-2a27-4ff5-8caf-e2f6addcca18","Type":"ContainerDied","Data":"8a88499b1d6ed2db990a029a18ba5da74b983e0ad0b105efb81236ebca0842ff"}
May 20 20:27:27.017461 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:27.017440    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb"
May 20 20:27:27.120917 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:27.120854    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19384a8a-2a27-4ff5-8caf-e2f6addcca18-util\") pod \"19384a8a-2a27-4ff5-8caf-e2f6addcca18\" (UID: \"19384a8a-2a27-4ff5-8caf-e2f6addcca18\") "
May 20 20:27:27.120917 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:27.120923    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmbjj\" (UniqueName: \"kubernetes.io/projected/19384a8a-2a27-4ff5-8caf-e2f6addcca18-kube-api-access-zmbjj\") pod \"19384a8a-2a27-4ff5-8caf-e2f6addcca18\" (UID: \"19384a8a-2a27-4ff5-8caf-e2f6addcca18\") "
May 20 20:27:27.121171 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:27.120995    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19384a8a-2a27-4ff5-8caf-e2f6addcca18-bundle\") pod \"19384a8a-2a27-4ff5-8caf-e2f6addcca18\" (UID: \"19384a8a-2a27-4ff5-8caf-e2f6addcca18\") "
May 20 20:27:27.121610 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:27.121587    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19384a8a-2a27-4ff5-8caf-e2f6addcca18-bundle" (OuterVolumeSpecName: "bundle") pod "19384a8a-2a27-4ff5-8caf-e2f6addcca18" (UID: "19384a8a-2a27-4ff5-8caf-e2f6addcca18"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:27:27.122997 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:27.122973    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19384a8a-2a27-4ff5-8caf-e2f6addcca18-kube-api-access-zmbjj" (OuterVolumeSpecName: "kube-api-access-zmbjj") pod "19384a8a-2a27-4ff5-8caf-e2f6addcca18" (UID: "19384a8a-2a27-4ff5-8caf-e2f6addcca18"). InnerVolumeSpecName "kube-api-access-zmbjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:27:27.126369 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:27.126346    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19384a8a-2a27-4ff5-8caf-e2f6addcca18-util" (OuterVolumeSpecName: "util") pod "19384a8a-2a27-4ff5-8caf-e2f6addcca18" (UID: "19384a8a-2a27-4ff5-8caf-e2f6addcca18"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:27:27.221977 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:27.221861    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19384a8a-2a27-4ff5-8caf-e2f6addcca18-bundle\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:27:27.221977 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:27.221921    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19384a8a-2a27-4ff5-8caf-e2f6addcca18-util\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:27:27.221977 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:27.221931    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmbjj\" (UniqueName: \"kubernetes.io/projected/19384a8a-2a27-4ff5-8caf-e2f6addcca18-kube-api-access-zmbjj\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:27:27.897192 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:27.897157    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb" event={"ID":"19384a8a-2a27-4ff5-8caf-e2f6addcca18","Type":"ContainerDied","Data":"1bf4cd6137d2f17b8c1f6c91e3f782046af30b2bc3db4534d52714ea3a5b43a9"}
May 20 20:27:27.897192 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:27.897194    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bf4cd6137d2f17b8c1f6c91e3f782046af30b2bc3db4534d52714ea3a5b43a9"
May 20 20:27:27.897402 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:27.897167    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zs2qb"
May 20 20:27:39.467084 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.467048    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76c978b984-htgkn"]
May 20 20:27:39.467578 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.467346    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19384a8a-2a27-4ff5-8caf-e2f6addcca18" containerName="pull"
May 20 20:27:39.467578 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.467357    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="19384a8a-2a27-4ff5-8caf-e2f6addcca18" containerName="pull"
May 20 20:27:39.467578 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.467368    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19384a8a-2a27-4ff5-8caf-e2f6addcca18" containerName="util"
May 20 20:27:39.467578 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.467373    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="19384a8a-2a27-4ff5-8caf-e2f6addcca18" containerName="util"
May 20 20:27:39.467578 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.467383    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19384a8a-2a27-4ff5-8caf-e2f6addcca18" containerName="extract"
May 20 20:27:39.467578 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.467389    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="19384a8a-2a27-4ff5-8caf-e2f6addcca18" containerName="extract"
May 20 20:27:39.467578 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.467435    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="19384a8a-2a27-4ff5-8caf-e2f6addcca18" containerName="extract"
May 20 20:27:39.473173 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.473150    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-htgkn"
May 20 20:27:39.475270 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.475248    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 20 20:27:39.475663 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.475646    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 20 20:27:39.475740 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.475709    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 20 20:27:39.475847 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.475833    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 20 20:27:39.476204 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.476191    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7njkd\""
May 20 20:27:39.489262 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.489240    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76c978b984-htgkn"]
May 20 20:27:39.524708 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.524684    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4t9p\" (UniqueName: \"kubernetes.io/projected/7db08fad-6de1-4d67-af26-cccd922354e8-kube-api-access-j4t9p\") pod \"opendatahub-operator-controller-manager-76c978b984-htgkn\" (UID: \"7db08fad-6de1-4d67-af26-cccd922354e8\") " pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-htgkn"
May 20 20:27:39.524813 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.524719    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7db08fad-6de1-4d67-af26-cccd922354e8-webhook-cert\") pod \"opendatahub-operator-controller-manager-76c978b984-htgkn\" (UID: \"7db08fad-6de1-4d67-af26-cccd922354e8\") " pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-htgkn"
May 20 20:27:39.524813 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.524776    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7db08fad-6de1-4d67-af26-cccd922354e8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76c978b984-htgkn\" (UID: \"7db08fad-6de1-4d67-af26-cccd922354e8\") " pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-htgkn"
May 20 20:27:39.625930 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.625881    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7db08fad-6de1-4d67-af26-cccd922354e8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76c978b984-htgkn\" (UID: \"7db08fad-6de1-4d67-af26-cccd922354e8\") " pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-htgkn"
May 20 20:27:39.626094 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.626050    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j4t9p\" (UniqueName: \"kubernetes.io/projected/7db08fad-6de1-4d67-af26-cccd922354e8-kube-api-access-j4t9p\") pod \"opendatahub-operator-controller-manager-76c978b984-htgkn\" (UID: \"7db08fad-6de1-4d67-af26-cccd922354e8\") " pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-htgkn"
May 20 20:27:39.626156 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.626109    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7db08fad-6de1-4d67-af26-cccd922354e8-webhook-cert\") pod \"opendatahub-operator-controller-manager-76c978b984-htgkn\" (UID: \"7db08fad-6de1-4d67-af26-cccd922354e8\") " pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-htgkn"
May 20 20:27:39.628552 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.628528    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7db08fad-6de1-4d67-af26-cccd922354e8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76c978b984-htgkn\" (UID: \"7db08fad-6de1-4d67-af26-cccd922354e8\") " pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-htgkn"
May 20 20:27:39.628655 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.628528    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7db08fad-6de1-4d67-af26-cccd922354e8-webhook-cert\") pod \"opendatahub-operator-controller-manager-76c978b984-htgkn\" (UID: \"7db08fad-6de1-4d67-af26-cccd922354e8\") " pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-htgkn"
May 20 20:27:39.636840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.636819    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4t9p\" (UniqueName: \"kubernetes.io/projected/7db08fad-6de1-4d67-af26-cccd922354e8-kube-api-access-j4t9p\") pod \"opendatahub-operator-controller-manager-76c978b984-htgkn\" (UID: \"7db08fad-6de1-4d67-af26-cccd922354e8\") " pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-htgkn"
May 20 20:27:39.783345 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.783261    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-htgkn"
May 20 20:27:39.802465 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.802438    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq"]
May 20 20:27:39.809917 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.809877    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq"
May 20 20:27:39.812555 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.812532    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cf5mm\""
May 20 20:27:39.812840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.812823    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 20:27:39.812989 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.812825    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 20:27:39.818612 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.818588    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq"]
May 20 20:27:39.928690 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.928661    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7qpl\" (UniqueName: \"kubernetes.io/projected/3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96-kube-api-access-l7qpl\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq\" (UID: \"3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq"
May 20 20:27:39.928782 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.928764    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq\" (UID: \"3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq"
May 20 20:27:39.928822 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.928801    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq\" (UID: \"3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq"
May 20 20:27:39.929005 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.928988    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76c978b984-htgkn"]
May 20 20:27:39.930713 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:27:39.930694    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7db08fad_6de1_4d67_af26_cccd922354e8.slice/crio-887a31ef500b0ba858cba249fbfa3510de60bbb98cad11e46658af8137a3bdbe WatchSource:0}: Error finding container 887a31ef500b0ba858cba249fbfa3510de60bbb98cad11e46658af8137a3bdbe: Status 404 returned error can't find the container with id 887a31ef500b0ba858cba249fbfa3510de60bbb98cad11e46658af8137a3bdbe
May 20 20:27:39.935496 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:39.935473    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-htgkn" event={"ID":"7db08fad-6de1-4d67-af26-cccd922354e8","Type":"ContainerStarted","Data":"887a31ef500b0ba858cba249fbfa3510de60bbb98cad11e46658af8137a3bdbe"}
May 20 20:27:40.030102 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:40.030068    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq\" (UID: \"3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq"
May 20 20:27:40.030102 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:40.030103    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq\" (UID: \"3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq"
May 20 20:27:40.030323 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:40.030158    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7qpl\" (UniqueName: \"kubernetes.io/projected/3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96-kube-api-access-l7qpl\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq\" (UID: \"3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq"
May 20 20:27:40.030545 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:40.030520    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq\" (UID: \"3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq"
May 20 20:27:40.030582 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:40.030549    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq\" (UID: \"3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq"
May 20 20:27:40.039135 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:40.039074    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7qpl\" (UniqueName: \"kubernetes.io/projected/3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96-kube-api-access-l7qpl\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq\" (UID: \"3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq"
May 20 20:27:40.120581 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:40.120543    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq"
May 20 20:27:40.249300 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:40.249272    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq"]
May 20 20:27:40.250814 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:27:40.250789    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9d0deb_dd3b_4cdf_a6cb_52a47b414e96.slice/crio-b47de0e8fc040da2c28f00ee0fecf573035ad1517dd0c0079a9693f6f6f78cff WatchSource:0}: Error finding container b47de0e8fc040da2c28f00ee0fecf573035ad1517dd0c0079a9693f6f6f78cff: Status 404 returned error can't find the container with id b47de0e8fc040da2c28f00ee0fecf573035ad1517dd0c0079a9693f6f6f78cff
May 20 20:27:40.944933 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:40.944875    2566 generic.go:358] "Generic (PLEG): container finished" podID="3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96" containerID="0ab0eac24cbff24db229e31aca42254a6807cedf91f7c3a07be6dd02881b54c7" exitCode=0
May 20 20:27:40.945393 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:40.944985    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq" event={"ID":"3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96","Type":"ContainerDied","Data":"0ab0eac24cbff24db229e31aca42254a6807cedf91f7c3a07be6dd02881b54c7"}
May 20 20:27:40.945393 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:40.945014    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq" event={"ID":"3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96","Type":"ContainerStarted","Data":"b47de0e8fc040da2c28f00ee0fecf573035ad1517dd0c0079a9693f6f6f78cff"}
May 20 20:27:42.955102 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:42.955060    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-htgkn" event={"ID":"7db08fad-6de1-4d67-af26-cccd922354e8","Type":"ContainerStarted","Data":"d4f5031a61e3a82b61f9311dfa2f91a09c88888a8663b1c6002619b1523e683b"}
May 20 20:27:42.955551 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:42.955237    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-htgkn"
May 20 20:27:42.956676 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:42.956651    2566 generic.go:358] "Generic (PLEG): container finished" podID="3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96" containerID="60bb923ccfdfcc2ab85cf1fd34c09dd76cae9107e061dee2353b4bf8b8a1ffb4" exitCode=0
May 20 20:27:42.956790 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:42.956719    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq" event={"ID":"3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96","Type":"ContainerDied","Data":"60bb923ccfdfcc2ab85cf1fd34c09dd76cae9107e061dee2353b4bf8b8a1ffb4"}
May 20 20:27:42.984167 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:42.984122    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-htgkn" podStartSLOduration=1.463101994 podStartE2EDuration="3.984109133s" podCreationTimestamp="2026-05-20 20:27:39 +0000 UTC" firstStartedPulling="2026-05-20 20:27:39.932339326 +0000 UTC m=+473.963505130" lastFinishedPulling="2026-05-20 20:27:42.453346461 +0000 UTC m=+476.484512269" observedRunningTime="2026-05-20 20:27:42.981433096 +0000 UTC m=+477.012598923" watchObservedRunningTime="2026-05-20 20:27:42.984109133 +0000 UTC m=+477.015275036"
May 20 20:27:43.962343 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:43.962309    2566 generic.go:358] "Generic (PLEG): container finished" podID="3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96" containerID="637eb9771618562c869b351b42501bb7734fbf0b4a0e3a7b4f95cab5a2be28d1" exitCode=0
May 20 20:27:43.962733 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:43.962395    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq" event={"ID":"3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96","Type":"ContainerDied","Data":"637eb9771618562c869b351b42501bb7734fbf0b4a0e3a7b4f95cab5a2be28d1"}
May 20 20:27:45.087324 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:45.087299    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq"
May 20 20:27:45.174635 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:45.174604    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7qpl\" (UniqueName: \"kubernetes.io/projected/3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96-kube-api-access-l7qpl\") pod \"3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96\" (UID: \"3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96\") "
May 20 20:27:45.174789 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:45.174660    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96-util\") pod \"3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96\" (UID: \"3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96\") "
May 20 20:27:45.174789 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:45.174708    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96-bundle\") pod \"3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96\" (UID: \"3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96\") "
May 20 20:27:45.175609 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:45.175581    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96-bundle" (OuterVolumeSpecName: "bundle") pod "3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96" (UID: "3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:27:45.176754 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:45.176731    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96-kube-api-access-l7qpl" (OuterVolumeSpecName: "kube-api-access-l7qpl") pod "3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96" (UID: "3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96"). InnerVolumeSpecName "kube-api-access-l7qpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:27:45.179674 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:45.179643    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96-util" (OuterVolumeSpecName: "util") pod "3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96" (UID: "3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:27:45.275786 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:45.275714    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7qpl\" (UniqueName: \"kubernetes.io/projected/3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96-kube-api-access-l7qpl\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:27:45.275786 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:45.275741    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96-util\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:27:45.275786 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:45.275752    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96-bundle\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:27:45.970315 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:45.970284    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq"
May 20 20:27:45.970492 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:45.970277    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9gjplq" event={"ID":"3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96","Type":"ContainerDied","Data":"b47de0e8fc040da2c28f00ee0fecf573035ad1517dd0c0079a9693f6f6f78cff"}
May 20 20:27:45.970492 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:45.970396    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b47de0e8fc040da2c28f00ee0fecf573035ad1517dd0c0079a9693f6f6f78cff"
May 20 20:27:53.965275 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:53.965240    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-htgkn"
May 20 20:27:58.076377 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.076339    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb"]
May 20 20:27:58.076820 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.076635    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96" containerName="util"
May 20 20:27:58.076820 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.076645    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96" containerName="util"
May 20 20:27:58.076820 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.076657    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96" containerName="extract"
May 20 20:27:58.076820 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.076662    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96" containerName="extract"
May 20 20:27:58.076820 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.076672    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96" containerName="pull"
May 20 20:27:58.076820 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.076678    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96" containerName="pull"
May 20 20:27:58.076820 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.076722    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c9d0deb-dd3b-4cdf-a6cb-52a47b414e96" containerName="extract"
May 20 20:27:58.080944 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.080925    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb"
May 20 20:27:58.086433 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.086407    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cf5mm\""
May 20 20:27:58.086611 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.086587    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 20:27:58.087168 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.087147    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 20:27:58.101532 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.101505    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb"]
May 20 20:27:58.181472 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.181429    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be001941-5835-4017-9892-dbdd0144efaf-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb\" (UID: \"be001941-5835-4017-9892-dbdd0144efaf\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb"
May 20 20:27:58.181659 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.181485    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be001941-5835-4017-9892-dbdd0144efaf-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb\" (UID: \"be001941-5835-4017-9892-dbdd0144efaf\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb"
May 20 20:27:58.181659 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.181600    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czpqs\" (UniqueName: \"kubernetes.io/projected/be001941-5835-4017-9892-dbdd0144efaf-kube-api-access-czpqs\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb\" (UID: \"be001941-5835-4017-9892-dbdd0144efaf\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb"
May 20 20:27:58.282840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.282803    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czpqs\" (UniqueName: \"kubernetes.io/projected/be001941-5835-4017-9892-dbdd0144efaf-kube-api-access-czpqs\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb\" (UID: \"be001941-5835-4017-9892-dbdd0144efaf\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb"
May 20 20:27:58.283037 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.282869    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be001941-5835-4017-9892-dbdd0144efaf-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb\" (UID: \"be001941-5835-4017-9892-dbdd0144efaf\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb"
May 20 20:27:58.283037 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.282930    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be001941-5835-4017-9892-dbdd0144efaf-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb\" (UID: \"be001941-5835-4017-9892-dbdd0144efaf\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb"
May 20 20:27:58.283328 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.283307    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be001941-5835-4017-9892-dbdd0144efaf-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb\" (UID: \"be001941-5835-4017-9892-dbdd0144efaf\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb"
May 20 20:27:58.283366 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.283316    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be001941-5835-4017-9892-dbdd0144efaf-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb\" (UID: \"be001941-5835-4017-9892-dbdd0144efaf\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb"
May 20 20:27:58.301684 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.301649    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czpqs\" (UniqueName: \"kubernetes.io/projected/be001941-5835-4017-9892-dbdd0144efaf-kube-api-access-czpqs\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb\" (UID: \"be001941-5835-4017-9892-dbdd0144efaf\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb"
May 20 20:27:58.390236 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.390201    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb"
May 20 20:27:58.534589 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:58.534561    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb"]
May 20 20:27:58.536544 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:27:58.536510    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe001941_5835_4017_9892_dbdd0144efaf.slice/crio-747a40454c0d6da5f1eec8c5c7cfa352e0dcb4bdc1998bcfd343d1fbbf431f72 WatchSource:0}: Error finding container 747a40454c0d6da5f1eec8c5c7cfa352e0dcb4bdc1998bcfd343d1fbbf431f72: Status 404 returned error can't find the container with id 747a40454c0d6da5f1eec8c5c7cfa352e0dcb4bdc1998bcfd343d1fbbf431f72
May 20 20:27:59.015055 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:59.014967    2566 generic.go:358] "Generic (PLEG): container finished" podID="be001941-5835-4017-9892-dbdd0144efaf" containerID="cc79226f0b5c3c87e850cf01216bb2109f2284ec5f7f8875e81040645235759d" exitCode=0
May 20 20:27:59.015055 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:59.015017    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb" event={"ID":"be001941-5835-4017-9892-dbdd0144efaf","Type":"ContainerDied","Data":"cc79226f0b5c3c87e850cf01216bb2109f2284ec5f7f8875e81040645235759d"}
May 20 20:27:59.015055 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:59.015039    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb" event={"ID":"be001941-5835-4017-9892-dbdd0144efaf","Type":"ContainerStarted","Data":"747a40454c0d6da5f1eec8c5c7cfa352e0dcb4bdc1998bcfd343d1fbbf431f72"}
May 20 20:27:59.285369 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:59.285293    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85ffd6857f-lsvwj"]
May 20 20:27:59.288697 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:59.288677    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85ffd6857f-lsvwj"
May 20 20:27:59.291191 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:59.291166    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 20 20:27:59.291301 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:59.291167    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bvnz7\""
May 20 20:27:59.291301 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:59.291212    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 20 20:27:59.297928 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:59.297886    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85ffd6857f-lsvwj"]
May 20 20:27:59.394224 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:59.394196    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f069973d-5577-48f5-9442-3df65ff55f95-tls-certs\") pod \"kube-auth-proxy-85ffd6857f-lsvwj\" (UID: \"f069973d-5577-48f5-9442-3df65ff55f95\") " pod="openshift-ingress/kube-auth-proxy-85ffd6857f-lsvwj"
May 20 20:27:59.394401 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:59.394229    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k48mn\" (UniqueName: \"kubernetes.io/projected/f069973d-5577-48f5-9442-3df65ff55f95-kube-api-access-k48mn\") pod \"kube-auth-proxy-85ffd6857f-lsvwj\" (UID: \"f069973d-5577-48f5-9442-3df65ff55f95\") " pod="openshift-ingress/kube-auth-proxy-85ffd6857f-lsvwj"
May 20 20:27:59.394401 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:59.394248    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f069973d-5577-48f5-9442-3df65ff55f95-tmp\") pod \"kube-auth-proxy-85ffd6857f-lsvwj\" (UID: \"f069973d-5577-48f5-9442-3df65ff55f95\") " pod="openshift-ingress/kube-auth-proxy-85ffd6857f-lsvwj"
May 20 20:27:59.494866 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:59.494834    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f069973d-5577-48f5-9442-3df65ff55f95-tls-certs\") pod \"kube-auth-proxy-85ffd6857f-lsvwj\" (UID: \"f069973d-5577-48f5-9442-3df65ff55f95\") " pod="openshift-ingress/kube-auth-proxy-85ffd6857f-lsvwj"
May 20 20:27:59.495080 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:59.494874    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k48mn\" (UniqueName: \"kubernetes.io/projected/f069973d-5577-48f5-9442-3df65ff55f95-kube-api-access-k48mn\") pod \"kube-auth-proxy-85ffd6857f-lsvwj\" (UID: \"f069973d-5577-48f5-9442-3df65ff55f95\") " pod="openshift-ingress/kube-auth-proxy-85ffd6857f-lsvwj"
May 20 20:27:59.495080 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:59.494915    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f069973d-5577-48f5-9442-3df65ff55f95-tmp\") pod \"kube-auth-proxy-85ffd6857f-lsvwj\" (UID: \"f069973d-5577-48f5-9442-3df65ff55f95\") " pod="openshift-ingress/kube-auth-proxy-85ffd6857f-lsvwj"
May 20 20:27:59.497247 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:59.497226    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f069973d-5577-48f5-9442-3df65ff55f95-tmp\") pod \"kube-auth-proxy-85ffd6857f-lsvwj\" (UID: \"f069973d-5577-48f5-9442-3df65ff55f95\") " pod="openshift-ingress/kube-auth-proxy-85ffd6857f-lsvwj"
May 20 20:27:59.497452 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:59.497434    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f069973d-5577-48f5-9442-3df65ff55f95-tls-certs\") pod \"kube-auth-proxy-85ffd6857f-lsvwj\" (UID: \"f069973d-5577-48f5-9442-3df65ff55f95\") " pod="openshift-ingress/kube-auth-proxy-85ffd6857f-lsvwj"
May 20 20:27:59.503458 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:59.503425    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k48mn\" (UniqueName: \"kubernetes.io/projected/f069973d-5577-48f5-9442-3df65ff55f95-kube-api-access-k48mn\") pod \"kube-auth-proxy-85ffd6857f-lsvwj\" (UID: \"f069973d-5577-48f5-9442-3df65ff55f95\") " pod="openshift-ingress/kube-auth-proxy-85ffd6857f-lsvwj"
May 20 20:27:59.599867 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:59.599841    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85ffd6857f-lsvwj"
May 20 20:27:59.731471 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:27:59.731446    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85ffd6857f-lsvwj"]
May 20 20:27:59.733698 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:27:59.733666    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf069973d_5577_48f5_9442_3df65ff55f95.slice/crio-fded92a7ff4a82dc31886bc1edefc07ab4dcd3b36571700e1d6a0763340d5f47 WatchSource:0}: Error finding container fded92a7ff4a82dc31886bc1edefc07ab4dcd3b36571700e1d6a0763340d5f47: Status 404 returned error can't find the container with id fded92a7ff4a82dc31886bc1edefc07ab4dcd3b36571700e1d6a0763340d5f47
May 20 20:28:00.019242 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:00.019212    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85ffd6857f-lsvwj" event={"ID":"f069973d-5577-48f5-9442-3df65ff55f95","Type":"ContainerStarted","Data":"fded92a7ff4a82dc31886bc1edefc07ab4dcd3b36571700e1d6a0763340d5f47"}
May 20 20:28:01.024844 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:01.024807    2566 generic.go:358] "Generic (PLEG): container finished" podID="be001941-5835-4017-9892-dbdd0144efaf" containerID="e9bdc615866a872c88c71cb9661b35e6daae9d1abfe2696c04cf3d70a087fe5c" exitCode=0
May 20 20:28:01.025334 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:01.024850    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb" event={"ID":"be001941-5835-4017-9892-dbdd0144efaf","Type":"ContainerDied","Data":"e9bdc615866a872c88c71cb9661b35e6daae9d1abfe2696c04cf3d70a087fe5c"}
May 20 20:28:02.029345 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:02.029256    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-ms5vg"]
May 20 20:28:02.031916 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:02.031873    2566 generic.go:358] "Generic (PLEG): container finished" podID="be001941-5835-4017-9892-dbdd0144efaf" containerID="802bee76242b7447f986d8deed886ede2ee7260384d5e97fa570fa9d0b56e064" exitCode=0
May 20 20:28:02.032525 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:02.032507    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb" event={"ID":"be001941-5835-4017-9892-dbdd0144efaf","Type":"ContainerDied","Data":"802bee76242b7447f986d8deed886ede2ee7260384d5e97fa570fa9d0b56e064"}
May 20 20:28:02.032623 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:02.032610    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg"
May 20 20:28:02.035094 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:02.035075    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-6mk2g\""
May 20 20:28:02.035180 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:02.035074    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 20 20:28:02.040383 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:02.040364    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-ms5vg"]
May 20 20:28:02.226771 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:02.226728    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxd6r\" (UniqueName: \"kubernetes.io/projected/8a76dafc-3562-42a2-b958-e97b002c3c38-kube-api-access-zxd6r\") pod \"odh-model-controller-858dbf95b8-ms5vg\" (UID: \"8a76dafc-3562-42a2-b958-e97b002c3c38\") " pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg"
May 20 20:28:02.227347 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:02.227318    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a76dafc-3562-42a2-b958-e97b002c3c38-cert\") pod \"odh-model-controller-858dbf95b8-ms5vg\" (UID: \"8a76dafc-3562-42a2-b958-e97b002c3c38\") " pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg"
May 20 20:28:02.328964 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:02.328753    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zxd6r\" (UniqueName: \"kubernetes.io/projected/8a76dafc-3562-42a2-b958-e97b002c3c38-kube-api-access-zxd6r\") pod \"odh-model-controller-858dbf95b8-ms5vg\" (UID: \"8a76dafc-3562-42a2-b958-e97b002c3c38\") " pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg"
May 20 20:28:02.328964 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:02.328824    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a76dafc-3562-42a2-b958-e97b002c3c38-cert\") pod \"odh-model-controller-858dbf95b8-ms5vg\" (UID: \"8a76dafc-3562-42a2-b958-e97b002c3c38\") " pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg"
May 20 20:28:02.329193 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:28:02.329037    2566 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 20 20:28:02.329193 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:28:02.329111    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a76dafc-3562-42a2-b958-e97b002c3c38-cert podName:8a76dafc-3562-42a2-b958-e97b002c3c38 nodeName:}" failed. No retries permitted until 2026-05-20 20:28:02.82908833 +0000 UTC m=+496.860254141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a76dafc-3562-42a2-b958-e97b002c3c38-cert") pod "odh-model-controller-858dbf95b8-ms5vg" (UID: "8a76dafc-3562-42a2-b958-e97b002c3c38") : secret "odh-model-controller-webhook-cert" not found
May 20 20:28:02.339720 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:02.339694    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxd6r\" (UniqueName: \"kubernetes.io/projected/8a76dafc-3562-42a2-b958-e97b002c3c38-kube-api-access-zxd6r\") pod \"odh-model-controller-858dbf95b8-ms5vg\" (UID: \"8a76dafc-3562-42a2-b958-e97b002c3c38\") " pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg"
May 20 20:28:02.832173 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:02.832132    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a76dafc-3562-42a2-b958-e97b002c3c38-cert\") pod \"odh-model-controller-858dbf95b8-ms5vg\" (UID: \"8a76dafc-3562-42a2-b958-e97b002c3c38\") " pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg"
May 20 20:28:02.834945 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:02.834887    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a76dafc-3562-42a2-b958-e97b002c3c38-cert\") pod \"odh-model-controller-858dbf95b8-ms5vg\" (UID: \"8a76dafc-3562-42a2-b958-e97b002c3c38\") " pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg"
May 20 20:28:02.943312 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:02.943274    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg"
May 20 20:28:03.343015 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:03.342991    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb"
May 20 20:28:03.437655 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:03.437624    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czpqs\" (UniqueName: \"kubernetes.io/projected/be001941-5835-4017-9892-dbdd0144efaf-kube-api-access-czpqs\") pod \"be001941-5835-4017-9892-dbdd0144efaf\" (UID: \"be001941-5835-4017-9892-dbdd0144efaf\") "
May 20 20:28:03.437775 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:03.437683    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be001941-5835-4017-9892-dbdd0144efaf-util\") pod \"be001941-5835-4017-9892-dbdd0144efaf\" (UID: \"be001941-5835-4017-9892-dbdd0144efaf\") "
May 20 20:28:03.437775 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:03.437735    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be001941-5835-4017-9892-dbdd0144efaf-bundle\") pod \"be001941-5835-4017-9892-dbdd0144efaf\" (UID: \"be001941-5835-4017-9892-dbdd0144efaf\") "
May 20 20:28:03.439065 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:03.439018    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be001941-5835-4017-9892-dbdd0144efaf-bundle" (OuterVolumeSpecName: "bundle") pod "be001941-5835-4017-9892-dbdd0144efaf" (UID: "be001941-5835-4017-9892-dbdd0144efaf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:28:03.439989 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:03.439962    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be001941-5835-4017-9892-dbdd0144efaf-kube-api-access-czpqs" (OuterVolumeSpecName: "kube-api-access-czpqs") pod "be001941-5835-4017-9892-dbdd0144efaf" (UID: "be001941-5835-4017-9892-dbdd0144efaf"). InnerVolumeSpecName "kube-api-access-czpqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:28:03.443655 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:03.443625    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be001941-5835-4017-9892-dbdd0144efaf-util" (OuterVolumeSpecName: "util") pod "be001941-5835-4017-9892-dbdd0144efaf" (UID: "be001941-5835-4017-9892-dbdd0144efaf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:28:03.472584 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:03.472541    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-ms5vg"]
May 20 20:28:03.474601 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:28:03.474574    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a76dafc_3562_42a2_b958_e97b002c3c38.slice/crio-8ff848cf7ab426f895ecb5d353aa81e28212d09be0f8bf6745495d9d7783c005 WatchSource:0}: Error finding container 8ff848cf7ab426f895ecb5d353aa81e28212d09be0f8bf6745495d9d7783c005: Status 404 returned error can't find the container with id 8ff848cf7ab426f895ecb5d353aa81e28212d09be0f8bf6745495d9d7783c005
May 20 20:28:03.539127 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:03.539090    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be001941-5835-4017-9892-dbdd0144efaf-bundle\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:28:03.539127 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:03.539119    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czpqs\" (UniqueName: \"kubernetes.io/projected/be001941-5835-4017-9892-dbdd0144efaf-kube-api-access-czpqs\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:28:03.539127 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:03.539129    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be001941-5835-4017-9892-dbdd0144efaf-util\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:28:04.040483 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:04.040453    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb"
May 20 20:28:04.040753 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:04.040457    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pqqkb" event={"ID":"be001941-5835-4017-9892-dbdd0144efaf","Type":"ContainerDied","Data":"747a40454c0d6da5f1eec8c5c7cfa352e0dcb4bdc1998bcfd343d1fbbf431f72"}
May 20 20:28:04.040753 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:04.040573    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="747a40454c0d6da5f1eec8c5c7cfa352e0dcb4bdc1998bcfd343d1fbbf431f72"
May 20 20:28:04.041619 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:04.041594    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg" event={"ID":"8a76dafc-3562-42a2-b958-e97b002c3c38","Type":"ContainerStarted","Data":"8ff848cf7ab426f895ecb5d353aa81e28212d09be0f8bf6745495d9d7783c005"}
May 20 20:28:04.043005 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:04.042984    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85ffd6857f-lsvwj" event={"ID":"f069973d-5577-48f5-9442-3df65ff55f95","Type":"ContainerStarted","Data":"fb01b71fb8b2bcea4985becb4bb8698778c5af2660f5addedf9721e53793dc12"}
May 20 20:28:04.059998 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:04.059960    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85ffd6857f-lsvwj" podStartSLOduration=1.412990099 podStartE2EDuration="5.05994989s" podCreationTimestamp="2026-05-20 20:27:59 +0000 UTC" firstStartedPulling="2026-05-20 20:27:59.735355326 +0000 UTC m=+493.766521130" lastFinishedPulling="2026-05-20 20:28:03.382315113 +0000 UTC m=+497.413480921" observedRunningTime="2026-05-20 20:28:04.05820915 +0000 UTC m=+498.089374977" watchObservedRunningTime="2026-05-20 20:28:04.05994989 +0000 UTC m=+498.091115716"
May 20 20:28:07.055951 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:07.055907    2566 generic.go:358] "Generic (PLEG): container finished" podID="8a76dafc-3562-42a2-b958-e97b002c3c38" containerID="e12353e10733ae2a7212fa16a225f128e94fea46a67b53b567918eba38611f9b" exitCode=1
May 20 20:28:07.056322 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:07.055975    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg" event={"ID":"8a76dafc-3562-42a2-b958-e97b002c3c38","Type":"ContainerDied","Data":"e12353e10733ae2a7212fa16a225f128e94fea46a67b53b567918eba38611f9b"}
May 20 20:28:07.056322 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:07.056188    2566 scope.go:117] "RemoveContainer" containerID="e12353e10733ae2a7212fa16a225f128e94fea46a67b53b567918eba38611f9b"
May 20 20:28:08.061591 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.061556    2566 generic.go:358] "Generic (PLEG): container finished" podID="8a76dafc-3562-42a2-b958-e97b002c3c38" containerID="22bccde597c59e17739f6b52677d9e0d081d569fd31e53a8963cb20a327fb8d6" exitCode=1
May 20 20:28:08.061591 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.061594    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg" event={"ID":"8a76dafc-3562-42a2-b958-e97b002c3c38","Type":"ContainerDied","Data":"22bccde597c59e17739f6b52677d9e0d081d569fd31e53a8963cb20a327fb8d6"}
May 20 20:28:08.062140 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.061620    2566 scope.go:117] "RemoveContainer" containerID="e12353e10733ae2a7212fa16a225f128e94fea46a67b53b567918eba38611f9b"
May 20 20:28:08.062140 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.061915    2566 scope.go:117] "RemoveContainer" containerID="22bccde597c59e17739f6b52677d9e0d081d569fd31e53a8963cb20a327fb8d6"
May 20 20:28:08.062240 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:28:08.062173    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-ms5vg_opendatahub(8a76dafc-3562-42a2-b958-e97b002c3c38)\"" pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg" podUID="8a76dafc-3562-42a2-b958-e97b002c3c38"
May 20 20:28:08.753686 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.753653    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-4v2bl"]
May 20 20:28:08.754010 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.753994    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be001941-5835-4017-9892-dbdd0144efaf" containerName="pull"
May 20 20:28:08.754010 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.754008    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="be001941-5835-4017-9892-dbdd0144efaf" containerName="pull"
May 20 20:28:08.754171 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.754016    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be001941-5835-4017-9892-dbdd0144efaf" containerName="extract"
May 20 20:28:08.754171 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.754022    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="be001941-5835-4017-9892-dbdd0144efaf" containerName="extract"
May 20 20:28:08.754171 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.754050    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be001941-5835-4017-9892-dbdd0144efaf" containerName="util"
May 20 20:28:08.754171 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.754055    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="be001941-5835-4017-9892-dbdd0144efaf" containerName="util"
May 20 20:28:08.754171 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.754103    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="be001941-5835-4017-9892-dbdd0144efaf" containerName="extract"
May 20 20:28:08.758227 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.758202    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-4v2bl"
May 20 20:28:08.761463 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.761439    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-6l5wc\""
May 20 20:28:08.761585 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.761482    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 20 20:28:08.768055 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.768033    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-4v2bl"]
May 20 20:28:08.782602 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.782577    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40863c5f-dffa-4200-8e42-ae5904f31021-cert\") pod \"kserve-controller-manager-856948b99f-4v2bl\" (UID: \"40863c5f-dffa-4200-8e42-ae5904f31021\") " pod="opendatahub/kserve-controller-manager-856948b99f-4v2bl"
May 20 20:28:08.782735 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.782643    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szx2v\" (UniqueName: \"kubernetes.io/projected/40863c5f-dffa-4200-8e42-ae5904f31021-kube-api-access-szx2v\") pod \"kserve-controller-manager-856948b99f-4v2bl\" (UID: \"40863c5f-dffa-4200-8e42-ae5904f31021\") " pod="opendatahub/kserve-controller-manager-856948b99f-4v2bl"
May 20 20:28:08.883458 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.883420    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-szx2v\" (UniqueName: \"kubernetes.io/projected/40863c5f-dffa-4200-8e42-ae5904f31021-kube-api-access-szx2v\") pod \"kserve-controller-manager-856948b99f-4v2bl\" (UID: \"40863c5f-dffa-4200-8e42-ae5904f31021\") " pod="opendatahub/kserve-controller-manager-856948b99f-4v2bl"
May 20 20:28:08.883600 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.883489    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40863c5f-dffa-4200-8e42-ae5904f31021-cert\") pod \"kserve-controller-manager-856948b99f-4v2bl\" (UID: \"40863c5f-dffa-4200-8e42-ae5904f31021\") " pod="opendatahub/kserve-controller-manager-856948b99f-4v2bl"
May 20 20:28:08.883600 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:28:08.883580    2566 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 20 20:28:08.883677 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:28:08.883637    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40863c5f-dffa-4200-8e42-ae5904f31021-cert podName:40863c5f-dffa-4200-8e42-ae5904f31021 nodeName:}" failed. No retries permitted until 2026-05-20 20:28:09.383618928 +0000 UTC m=+503.414784735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/40863c5f-dffa-4200-8e42-ae5904f31021-cert") pod "kserve-controller-manager-856948b99f-4v2bl" (UID: "40863c5f-dffa-4200-8e42-ae5904f31021") : secret "kserve-webhook-server-cert" not found
May 20 20:28:08.891961 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:08.891931    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szx2v\" (UniqueName: \"kubernetes.io/projected/40863c5f-dffa-4200-8e42-ae5904f31021-kube-api-access-szx2v\") pod \"kserve-controller-manager-856948b99f-4v2bl\" (UID: \"40863c5f-dffa-4200-8e42-ae5904f31021\") " pod="opendatahub/kserve-controller-manager-856948b99f-4v2bl"
May 20 20:28:09.066203 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:09.066126    2566 scope.go:117] "RemoveContainer" containerID="22bccde597c59e17739f6b52677d9e0d081d569fd31e53a8963cb20a327fb8d6"
May 20 20:28:09.066536 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:28:09.066301    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-ms5vg_opendatahub(8a76dafc-3562-42a2-b958-e97b002c3c38)\"" pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg" podUID="8a76dafc-3562-42a2-b958-e97b002c3c38"
May 20 20:28:09.389139 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:09.389103    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40863c5f-dffa-4200-8e42-ae5904f31021-cert\") pod \"kserve-controller-manager-856948b99f-4v2bl\" (UID: \"40863c5f-dffa-4200-8e42-ae5904f31021\") " pod="opendatahub/kserve-controller-manager-856948b99f-4v2bl"
May 20 20:28:09.391416 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:09.391398    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40863c5f-dffa-4200-8e42-ae5904f31021-cert\") pod \"kserve-controller-manager-856948b99f-4v2bl\" (UID: \"40863c5f-dffa-4200-8e42-ae5904f31021\") " pod="opendatahub/kserve-controller-manager-856948b99f-4v2bl"
May 20 20:28:09.675298 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:09.675209    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-4v2bl"
May 20 20:28:09.823068 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:09.823026    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-4v2bl"]
May 20 20:28:09.824190 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:28:09.824161    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40863c5f_dffa_4200_8e42_ae5904f31021.slice/crio-884269a7839de834080a8d9b798af02f6adf1737059c12c0d4381429f707a066 WatchSource:0}: Error finding container 884269a7839de834080a8d9b798af02f6adf1737059c12c0d4381429f707a066: Status 404 returned error can't find the container with id 884269a7839de834080a8d9b798af02f6adf1737059c12c0d4381429f707a066
May 20 20:28:10.069919 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:10.069822    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-4v2bl" event={"ID":"40863c5f-dffa-4200-8e42-ae5904f31021","Type":"ContainerStarted","Data":"884269a7839de834080a8d9b798af02f6adf1737059c12c0d4381429f707a066"}
May 20 20:28:11.984962 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:11.984923    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg"]
May 20 20:28:11.988995 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:11.988975    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg"
May 20 20:28:11.993501 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:11.993480    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 20:28:11.994275 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:11.994255    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cf5mm\""
May 20 20:28:11.994372 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:11.994255    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 20:28:12.014969 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:12.014948    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrmnf\" (UniqueName: \"kubernetes.io/projected/25e7bcc2-a15d-4617-ab5b-da9718e42ce1-kube-api-access-xrmnf\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg\" (UID: \"25e7bcc2-a15d-4617-ab5b-da9718e42ce1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg"
May 20 20:28:12.015069 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:12.015033    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25e7bcc2-a15d-4617-ab5b-da9718e42ce1-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg\" (UID: \"25e7bcc2-a15d-4617-ab5b-da9718e42ce1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg"
May 20 20:28:12.015069 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:12.015049    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25e7bcc2-a15d-4617-ab5b-da9718e42ce1-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg\" (UID: \"25e7bcc2-a15d-4617-ab5b-da9718e42ce1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg"
May 20 20:28:12.019068 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:12.019047    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg"]
May 20 20:28:12.116184 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:12.116152    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25e7bcc2-a15d-4617-ab5b-da9718e42ce1-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg\" (UID: \"25e7bcc2-a15d-4617-ab5b-da9718e42ce1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg"
May 20 20:28:12.116333 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:12.116193    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25e7bcc2-a15d-4617-ab5b-da9718e42ce1-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg\" (UID: \"25e7bcc2-a15d-4617-ab5b-da9718e42ce1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg"
May 20 20:28:12.116394 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:12.116356    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrmnf\" (UniqueName: \"kubernetes.io/projected/25e7bcc2-a15d-4617-ab5b-da9718e42ce1-kube-api-access-xrmnf\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg\" (UID: \"25e7bcc2-a15d-4617-ab5b-da9718e42ce1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg"
May 20 20:28:12.116601 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:12.116580    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25e7bcc2-a15d-4617-ab5b-da9718e42ce1-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg\" (UID: \"25e7bcc2-a15d-4617-ab5b-da9718e42ce1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg"
May 20 20:28:12.116661 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:12.116620    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25e7bcc2-a15d-4617-ab5b-da9718e42ce1-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg\" (UID: \"25e7bcc2-a15d-4617-ab5b-da9718e42ce1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg"
May 20 20:28:12.127204 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:12.127179    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrmnf\" (UniqueName: \"kubernetes.io/projected/25e7bcc2-a15d-4617-ab5b-da9718e42ce1-kube-api-access-xrmnf\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg\" (UID: \"25e7bcc2-a15d-4617-ab5b-da9718e42ce1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg"
May 20 20:28:12.301299 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:12.301218    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg"
May 20 20:28:12.455221 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:12.455198    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg"]
May 20 20:28:12.457026 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:28:12.456999    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25e7bcc2_a15d_4617_ab5b_da9718e42ce1.slice/crio-0215dc27aca8d41ef399e4d425a4767078b16cde18071125255a795ffc9f0da6 WatchSource:0}: Error finding container 0215dc27aca8d41ef399e4d425a4767078b16cde18071125255a795ffc9f0da6: Status 404 returned error can't find the container with id 0215dc27aca8d41ef399e4d425a4767078b16cde18071125255a795ffc9f0da6
May 20 20:28:12.943631 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:12.943600    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg"
May 20 20:28:12.944035 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:12.944011    2566 scope.go:117] "RemoveContainer" containerID="22bccde597c59e17739f6b52677d9e0d081d569fd31e53a8963cb20a327fb8d6"
May 20 20:28:12.944217 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:28:12.944200    2566 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-ms5vg_opendatahub(8a76dafc-3562-42a2-b958-e97b002c3c38)\"" pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg" podUID="8a76dafc-3562-42a2-b958-e97b002c3c38"
May 20 20:28:13.082073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:13.082028    2566 generic.go:358] "Generic (PLEG): container finished" podID="25e7bcc2-a15d-4617-ab5b-da9718e42ce1" containerID="960d3b576852833403636117c7f0c03a13422d736d18c315b3a8b3b27b1f9aaa" exitCode=0
May 20 20:28:13.082502 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:13.082123    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg" event={"ID":"25e7bcc2-a15d-4617-ab5b-da9718e42ce1","Type":"ContainerDied","Data":"960d3b576852833403636117c7f0c03a13422d736d18c315b3a8b3b27b1f9aaa"}
May 20 20:28:13.082502 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:13.082159    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg" event={"ID":"25e7bcc2-a15d-4617-ab5b-da9718e42ce1","Type":"ContainerStarted","Data":"0215dc27aca8d41ef399e4d425a4767078b16cde18071125255a795ffc9f0da6"}
May 20 20:28:13.187163 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:13.187130    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-vsf69"]
May 20 20:28:13.191755 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:13.191729    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vsf69"
May 20 20:28:13.195437 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:13.195380    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-c6mxw\""
May 20 20:28:13.195552 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:13.195453    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 20 20:28:13.195707 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:13.195623    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 20 20:28:13.204267 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:13.204242    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-vsf69"]
May 20 20:28:13.226581 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:13.226546    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f3c44c76-0e27-4ef1-8115-00602f1b731a-operator-config\") pod \"servicemesh-operator3-55f49c5f94-vsf69\" (UID: \"f3c44c76-0e27-4ef1-8115-00602f1b731a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vsf69"
May 20 20:28:13.226708 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:13.226587    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z5cn\" (UniqueName: \"kubernetes.io/projected/f3c44c76-0e27-4ef1-8115-00602f1b731a-kube-api-access-9z5cn\") pod \"servicemesh-operator3-55f49c5f94-vsf69\" (UID: \"f3c44c76-0e27-4ef1-8115-00602f1b731a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vsf69"
May 20 20:28:13.327500 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:13.327459    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f3c44c76-0e27-4ef1-8115-00602f1b731a-operator-config\") pod \"servicemesh-operator3-55f49c5f94-vsf69\" (UID: \"f3c44c76-0e27-4ef1-8115-00602f1b731a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vsf69"
May 20 20:28:13.327675 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:13.327504    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9z5cn\" (UniqueName: \"kubernetes.io/projected/f3c44c76-0e27-4ef1-8115-00602f1b731a-kube-api-access-9z5cn\") pod \"servicemesh-operator3-55f49c5f94-vsf69\" (UID: \"f3c44c76-0e27-4ef1-8115-00602f1b731a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vsf69"
May 20 20:28:13.329952 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:13.329924    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f3c44c76-0e27-4ef1-8115-00602f1b731a-operator-config\") pod \"servicemesh-operator3-55f49c5f94-vsf69\" (UID: \"f3c44c76-0e27-4ef1-8115-00602f1b731a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vsf69"
May 20 20:28:13.339354 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:13.339322    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z5cn\" (UniqueName: \"kubernetes.io/projected/f3c44c76-0e27-4ef1-8115-00602f1b731a-kube-api-access-9z5cn\") pod \"servicemesh-operator3-55f49c5f94-vsf69\" (UID: \"f3c44c76-0e27-4ef1-8115-00602f1b731a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vsf69"
May 20 20:28:13.506060 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:13.505980    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vsf69"
May 20 20:28:13.650152 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:13.650089    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-vsf69"]
May 20 20:28:13.652405 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:28:13.652374    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3c44c76_0e27_4ef1_8115_00602f1b731a.slice/crio-3179b93d18f470dbc55d4c92070405e20c20643b0796ee4f76e47f8d50b26168 WatchSource:0}: Error finding container 3179b93d18f470dbc55d4c92070405e20c20643b0796ee4f76e47f8d50b26168: Status 404 returned error can't find the container with id 3179b93d18f470dbc55d4c92070405e20c20643b0796ee4f76e47f8d50b26168
May 20 20:28:14.086698 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:14.086667    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-4v2bl" event={"ID":"40863c5f-dffa-4200-8e42-ae5904f31021","Type":"ContainerStarted","Data":"0a232e09229a908d6210c63aba6ea22d327ae6a851074be098bdd56c1fa9ec7f"}
May 20 20:28:14.087255 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:14.086911    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-4v2bl"
May 20 20:28:14.087944 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:14.087923    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vsf69" event={"ID":"f3c44c76-0e27-4ef1-8115-00602f1b731a","Type":"ContainerStarted","Data":"3179b93d18f470dbc55d4c92070405e20c20643b0796ee4f76e47f8d50b26168"}
May 20 20:28:15.093515 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:15.093479    2566 generic.go:358] "Generic (PLEG): container finished" podID="25e7bcc2-a15d-4617-ab5b-da9718e42ce1" containerID="3b7b103fcab0f66b8e18f95d1ecd97312a2444252a73cbcecf9e85db8414b969" exitCode=0
May 20 20:28:15.094004 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:15.093575    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg" event={"ID":"25e7bcc2-a15d-4617-ab5b-da9718e42ce1","Type":"ContainerDied","Data":"3b7b103fcab0f66b8e18f95d1ecd97312a2444252a73cbcecf9e85db8414b969"}
May 20 20:28:15.130817 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:15.130760    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-4v2bl" podStartSLOduration=3.593145867 podStartE2EDuration="7.130660488s" podCreationTimestamp="2026-05-20 20:28:08 +0000 UTC" firstStartedPulling="2026-05-20 20:28:09.825590212 +0000 UTC m=+503.856756017" lastFinishedPulling="2026-05-20 20:28:13.36310483 +0000 UTC m=+507.394270638" observedRunningTime="2026-05-20 20:28:14.110380693 +0000 UTC m=+508.141546522" watchObservedRunningTime="2026-05-20 20:28:15.130660488 +0000 UTC m=+509.161826316"
May 20 20:28:16.098849 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:16.098809    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg" event={"ID":"25e7bcc2-a15d-4617-ab5b-da9718e42ce1","Type":"ContainerStarted","Data":"7ff9e3da20b182ddc825225662469762e44f6cc3113245eb57f686108a48c003"}
May 20 20:28:16.118072 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:16.118012    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg" podStartSLOduration=4.094189209 podStartE2EDuration="5.117997097s" podCreationTimestamp="2026-05-20 20:28:11 +0000 UTC" firstStartedPulling="2026-05-20 20:28:13.083298765 +0000 UTC m=+507.114464570" lastFinishedPulling="2026-05-20 20:28:14.107106643 +0000 UTC m=+508.138272458" observedRunningTime="2026-05-20 20:28:16.117709778 +0000 UTC m=+510.148875605" watchObservedRunningTime="2026-05-20 20:28:16.117997097 +0000 UTC m=+510.149162925"
May 20 20:28:17.104037 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:17.104003    2566 generic.go:358] "Generic (PLEG): container finished" podID="25e7bcc2-a15d-4617-ab5b-da9718e42ce1" containerID="7ff9e3da20b182ddc825225662469762e44f6cc3113245eb57f686108a48c003" exitCode=0
May 20 20:28:17.104512 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:17.104091    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg" event={"ID":"25e7bcc2-a15d-4617-ab5b-da9718e42ce1","Type":"ContainerDied","Data":"7ff9e3da20b182ddc825225662469762e44f6cc3113245eb57f686108a48c003"}
May 20 20:28:17.105411 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:17.105388    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vsf69" event={"ID":"f3c44c76-0e27-4ef1-8115-00602f1b731a","Type":"ContainerStarted","Data":"ad905ea4efb2778991eb4c1e4c94232658fabb2017575f5c56f5be5af9adc2de"}
May 20 20:28:17.105528 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:17.105516    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vsf69"
May 20 20:28:17.174606 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:17.174563    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vsf69" podStartSLOduration=1.642328574 podStartE2EDuration="4.174550116s" podCreationTimestamp="2026-05-20 20:28:13 +0000 UTC" firstStartedPulling="2026-05-20 20:28:13.654839155 +0000 UTC m=+507.686004964" lastFinishedPulling="2026-05-20 20:28:16.187060689 +0000 UTC m=+510.218226506" observedRunningTime="2026-05-20 20:28:17.17252778 +0000 UTC m=+511.203693607" watchObservedRunningTime="2026-05-20 20:28:17.174550116 +0000 UTC m=+511.205715942"
May 20 20:28:18.237166 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:18.237139    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg"
May 20 20:28:18.270465 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:18.270430    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrmnf\" (UniqueName: \"kubernetes.io/projected/25e7bcc2-a15d-4617-ab5b-da9718e42ce1-kube-api-access-xrmnf\") pod \"25e7bcc2-a15d-4617-ab5b-da9718e42ce1\" (UID: \"25e7bcc2-a15d-4617-ab5b-da9718e42ce1\") "
May 20 20:28:18.270589 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:18.270486    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25e7bcc2-a15d-4617-ab5b-da9718e42ce1-bundle\") pod \"25e7bcc2-a15d-4617-ab5b-da9718e42ce1\" (UID: \"25e7bcc2-a15d-4617-ab5b-da9718e42ce1\") "
May 20 20:28:18.270589 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:18.270542    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25e7bcc2-a15d-4617-ab5b-da9718e42ce1-util\") pod \"25e7bcc2-a15d-4617-ab5b-da9718e42ce1\" (UID: \"25e7bcc2-a15d-4617-ab5b-da9718e42ce1\") "
May 20 20:28:18.271594 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:18.271566    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25e7bcc2-a15d-4617-ab5b-da9718e42ce1-bundle" (OuterVolumeSpecName: "bundle") pod "25e7bcc2-a15d-4617-ab5b-da9718e42ce1" (UID: "25e7bcc2-a15d-4617-ab5b-da9718e42ce1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:28:18.272564 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:18.272540    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25e7bcc2-a15d-4617-ab5b-da9718e42ce1-kube-api-access-xrmnf" (OuterVolumeSpecName: "kube-api-access-xrmnf") pod "25e7bcc2-a15d-4617-ab5b-da9718e42ce1" (UID: "25e7bcc2-a15d-4617-ab5b-da9718e42ce1"). InnerVolumeSpecName "kube-api-access-xrmnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:28:18.275098 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:18.275074    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25e7bcc2-a15d-4617-ab5b-da9718e42ce1-util" (OuterVolumeSpecName: "util") pod "25e7bcc2-a15d-4617-ab5b-da9718e42ce1" (UID: "25e7bcc2-a15d-4617-ab5b-da9718e42ce1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:28:18.371298 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:18.371218    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25e7bcc2-a15d-4617-ab5b-da9718e42ce1-bundle\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:28:18.371298 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:18.371248    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25e7bcc2-a15d-4617-ab5b-da9718e42ce1-util\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:28:18.371298 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:18.371261    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrmnf\" (UniqueName: \"kubernetes.io/projected/25e7bcc2-a15d-4617-ab5b-da9718e42ce1-kube-api-access-xrmnf\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:28:19.041765 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.041725    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"]
May 20 20:28:19.042088 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.042074    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25e7bcc2-a15d-4617-ab5b-da9718e42ce1" containerName="pull"
May 20 20:28:19.042088 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.042089    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="25e7bcc2-a15d-4617-ab5b-da9718e42ce1" containerName="pull"
May 20 20:28:19.042197 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.042097    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25e7bcc2-a15d-4617-ab5b-da9718e42ce1" containerName="extract"
May 20 20:28:19.042197 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.042103    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="25e7bcc2-a15d-4617-ab5b-da9718e42ce1" containerName="extract"
May 20 20:28:19.042197 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.042111    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25e7bcc2-a15d-4617-ab5b-da9718e42ce1" containerName="util"
May 20 20:28:19.042197 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.042117    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="25e7bcc2-a15d-4617-ab5b-da9718e42ce1" containerName="util"
May 20 20:28:19.042197 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.042176    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="25e7bcc2-a15d-4617-ab5b-da9718e42ce1" containerName="extract"
May 20 20:28:19.047398 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.047375    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.049741 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.049719    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 20 20:28:19.050130 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.050113    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qsvd6\""
May 20 20:28:19.050204 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.050128    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 20 20:28:19.050329 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.050308    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 20 20:28:19.050453 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.050431    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 20 20:28:19.056166 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.056147    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"]
May 20 20:28:19.078286 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.078261    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5f86e28-174c-4a97-851c-80ae9325ffc2-local-certs\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.078388 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.078343    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b5f86e28-174c-4a97-851c-80ae9325ffc2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.078388 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.078378    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b5f86e28-174c-4a97-851c-80ae9325ffc2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.078476 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.078427    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5f86e28-174c-4a97-851c-80ae9325ffc2-istio-token\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.078512 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.078493    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5f86e28-174c-4a97-851c-80ae9325ffc2-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.078543 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.078521    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngs8x\" (UniqueName: \"kubernetes.io/projected/b5f86e28-174c-4a97-851c-80ae9325ffc2-kube-api-access-ngs8x\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.078583 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.078551    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b5f86e28-174c-4a97-851c-80ae9325ffc2-cacerts\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.113480 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.113451    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg" event={"ID":"25e7bcc2-a15d-4617-ab5b-da9718e42ce1","Type":"ContainerDied","Data":"0215dc27aca8d41ef399e4d425a4767078b16cde18071125255a795ffc9f0da6"}
May 20 20:28:19.113576 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.113480    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0215dc27aca8d41ef399e4d425a4767078b16cde18071125255a795ffc9f0da6"
May 20 20:28:19.113576 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.113499    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5gxkg"
May 20 20:28:19.179936 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.179916    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5f86e28-174c-4a97-851c-80ae9325ffc2-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.180022 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.179945    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ngs8x\" (UniqueName: \"kubernetes.io/projected/b5f86e28-174c-4a97-851c-80ae9325ffc2-kube-api-access-ngs8x\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.180022 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.179974    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b5f86e28-174c-4a97-851c-80ae9325ffc2-cacerts\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.180183 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.180165    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5f86e28-174c-4a97-851c-80ae9325ffc2-local-certs\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.180269 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.180220    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b5f86e28-174c-4a97-851c-80ae9325ffc2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.180269 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.180244    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b5f86e28-174c-4a97-851c-80ae9325ffc2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.180377 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.180286    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5f86e28-174c-4a97-851c-80ae9325ffc2-istio-token\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.180879 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.180854    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b5f86e28-174c-4a97-851c-80ae9325ffc2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.182385 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.182367    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b5f86e28-174c-4a97-851c-80ae9325ffc2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.182512 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.182431    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5f86e28-174c-4a97-851c-80ae9325ffc2-local-certs\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.182512 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.182490    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b5f86e28-174c-4a97-851c-80ae9325ffc2-cacerts\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.182512 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.182504    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5f86e28-174c-4a97-851c-80ae9325ffc2-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.189291 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.189269    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5f86e28-174c-4a97-851c-80ae9325ffc2-istio-token\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.189618 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.189599    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngs8x\" (UniqueName: \"kubernetes.io/projected/b5f86e28-174c-4a97-851c-80ae9325ffc2-kube-api-access-ngs8x\") pod \"istiod-openshift-gateway-798958bb55-5kq7c\" (UID: \"b5f86e28-174c-4a97-851c-80ae9325ffc2\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.361815 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.357799    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:19.503269 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:19.503215    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"]
May 20 20:28:19.506051 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:28:19.506023    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f86e28_174c_4a97_851c_80ae9325ffc2.slice/crio-9e77501e6333d9287a1c9df20f15749b1ca14458bf43c2013f8d48a49c0f9143 WatchSource:0}: Error finding container 9e77501e6333d9287a1c9df20f15749b1ca14458bf43c2013f8d48a49c0f9143: Status 404 returned error can't find the container with id 9e77501e6333d9287a1c9df20f15749b1ca14458bf43c2013f8d48a49c0f9143
May 20 20:28:20.119636 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:20.119595    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c" event={"ID":"b5f86e28-174c-4a97-851c-80ae9325ffc2","Type":"ContainerStarted","Data":"9e77501e6333d9287a1c9df20f15749b1ca14458bf43c2013f8d48a49c0f9143"}
May 20 20:28:22.323370 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:22.323326    2566 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 20 20:28:22.323710 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:22.323398    2566 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 20 20:28:22.944018 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:22.943969    2566 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg"
May 20 20:28:22.944388 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:22.944374    2566 scope.go:117] "RemoveContainer" containerID="22bccde597c59e17739f6b52677d9e0d081d569fd31e53a8963cb20a327fb8d6"
May 20 20:28:23.133630 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:23.133588    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c" event={"ID":"b5f86e28-174c-4a97-851c-80ae9325ffc2","Type":"ContainerStarted","Data":"eee6dbd87347eddb0035467b5f134949a31a1fddd35980a72b21b05f45c9f194"}
May 20 20:28:23.133630 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:23.133641    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:23.135367 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:23.135342    2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-5kq7c container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 20 20:28:23.135506 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:23.135394    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c" podUID="b5f86e28-174c-4a97-851c-80ae9325ffc2" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:28:23.157031 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:23.156981    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c" podStartSLOduration=1.342345591 podStartE2EDuration="4.156967888s" podCreationTimestamp="2026-05-20 20:28:19 +0000 UTC" firstStartedPulling="2026-05-20 20:28:19.508482337 +0000 UTC m=+513.539648142" lastFinishedPulling="2026-05-20 20:28:22.323104632 +0000 UTC m=+516.354270439" observedRunningTime="2026-05-20 20:28:23.154752415 +0000 UTC m=+517.185918234" watchObservedRunningTime="2026-05-20 20:28:23.156967888 +0000 UTC m=+517.188133714"
May 20 20:28:24.139188 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:24.139149    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg" event={"ID":"8a76dafc-3562-42a2-b958-e97b002c3c38","Type":"ContainerStarted","Data":"a5ae209fea724ead89ad973006a7eca2a842dfee444822cb0d91d8bb6461ae5f"}
May 20 20:28:24.139717 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:24.139593    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg"
May 20 20:28:24.140268 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:24.140246    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5kq7c"
May 20 20:28:24.159349 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:24.159301    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg" podStartSLOduration=2.425056536 podStartE2EDuration="22.159285901s" podCreationTimestamp="2026-05-20 20:28:02 +0000 UTC" firstStartedPulling="2026-05-20 20:28:03.476124114 +0000 UTC m=+497.507289924" lastFinishedPulling="2026-05-20 20:28:23.210353481 +0000 UTC m=+517.241519289" observedRunningTime="2026-05-20 20:28:24.158079682 +0000 UTC m=+518.189245512" watchObservedRunningTime="2026-05-20 20:28:24.159285901 +0000 UTC m=+518.190451729"
May 20 20:28:28.111379 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:28.111341    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vsf69"
May 20 20:28:34.524752 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.524717    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-74849c55b8-r7zgn"]
May 20 20:28:34.530217 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.530195    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.540921 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.540875    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74849c55b8-r7zgn"]
May 20 20:28:34.622050 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.622018    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/878b2382-6b64-42c2-8a19-c0066e293fa4-trusted-ca-bundle\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.622221 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.622068    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/878b2382-6b64-42c2-8a19-c0066e293fa4-oauth-serving-cert\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.622221 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.622131    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/878b2382-6b64-42c2-8a19-c0066e293fa4-console-config\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.622221 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.622171    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/878b2382-6b64-42c2-8a19-c0066e293fa4-console-oauth-config\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.622324 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.622229    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zm99\" (UniqueName: \"kubernetes.io/projected/878b2382-6b64-42c2-8a19-c0066e293fa4-kube-api-access-2zm99\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.622324 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.622276    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/878b2382-6b64-42c2-8a19-c0066e293fa4-console-serving-cert\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.622324 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.622319    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/878b2382-6b64-42c2-8a19-c0066e293fa4-service-ca\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.723661 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.723615    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/878b2382-6b64-42c2-8a19-c0066e293fa4-oauth-serving-cert\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.723853 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.723679    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/878b2382-6b64-42c2-8a19-c0066e293fa4-console-config\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.723853 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.723709    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/878b2382-6b64-42c2-8a19-c0066e293fa4-console-oauth-config\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.723853 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.723741    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zm99\" (UniqueName: \"kubernetes.io/projected/878b2382-6b64-42c2-8a19-c0066e293fa4-kube-api-access-2zm99\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.723853 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.723774    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/878b2382-6b64-42c2-8a19-c0066e293fa4-console-serving-cert\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.723853 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.723817    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/878b2382-6b64-42c2-8a19-c0066e293fa4-service-ca\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.724148 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.723875    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/878b2382-6b64-42c2-8a19-c0066e293fa4-trusted-ca-bundle\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.724507 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.724480    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/878b2382-6b64-42c2-8a19-c0066e293fa4-console-config\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.724611 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.724496    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/878b2382-6b64-42c2-8a19-c0066e293fa4-oauth-serving-cert\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.724848 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.724823    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/878b2382-6b64-42c2-8a19-c0066e293fa4-service-ca\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.724956 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.724936    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/878b2382-6b64-42c2-8a19-c0066e293fa4-trusted-ca-bundle\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.726302 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.726273    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/878b2382-6b64-42c2-8a19-c0066e293fa4-console-oauth-config\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.726424 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.726404    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/878b2382-6b64-42c2-8a19-c0066e293fa4-console-serving-cert\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.733316 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.733282    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zm99\" (UniqueName: \"kubernetes.io/projected/878b2382-6b64-42c2-8a19-c0066e293fa4-kube-api-access-2zm99\") pod \"console-74849c55b8-r7zgn\" (UID: \"878b2382-6b64-42c2-8a19-c0066e293fa4\") " pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.839207 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.839176    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:34.971520 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:34.971490    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74849c55b8-r7zgn"]
May 20 20:28:34.972697 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:28:34.972669    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod878b2382_6b64_42c2_8a19_c0066e293fa4.slice/crio-fd09c0b01948a84362be45b1c55d7a866df7a34d355751a0f2cc96bd5f8b661e WatchSource:0}: Error finding container fd09c0b01948a84362be45b1c55d7a866df7a34d355751a0f2cc96bd5f8b661e: Status 404 returned error can't find the container with id fd09c0b01948a84362be45b1c55d7a866df7a34d355751a0f2cc96bd5f8b661e
May 20 20:28:35.145515 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:35.145428    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-ms5vg"
May 20 20:28:35.181733 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:35.181700    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74849c55b8-r7zgn" event={"ID":"878b2382-6b64-42c2-8a19-c0066e293fa4","Type":"ContainerStarted","Data":"7cce8d7d5c044a1cc0ea29541cf37851970e8144e27cf5974fba6286ecced502"}
May 20 20:28:35.181733 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:35.181733    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74849c55b8-r7zgn" event={"ID":"878b2382-6b64-42c2-8a19-c0066e293fa4","Type":"ContainerStarted","Data":"fd09c0b01948a84362be45b1c55d7a866df7a34d355751a0f2cc96bd5f8b661e"}
May 20 20:28:35.212292 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:35.212246    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-74849c55b8-r7zgn" podStartSLOduration=1.212232564 podStartE2EDuration="1.212232564s" podCreationTimestamp="2026-05-20 20:28:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:28:35.21069177 +0000 UTC m=+529.241857598" watchObservedRunningTime="2026-05-20 20:28:35.212232564 +0000 UTC m=+529.243398391"
May 20 20:28:44.839675 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:44.839591    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:44.839675 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:44.839643    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:44.844120 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:44.844100    2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:45.099548 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:45.099474    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-4v2bl"
May 20 20:28:45.224371 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:45.224341    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74849c55b8-r7zgn"
May 20 20:28:45.288029 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:28:45.287989    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d7dd5d75b-p4q9h"]
May 20 20:29:10.313070 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.313002    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5d7dd5d75b-p4q9h" podUID="36c57b90-1212-408e-864f-b56ec812bbac" containerName="console" containerID="cri-o://7c6e4be13afdda0678a592eb75644e6abd6347234e1f04505e1f5c6998b5b329" gracePeriod=15
May 20 20:29:10.549090 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.549067    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d7dd5d75b-p4q9h_36c57b90-1212-408e-864f-b56ec812bbac/console/0.log"
May 20 20:29:10.549191 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.549128    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:29:10.643797 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.643765    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-oauth-serving-cert\") pod \"36c57b90-1212-408e-864f-b56ec812bbac\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") "
May 20 20:29:10.643797 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.643801    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36c57b90-1212-408e-864f-b56ec812bbac-console-oauth-config\") pod \"36c57b90-1212-408e-864f-b56ec812bbac\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") "
May 20 20:29:10.644053 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.643840    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsxfg\" (UniqueName: \"kubernetes.io/projected/36c57b90-1212-408e-864f-b56ec812bbac-kube-api-access-hsxfg\") pod \"36c57b90-1212-408e-864f-b56ec812bbac\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") "
May 20 20:29:10.644053 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.643867    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-service-ca\") pod \"36c57b90-1212-408e-864f-b56ec812bbac\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") "
May 20 20:29:10.644053 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.643912    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-console-config\") pod \"36c57b90-1212-408e-864f-b56ec812bbac\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") "
May 20 20:29:10.644053 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.643980    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36c57b90-1212-408e-864f-b56ec812bbac-console-serving-cert\") pod \"36c57b90-1212-408e-864f-b56ec812bbac\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") "
May 20 20:29:10.644053 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.644032    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-trusted-ca-bundle\") pod \"36c57b90-1212-408e-864f-b56ec812bbac\" (UID: \"36c57b90-1212-408e-864f-b56ec812bbac\") "
May 20 20:29:10.644278 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.644206    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "36c57b90-1212-408e-864f-b56ec812bbac" (UID: "36c57b90-1212-408e-864f-b56ec812bbac"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:29:10.644388 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.644355    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-oauth-serving-cert\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:29:10.644485 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.644460    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-service-ca" (OuterVolumeSpecName: "service-ca") pod "36c57b90-1212-408e-864f-b56ec812bbac" (UID: "36c57b90-1212-408e-864f-b56ec812bbac"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:29:10.644544 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.644517    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-console-config" (OuterVolumeSpecName: "console-config") pod "36c57b90-1212-408e-864f-b56ec812bbac" (UID: "36c57b90-1212-408e-864f-b56ec812bbac"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:29:10.644729 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.644707    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "36c57b90-1212-408e-864f-b56ec812bbac" (UID: "36c57b90-1212-408e-864f-b56ec812bbac"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:29:10.646212 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.646185    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36c57b90-1212-408e-864f-b56ec812bbac-kube-api-access-hsxfg" (OuterVolumeSpecName: "kube-api-access-hsxfg") pod "36c57b90-1212-408e-864f-b56ec812bbac" (UID: "36c57b90-1212-408e-864f-b56ec812bbac"). InnerVolumeSpecName "kube-api-access-hsxfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:29:10.646212 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.646197    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36c57b90-1212-408e-864f-b56ec812bbac-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "36c57b90-1212-408e-864f-b56ec812bbac" (UID: "36c57b90-1212-408e-864f-b56ec812bbac"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:29:10.646347 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.646234    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36c57b90-1212-408e-864f-b56ec812bbac-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "36c57b90-1212-408e-864f-b56ec812bbac" (UID: "36c57b90-1212-408e-864f-b56ec812bbac"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:29:10.744713 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.744686    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-trusted-ca-bundle\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:29:10.744713 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.744709    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36c57b90-1212-408e-864f-b56ec812bbac-console-oauth-config\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:29:10.744867 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.744719    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsxfg\" (UniqueName: \"kubernetes.io/projected/36c57b90-1212-408e-864f-b56ec812bbac-kube-api-access-hsxfg\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:29:10.744867 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.744730    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-service-ca\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:29:10.744867 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.744738    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36c57b90-1212-408e-864f-b56ec812bbac-console-config\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:29:10.744867 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:10.744747    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36c57b90-1212-408e-864f-b56ec812bbac-console-serving-cert\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:29:11.312064 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:11.312038    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d7dd5d75b-p4q9h_36c57b90-1212-408e-864f-b56ec812bbac/console/0.log"
May 20 20:29:11.312260 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:11.312076    2566 generic.go:358] "Generic (PLEG): container finished" podID="36c57b90-1212-408e-864f-b56ec812bbac" containerID="7c6e4be13afdda0678a592eb75644e6abd6347234e1f04505e1f5c6998b5b329" exitCode=2
May 20 20:29:11.312260 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:11.312105    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7dd5d75b-p4q9h" event={"ID":"36c57b90-1212-408e-864f-b56ec812bbac","Type":"ContainerDied","Data":"7c6e4be13afdda0678a592eb75644e6abd6347234e1f04505e1f5c6998b5b329"}
May 20 20:29:11.312260 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:11.312143    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7dd5d75b-p4q9h" event={"ID":"36c57b90-1212-408e-864f-b56ec812bbac","Type":"ContainerDied","Data":"1186138a63e375eb09786004dc827f2ff379b26da85c09dc39e9d0a62142c61b"}
May 20 20:29:11.312260 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:11.312158    2566 scope.go:117] "RemoveContainer" containerID="7c6e4be13afdda0678a592eb75644e6abd6347234e1f04505e1f5c6998b5b329"
May 20 20:29:11.312260 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:11.312183    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7dd5d75b-p4q9h"
May 20 20:29:11.321454 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:11.321319    2566 scope.go:117] "RemoveContainer" containerID="7c6e4be13afdda0678a592eb75644e6abd6347234e1f04505e1f5c6998b5b329"
May 20 20:29:11.321653 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:29:11.321534    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c6e4be13afdda0678a592eb75644e6abd6347234e1f04505e1f5c6998b5b329\": container with ID starting with 7c6e4be13afdda0678a592eb75644e6abd6347234e1f04505e1f5c6998b5b329 not found: ID does not exist" containerID="7c6e4be13afdda0678a592eb75644e6abd6347234e1f04505e1f5c6998b5b329"
May 20 20:29:11.321653 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:11.321558    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c6e4be13afdda0678a592eb75644e6abd6347234e1f04505e1f5c6998b5b329"} err="failed to get container status \"7c6e4be13afdda0678a592eb75644e6abd6347234e1f04505e1f5c6998b5b329\": rpc error: code = NotFound desc = could not find container \"7c6e4be13afdda0678a592eb75644e6abd6347234e1f04505e1f5c6998b5b329\": container with ID starting with 7c6e4be13afdda0678a592eb75644e6abd6347234e1f04505e1f5c6998b5b329 not found: ID does not exist"
May 20 20:29:11.335035 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:11.335016    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d7dd5d75b-p4q9h"]
May 20 20:29:11.342013 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:11.341995    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d7dd5d75b-p4q9h"]
May 20 20:29:12.557838 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:12.557804    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36c57b90-1212-408e-864f-b56ec812bbac" path="/var/lib/kubelet/pods/36c57b90-1212-408e-864f-b56ec812bbac/volumes"
May 20 20:29:16.672923 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:16.672879    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6"]
May 20 20:29:16.673300 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:16.673253    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36c57b90-1212-408e-864f-b56ec812bbac" containerName="console"
May 20 20:29:16.673300 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:16.673265    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c57b90-1212-408e-864f-b56ec812bbac" containerName="console"
May 20 20:29:16.673363 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:16.673322    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="36c57b90-1212-408e-864f-b56ec812bbac" containerName="console"
May 20 20:29:16.676166 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:16.676150    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6"
May 20 20:29:16.678738 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:16.678718    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 20 20:29:16.678841 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:16.678809    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 20 20:29:16.679481 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:16.679465    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4sntc\""
May 20 20:29:16.684476 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:16.684452    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6"]
May 20 20:29:16.799109 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:16.799075    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7jft\" (UniqueName: \"kubernetes.io/projected/f0124fc3-4896-4717-8ca3-e1485f7d0095-kube-api-access-z7jft\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6\" (UID: \"f0124fc3-4896-4717-8ca3-e1485f7d0095\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6"
May 20 20:29:16.799278 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:16.799128    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0124fc3-4896-4717-8ca3-e1485f7d0095-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6\" (UID: \"f0124fc3-4896-4717-8ca3-e1485f7d0095\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6"
May 20 20:29:16.799278 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:16.799210    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0124fc3-4896-4717-8ca3-e1485f7d0095-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6\" (UID: \"f0124fc3-4896-4717-8ca3-e1485f7d0095\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6"
May 20 20:29:16.900694 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:16.900654    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z7jft\" (UniqueName: \"kubernetes.io/projected/f0124fc3-4896-4717-8ca3-e1485f7d0095-kube-api-access-z7jft\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6\" (UID: \"f0124fc3-4896-4717-8ca3-e1485f7d0095\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6"
May 20 20:29:16.900694 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:16.900712    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0124fc3-4896-4717-8ca3-e1485f7d0095-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6\" (UID: \"f0124fc3-4896-4717-8ca3-e1485f7d0095\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6"
May 20 20:29:16.901007 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:16.900742    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0124fc3-4896-4717-8ca3-e1485f7d0095-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6\" (UID: \"f0124fc3-4896-4717-8ca3-e1485f7d0095\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6"
May 20 20:29:16.901135 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:16.901117    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0124fc3-4896-4717-8ca3-e1485f7d0095-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6\" (UID: \"f0124fc3-4896-4717-8ca3-e1485f7d0095\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6"
May 20 20:29:16.901215 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:16.901191    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0124fc3-4896-4717-8ca3-e1485f7d0095-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6\" (UID: \"f0124fc3-4896-4717-8ca3-e1485f7d0095\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6"
May 20 20:29:16.909254 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:16.909230    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7jft\" (UniqueName: \"kubernetes.io/projected/f0124fc3-4896-4717-8ca3-e1485f7d0095-kube-api-access-z7jft\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6\" (UID: \"f0124fc3-4896-4717-8ca3-e1485f7d0095\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6"
May 20 20:29:16.987103 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:16.987023    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6"
May 20 20:29:17.105145 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.105115    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955"]
May 20 20:29:17.108556 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.108535    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955"
May 20 20:29:17.120692 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.120670    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955"]
May 20 20:29:17.124720 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.124699    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6"]
May 20 20:29:17.126510 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:29:17.126484    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0124fc3_4896_4717_8ca3_e1485f7d0095.slice/crio-7c09b1e5b9f3396dba21e09e4eb1633cb9f24bd92b87620469362846ee400dd9 WatchSource:0}: Error finding container 7c09b1e5b9f3396dba21e09e4eb1633cb9f24bd92b87620469362846ee400dd9: Status 404 returned error can't find the container with id 7c09b1e5b9f3396dba21e09e4eb1633cb9f24bd92b87620469362846ee400dd9
May 20 20:29:17.203798 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.203768    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd6af2fa-96f7-4621-ab43-bc95eaa91865-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955\" (UID: \"fd6af2fa-96f7-4621-ab43-bc95eaa91865\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955"
May 20 20:29:17.203954 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.203823    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd6af2fa-96f7-4621-ab43-bc95eaa91865-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955\" (UID: \"fd6af2fa-96f7-4621-ab43-bc95eaa91865\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955"
May 20 20:29:17.203954 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.203882    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbxsf\" (UniqueName: \"kubernetes.io/projected/fd6af2fa-96f7-4621-ab43-bc95eaa91865-kube-api-access-lbxsf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955\" (UID: \"fd6af2fa-96f7-4621-ab43-bc95eaa91865\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955"
May 20 20:29:17.305272 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.305201    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd6af2fa-96f7-4621-ab43-bc95eaa91865-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955\" (UID: \"fd6af2fa-96f7-4621-ab43-bc95eaa91865\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955"
May 20 20:29:17.305272 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.305243    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lbxsf\" (UniqueName: \"kubernetes.io/projected/fd6af2fa-96f7-4621-ab43-bc95eaa91865-kube-api-access-lbxsf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955\" (UID: \"fd6af2fa-96f7-4621-ab43-bc95eaa91865\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955"
May 20 20:29:17.305429 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.305336    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd6af2fa-96f7-4621-ab43-bc95eaa91865-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955\" (UID: \"fd6af2fa-96f7-4621-ab43-bc95eaa91865\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955"
May 20 20:29:17.305640 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.305619    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd6af2fa-96f7-4621-ab43-bc95eaa91865-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955\" (UID: \"fd6af2fa-96f7-4621-ab43-bc95eaa91865\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955"
May 20 20:29:17.305678 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.305643    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd6af2fa-96f7-4621-ab43-bc95eaa91865-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955\" (UID: \"fd6af2fa-96f7-4621-ab43-bc95eaa91865\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955"
May 20 20:29:17.313764 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.313738    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbxsf\" (UniqueName: \"kubernetes.io/projected/fd6af2fa-96f7-4621-ab43-bc95eaa91865-kube-api-access-lbxsf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955\" (UID: \"fd6af2fa-96f7-4621-ab43-bc95eaa91865\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955"
May 20 20:29:17.335013 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.334986    2566 generic.go:358] "Generic (PLEG): container finished" podID="f0124fc3-4896-4717-8ca3-e1485f7d0095" containerID="aa418b3a559d4e4cc434a30812d75c69891b4d56023f20a1ffbf9a59df6464a9" exitCode=0
May 20 20:29:17.335129 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.335035    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6" event={"ID":"f0124fc3-4896-4717-8ca3-e1485f7d0095","Type":"ContainerDied","Data":"aa418b3a559d4e4cc434a30812d75c69891b4d56023f20a1ffbf9a59df6464a9"}
May 20 20:29:17.335129 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.335055    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6" event={"ID":"f0124fc3-4896-4717-8ca3-e1485f7d0095","Type":"ContainerStarted","Data":"7c09b1e5b9f3396dba21e09e4eb1633cb9f24bd92b87620469362846ee400dd9"}
May 20 20:29:17.418215 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.418191    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955"
May 20 20:29:17.474864 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.474383    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj"]
May 20 20:29:17.478642 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.478620    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj"
May 20 20:29:17.488397 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.488352    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj"]
May 20 20:29:17.549291 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.549266    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955"]
May 20 20:29:17.551095 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:29:17.551069    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd6af2fa_96f7_4621_ab43_bc95eaa91865.slice/crio-7b5e06a40567475af7f4cb8bcdb8dd8b3ab165d0aef76a133ba73a9e76cf6ca6 WatchSource:0}: Error finding container 7b5e06a40567475af7f4cb8bcdb8dd8b3ab165d0aef76a133ba73a9e76cf6ca6: Status 404 returned error can't find the container with id 7b5e06a40567475af7f4cb8bcdb8dd8b3ab165d0aef76a133ba73a9e76cf6ca6
May 20 20:29:17.608597 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.608571    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/696c47a1-0faf-431e-b922-c8c4d171a118-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj\" (UID: \"696c47a1-0faf-431e-b922-c8c4d171a118\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj"
May 20 20:29:17.608694 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.608622    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4xq8\" (UniqueName: \"kubernetes.io/projected/696c47a1-0faf-431e-b922-c8c4d171a118-kube-api-access-t4xq8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj\" (UID: \"696c47a1-0faf-431e-b922-c8c4d171a118\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj"
May 20 20:29:17.608745 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.608726    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/696c47a1-0faf-431e-b922-c8c4d171a118-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj\" (UID: \"696c47a1-0faf-431e-b922-c8c4d171a118\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj"
May 20 20:29:17.709600 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.709569    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/696c47a1-0faf-431e-b922-c8c4d171a118-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj\" (UID: \"696c47a1-0faf-431e-b922-c8c4d171a118\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj"
May 20 20:29:17.710015 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.709699    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/696c47a1-0faf-431e-b922-c8c4d171a118-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj\" (UID: \"696c47a1-0faf-431e-b922-c8c4d171a118\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj"
May 20 20:29:17.710015 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.709741    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t4xq8\" (UniqueName: \"kubernetes.io/projected/696c47a1-0faf-431e-b922-c8c4d171a118-kube-api-access-t4xq8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj\" (UID: \"696c47a1-0faf-431e-b922-c8c4d171a118\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj"
May 20 20:29:17.710015 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.709797    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/696c47a1-0faf-431e-b922-c8c4d171a118-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj\" (UID: \"696c47a1-0faf-431e-b922-c8c4d171a118\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj"
May 20 20:29:17.710015 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.709980    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/696c47a1-0faf-431e-b922-c8c4d171a118-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj\" (UID: \"696c47a1-0faf-431e-b922-c8c4d171a118\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj"
May 20 20:29:17.720729 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.720706    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4xq8\" (UniqueName: \"kubernetes.io/projected/696c47a1-0faf-431e-b922-c8c4d171a118-kube-api-access-t4xq8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj\" (UID: \"696c47a1-0faf-431e-b922-c8c4d171a118\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj"
May 20 20:29:17.790224 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.790198    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj"
May 20 20:29:17.881955 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.881923    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz"]
May 20 20:29:17.885382 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.885355    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz"
May 20 20:29:17.895325 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.895270    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz"]
May 20 20:29:17.920828 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:17.920763    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj"]
May 20 20:29:17.921115 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:29:17.921091    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod696c47a1_0faf_431e_b922_c8c4d171a118.slice/crio-5f0f688750f0c2eddc0a81105af8a8bd60c56673ed42a1391fb302fbfe94f73c WatchSource:0}: Error finding container 5f0f688750f0c2eddc0a81105af8a8bd60c56673ed42a1391fb302fbfe94f73c: Status 404 returned error can't find the container with id 5f0f688750f0c2eddc0a81105af8a8bd60c56673ed42a1391fb302fbfe94f73c
May 20 20:29:18.013073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:18.013039    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct4jh\" (UniqueName: \"kubernetes.io/projected/ab027928-e912-40fb-a0d5-58e094785f87-kube-api-access-ct4jh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz\" (UID: \"ab027928-e912-40fb-a0d5-58e094785f87\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz"
May 20 20:29:18.013213 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:18.013086    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab027928-e912-40fb-a0d5-58e094785f87-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz\" (UID: \"ab027928-e912-40fb-a0d5-58e094785f87\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz"
May 20 20:29:18.013213 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:18.013190    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab027928-e912-40fb-a0d5-58e094785f87-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz\" (UID: \"ab027928-e912-40fb-a0d5-58e094785f87\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz"
May 20 20:29:18.114318 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:18.114291    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ct4jh\" (UniqueName: \"kubernetes.io/projected/ab027928-e912-40fb-a0d5-58e094785f87-kube-api-access-ct4jh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz\" (UID: \"ab027928-e912-40fb-a0d5-58e094785f87\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz"
May 20 20:29:18.114485 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:18.114328    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab027928-e912-40fb-a0d5-58e094785f87-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz\" (UID: \"ab027928-e912-40fb-a0d5-58e094785f87\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz"
May 20 20:29:18.114485 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:18.114377    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab027928-e912-40fb-a0d5-58e094785f87-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz\" (UID: \"ab027928-e912-40fb-a0d5-58e094785f87\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz"
May 20 20:29:18.114710 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:18.114691    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab027928-e912-40fb-a0d5-58e094785f87-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz\" (UID: \"ab027928-e912-40fb-a0d5-58e094785f87\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz"
May 20 20:29:18.114796 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:18.114770    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab027928-e912-40fb-a0d5-58e094785f87-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz\" (UID: \"ab027928-e912-40fb-a0d5-58e094785f87\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz"
May 20 20:29:18.122818 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:18.122788    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct4jh\" (UniqueName: \"kubernetes.io/projected/ab027928-e912-40fb-a0d5-58e094785f87-kube-api-access-ct4jh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz\" (UID: \"ab027928-e912-40fb-a0d5-58e094785f87\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz"
May 20 20:29:18.198133 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:18.198105    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz"
May 20 20:29:18.338104 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:18.338072    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz"]
May 20 20:29:18.345108 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:18.345082    2566 generic.go:358] "Generic (PLEG): container finished" podID="696c47a1-0faf-431e-b922-c8c4d171a118" containerID="f00358a08b2ce93b8a9e8b835fb0c93a6c5ba78ab0aa6dc4d29908a21e4117f4" exitCode=0
May 20 20:29:18.345212 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:18.345164    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj" event={"ID":"696c47a1-0faf-431e-b922-c8c4d171a118","Type":"ContainerDied","Data":"f00358a08b2ce93b8a9e8b835fb0c93a6c5ba78ab0aa6dc4d29908a21e4117f4"}
May 20 20:29:18.345212 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:18.345198    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj" event={"ID":"696c47a1-0faf-431e-b922-c8c4d171a118","Type":"ContainerStarted","Data":"5f0f688750f0c2eddc0a81105af8a8bd60c56673ed42a1391fb302fbfe94f73c"}
May 20 20:29:18.346792 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:18.346771    2566 generic.go:358] "Generic (PLEG): container finished" podID="f0124fc3-4896-4717-8ca3-e1485f7d0095" containerID="e19b52b4cdeff100f310c6f64c2862da5c88b25e122dd3860c08af8599b0c023" exitCode=0
May 20 20:29:18.346882 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:18.346854    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6" event={"ID":"f0124fc3-4896-4717-8ca3-e1485f7d0095","Type":"ContainerDied","Data":"e19b52b4cdeff100f310c6f64c2862da5c88b25e122dd3860c08af8599b0c023"}
May 20 20:29:18.351361 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:29:18.351336    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab027928_e912_40fb_a0d5_58e094785f87.slice/crio-b4f37e0d88e34558bc60b30ee2c11987257482b439c2df8bdeb92d3b44d7aa14 WatchSource:0}: Error finding container b4f37e0d88e34558bc60b30ee2c11987257482b439c2df8bdeb92d3b44d7aa14: Status 404 returned error can't find the container with id b4f37e0d88e34558bc60b30ee2c11987257482b439c2df8bdeb92d3b44d7aa14
May 20 20:29:18.352028 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:18.351953    2566 generic.go:358] "Generic (PLEG): container finished" podID="fd6af2fa-96f7-4621-ab43-bc95eaa91865" containerID="93017cbd25bad301b3900e1596a28351415aa4d5ff120af0cbce12e68221dd99" exitCode=0
May 20 20:29:18.352028 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:18.352013    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955" event={"ID":"fd6af2fa-96f7-4621-ab43-bc95eaa91865","Type":"ContainerDied","Data":"93017cbd25bad301b3900e1596a28351415aa4d5ff120af0cbce12e68221dd99"}
May 20 20:29:18.352117 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:18.352033    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955" event={"ID":"fd6af2fa-96f7-4621-ab43-bc95eaa91865","Type":"ContainerStarted","Data":"7b5e06a40567475af7f4cb8bcdb8dd8b3ab165d0aef76a133ba73a9e76cf6ca6"}
May 20 20:29:19.357723 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:19.357695    2566 generic.go:358] "Generic (PLEG): container finished" podID="fd6af2fa-96f7-4621-ab43-bc95eaa91865" containerID="a8fcb9a9415de449dca367a477418f2a179b02d075798c9fc686832ea42e6652" exitCode=0
May 20 20:29:19.358117 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:19.357775    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955" event={"ID":"fd6af2fa-96f7-4621-ab43-bc95eaa91865","Type":"ContainerDied","Data":"a8fcb9a9415de449dca367a477418f2a179b02d075798c9fc686832ea42e6652"}
May 20 20:29:19.359110 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:19.359087    2566 generic.go:358] "Generic (PLEG): container finished" podID="ab027928-e912-40fb-a0d5-58e094785f87" containerID="ff1c9ec2fffa39278f1ff75031da0ac629321f6a9be95e038d16ab5965435b21" exitCode=0
May 20 20:29:19.359219 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:19.359161    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz" event={"ID":"ab027928-e912-40fb-a0d5-58e094785f87","Type":"ContainerDied","Data":"ff1c9ec2fffa39278f1ff75031da0ac629321f6a9be95e038d16ab5965435b21"}
May 20 20:29:19.359219 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:19.359186    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz" event={"ID":"ab027928-e912-40fb-a0d5-58e094785f87","Type":"ContainerStarted","Data":"b4f37e0d88e34558bc60b30ee2c11987257482b439c2df8bdeb92d3b44d7aa14"}
May 20 20:29:19.360948 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:19.360924    2566 generic.go:358] "Generic (PLEG): container finished" podID="696c47a1-0faf-431e-b922-c8c4d171a118" containerID="14157e38fd29a1e9770396b82ee4e6e94d91b5dd8fb16139f9a0d6eb3aeacedf" exitCode=0
May 20 20:29:19.361051 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:19.361002    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj" event={"ID":"696c47a1-0faf-431e-b922-c8c4d171a118","Type":"ContainerDied","Data":"14157e38fd29a1e9770396b82ee4e6e94d91b5dd8fb16139f9a0d6eb3aeacedf"}
May 20 20:29:19.363581 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:19.363563    2566 generic.go:358] "Generic (PLEG): container finished" podID="f0124fc3-4896-4717-8ca3-e1485f7d0095" containerID="bf87f88b8be4b981e1c094c678c32c172d2520fe87e846128cedcc06a20ab62e" exitCode=0
May 20 20:29:19.363668 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:19.363635    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6" event={"ID":"f0124fc3-4896-4717-8ca3-e1485f7d0095","Type":"ContainerDied","Data":"bf87f88b8be4b981e1c094c678c32c172d2520fe87e846128cedcc06a20ab62e"}
May 20 20:29:20.368846 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:20.368807    2566 generic.go:358] "Generic (PLEG): container finished" podID="696c47a1-0faf-431e-b922-c8c4d171a118" containerID="f5133912ce9e0c9da0c5cbdf4ca16a8c0c2c3ded92442447c5415e5b7d9a1d86" exitCode=0
May 20 20:29:20.369288 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:20.368900    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj" event={"ID":"696c47a1-0faf-431e-b922-c8c4d171a118","Type":"ContainerDied","Data":"f5133912ce9e0c9da0c5cbdf4ca16a8c0c2c3ded92442447c5415e5b7d9a1d86"}
May 20 20:29:20.370691 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:20.370671    2566 generic.go:358] "Generic (PLEG): container finished" podID="fd6af2fa-96f7-4621-ab43-bc95eaa91865" containerID="5c2f3a8094fe009bc2421e7d138568e3887d6ec41281f6f7d44811fe046da20e" exitCode=0
May 20 20:29:20.370804 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:20.370725    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955" event={"ID":"fd6af2fa-96f7-4621-ab43-bc95eaa91865","Type":"ContainerDied","Data":"5c2f3a8094fe009bc2421e7d138568e3887d6ec41281f6f7d44811fe046da20e"}
May 20 20:29:20.372163 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:20.372139    2566 generic.go:358] "Generic (PLEG): container finished" podID="ab027928-e912-40fb-a0d5-58e094785f87" containerID="31a303725960cb6fec3f4da33df5b8c74b9dfbdcc25adcdc59eb3bfbb7b4a775" exitCode=0
May 20 20:29:20.372254 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:20.372195    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz" event={"ID":"ab027928-e912-40fb-a0d5-58e094785f87","Type":"ContainerDied","Data":"31a303725960cb6fec3f4da33df5b8c74b9dfbdcc25adcdc59eb3bfbb7b4a775"}
May 20 20:29:20.499374 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:20.499352    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6"
May 20 20:29:20.641392 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:20.641320    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7jft\" (UniqueName: \"kubernetes.io/projected/f0124fc3-4896-4717-8ca3-e1485f7d0095-kube-api-access-z7jft\") pod \"f0124fc3-4896-4717-8ca3-e1485f7d0095\" (UID: \"f0124fc3-4896-4717-8ca3-e1485f7d0095\") "
May 20 20:29:20.641392 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:20.641362    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0124fc3-4896-4717-8ca3-e1485f7d0095-bundle\") pod \"f0124fc3-4896-4717-8ca3-e1485f7d0095\" (UID: \"f0124fc3-4896-4717-8ca3-e1485f7d0095\") "
May 20 20:29:20.641565 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:20.641491    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0124fc3-4896-4717-8ca3-e1485f7d0095-util\") pod \"f0124fc3-4896-4717-8ca3-e1485f7d0095\" (UID: \"f0124fc3-4896-4717-8ca3-e1485f7d0095\") "
May 20 20:29:20.642032 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:20.641994    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0124fc3-4896-4717-8ca3-e1485f7d0095-bundle" (OuterVolumeSpecName: "bundle") pod "f0124fc3-4896-4717-8ca3-e1485f7d0095" (UID: "f0124fc3-4896-4717-8ca3-e1485f7d0095"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:29:20.643520 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:20.643495    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0124fc3-4896-4717-8ca3-e1485f7d0095-kube-api-access-z7jft" (OuterVolumeSpecName: "kube-api-access-z7jft") pod "f0124fc3-4896-4717-8ca3-e1485f7d0095" (UID: "f0124fc3-4896-4717-8ca3-e1485f7d0095"). InnerVolumeSpecName "kube-api-access-z7jft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:29:20.647037 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:20.647014    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0124fc3-4896-4717-8ca3-e1485f7d0095-util" (OuterVolumeSpecName: "util") pod "f0124fc3-4896-4717-8ca3-e1485f7d0095" (UID: "f0124fc3-4896-4717-8ca3-e1485f7d0095"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:29:20.742798 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:20.742759    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7jft\" (UniqueName: \"kubernetes.io/projected/f0124fc3-4896-4717-8ca3-e1485f7d0095-kube-api-access-z7jft\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:29:20.742798 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:20.742794    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0124fc3-4896-4717-8ca3-e1485f7d0095-bundle\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:29:20.742798 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:20.742805    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0124fc3-4896-4717-8ca3-e1485f7d0095-util\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:29:21.377034 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.377005    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6"
May 20 20:29:21.377529 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.377006    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6" event={"ID":"f0124fc3-4896-4717-8ca3-e1485f7d0095","Type":"ContainerDied","Data":"7c09b1e5b9f3396dba21e09e4eb1633cb9f24bd92b87620469362846ee400dd9"}
May 20 20:29:21.377529 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.377116    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c09b1e5b9f3396dba21e09e4eb1633cb9f24bd92b87620469362846ee400dd9"
May 20 20:29:21.378887 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.378866    2566 generic.go:358] "Generic (PLEG): container finished" podID="ab027928-e912-40fb-a0d5-58e094785f87" containerID="e654b0a5f0bd7832c7da91e80c30a526a85ebf1c575749c337e4fee64abbcda8" exitCode=0
May 20 20:29:21.379001 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.378931    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz" event={"ID":"ab027928-e912-40fb-a0d5-58e094785f87","Type":"ContainerDied","Data":"e654b0a5f0bd7832c7da91e80c30a526a85ebf1c575749c337e4fee64abbcda8"}
May 20 20:29:21.515367 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.515346    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj"
May 20 20:29:21.543269 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.543247    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955"
May 20 20:29:21.650872 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.650776    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbxsf\" (UniqueName: \"kubernetes.io/projected/fd6af2fa-96f7-4621-ab43-bc95eaa91865-kube-api-access-lbxsf\") pod \"fd6af2fa-96f7-4621-ab43-bc95eaa91865\" (UID: \"fd6af2fa-96f7-4621-ab43-bc95eaa91865\") "
May 20 20:29:21.650872 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.650859    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/696c47a1-0faf-431e-b922-c8c4d171a118-bundle\") pod \"696c47a1-0faf-431e-b922-c8c4d171a118\" (UID: \"696c47a1-0faf-431e-b922-c8c4d171a118\") "
May 20 20:29:21.651145 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.650961    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4xq8\" (UniqueName: \"kubernetes.io/projected/696c47a1-0faf-431e-b922-c8c4d171a118-kube-api-access-t4xq8\") pod \"696c47a1-0faf-431e-b922-c8c4d171a118\" (UID: \"696c47a1-0faf-431e-b922-c8c4d171a118\") "
May 20 20:29:21.651145 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.651008    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd6af2fa-96f7-4621-ab43-bc95eaa91865-util\") pod \"fd6af2fa-96f7-4621-ab43-bc95eaa91865\" (UID: \"fd6af2fa-96f7-4621-ab43-bc95eaa91865\") "
May 20 20:29:21.651145 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.651031    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd6af2fa-96f7-4621-ab43-bc95eaa91865-bundle\") pod \"fd6af2fa-96f7-4621-ab43-bc95eaa91865\" (UID: \"fd6af2fa-96f7-4621-ab43-bc95eaa91865\") "
May 20 20:29:21.651145 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.651053    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/696c47a1-0faf-431e-b922-c8c4d171a118-util\") pod \"696c47a1-0faf-431e-b922-c8c4d171a118\" (UID: \"696c47a1-0faf-431e-b922-c8c4d171a118\") "
May 20 20:29:21.651493 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.651461    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/696c47a1-0faf-431e-b922-c8c4d171a118-bundle" (OuterVolumeSpecName: "bundle") pod "696c47a1-0faf-431e-b922-c8c4d171a118" (UID: "696c47a1-0faf-431e-b922-c8c4d171a118"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:29:21.651585 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.651524    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd6af2fa-96f7-4621-ab43-bc95eaa91865-bundle" (OuterVolumeSpecName: "bundle") pod "fd6af2fa-96f7-4621-ab43-bc95eaa91865" (UID: "fd6af2fa-96f7-4621-ab43-bc95eaa91865"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:29:21.653185 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.653157    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd6af2fa-96f7-4621-ab43-bc95eaa91865-kube-api-access-lbxsf" (OuterVolumeSpecName: "kube-api-access-lbxsf") pod "fd6af2fa-96f7-4621-ab43-bc95eaa91865" (UID: "fd6af2fa-96f7-4621-ab43-bc95eaa91865"). InnerVolumeSpecName "kube-api-access-lbxsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:29:21.653279 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.653191    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/696c47a1-0faf-431e-b922-c8c4d171a118-kube-api-access-t4xq8" (OuterVolumeSpecName: "kube-api-access-t4xq8") pod "696c47a1-0faf-431e-b922-c8c4d171a118" (UID: "696c47a1-0faf-431e-b922-c8c4d171a118"). InnerVolumeSpecName "kube-api-access-t4xq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:29:21.656293 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.656255    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/696c47a1-0faf-431e-b922-c8c4d171a118-util" (OuterVolumeSpecName: "util") pod "696c47a1-0faf-431e-b922-c8c4d171a118" (UID: "696c47a1-0faf-431e-b922-c8c4d171a118"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:29:21.656468 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.656450    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd6af2fa-96f7-4621-ab43-bc95eaa91865-util" (OuterVolumeSpecName: "util") pod "fd6af2fa-96f7-4621-ab43-bc95eaa91865" (UID: "fd6af2fa-96f7-4621-ab43-bc95eaa91865"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:29:21.751737 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.751702    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/696c47a1-0faf-431e-b922-c8c4d171a118-bundle\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:29:21.751737 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.751734    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4xq8\" (UniqueName: \"kubernetes.io/projected/696c47a1-0faf-431e-b922-c8c4d171a118-kube-api-access-t4xq8\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:29:21.751947 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.751749    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd6af2fa-96f7-4621-ab43-bc95eaa91865-util\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:29:21.751947 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.751763    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd6af2fa-96f7-4621-ab43-bc95eaa91865-bundle\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:29:21.751947 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.751773    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/696c47a1-0faf-431e-b922-c8c4d171a118-util\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:29:21.751947 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:21.751786    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbxsf\" (UniqueName: \"kubernetes.io/projected/fd6af2fa-96f7-4621-ab43-bc95eaa91865-kube-api-access-lbxsf\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:29:22.384033 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:22.384003    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955"
May 20 20:29:22.384033 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:22.384026    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955" event={"ID":"fd6af2fa-96f7-4621-ab43-bc95eaa91865","Type":"ContainerDied","Data":"7b5e06a40567475af7f4cb8bcdb8dd8b3ab165d0aef76a133ba73a9e76cf6ca6"}
May 20 20:29:22.384481 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:22.384058    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b5e06a40567475af7f4cb8bcdb8dd8b3ab165d0aef76a133ba73a9e76cf6ca6"
May 20 20:29:22.385764 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:22.385737    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj" event={"ID":"696c47a1-0faf-431e-b922-c8c4d171a118","Type":"ContainerDied","Data":"5f0f688750f0c2eddc0a81105af8a8bd60c56673ed42a1391fb302fbfe94f73c"}
May 20 20:29:22.385764 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:22.385759    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj"
May 20 20:29:22.385986 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:22.385769    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f0f688750f0c2eddc0a81105af8a8bd60c56673ed42a1391fb302fbfe94f73c"
May 20 20:29:22.512723 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:22.512694    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz"
May 20 20:29:22.660461 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:22.660376    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab027928-e912-40fb-a0d5-58e094785f87-bundle\") pod \"ab027928-e912-40fb-a0d5-58e094785f87\" (UID: \"ab027928-e912-40fb-a0d5-58e094785f87\") "
May 20 20:29:22.660461 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:22.660443    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab027928-e912-40fb-a0d5-58e094785f87-util\") pod \"ab027928-e912-40fb-a0d5-58e094785f87\" (UID: \"ab027928-e912-40fb-a0d5-58e094785f87\") "
May 20 20:29:22.660698 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:22.660579    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct4jh\" (UniqueName: \"kubernetes.io/projected/ab027928-e912-40fb-a0d5-58e094785f87-kube-api-access-ct4jh\") pod \"ab027928-e912-40fb-a0d5-58e094785f87\" (UID: \"ab027928-e912-40fb-a0d5-58e094785f87\") "
May 20 20:29:22.660962 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:22.660940    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab027928-e912-40fb-a0d5-58e094785f87-bundle" (OuterVolumeSpecName: "bundle") pod "ab027928-e912-40fb-a0d5-58e094785f87" (UID: "ab027928-e912-40fb-a0d5-58e094785f87"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:29:22.662669 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:22.662641    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab027928-e912-40fb-a0d5-58e094785f87-kube-api-access-ct4jh" (OuterVolumeSpecName: "kube-api-access-ct4jh") pod "ab027928-e912-40fb-a0d5-58e094785f87" (UID: "ab027928-e912-40fb-a0d5-58e094785f87"). InnerVolumeSpecName "kube-api-access-ct4jh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:29:22.666030 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:22.665990    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab027928-e912-40fb-a0d5-58e094785f87-util" (OuterVolumeSpecName: "util") pod "ab027928-e912-40fb-a0d5-58e094785f87" (UID: "ab027928-e912-40fb-a0d5-58e094785f87"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:29:22.762172 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:22.762133    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab027928-e912-40fb-a0d5-58e094785f87-util\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:29:22.762172 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:22.762167    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct4jh\" (UniqueName: \"kubernetes.io/projected/ab027928-e912-40fb-a0d5-58e094785f87-kube-api-access-ct4jh\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:29:22.762172 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:22.762177    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab027928-e912-40fb-a0d5-58e094785f87-bundle\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:29:23.391524 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:23.391493    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz" event={"ID":"ab027928-e912-40fb-a0d5-58e094785f87","Type":"ContainerDied","Data":"b4f37e0d88e34558bc60b30ee2c11987257482b439c2df8bdeb92d3b44d7aa14"}
May 20 20:29:23.391524 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:23.391528    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4f37e0d88e34558bc60b30ee2c11987257482b439c2df8bdeb92d3b44d7aa14"
May 20 20:29:23.391984 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:23.391533    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz"
May 20 20:29:39.109436 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109401    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg"]
May 20 20:29:39.109783 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109721    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0124fc3-4896-4717-8ca3-e1485f7d0095" containerName="util"
May 20 20:29:39.109783 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109731    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0124fc3-4896-4717-8ca3-e1485f7d0095" containerName="util"
May 20 20:29:39.109783 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109746    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab027928-e912-40fb-a0d5-58e094785f87" containerName="util"
May 20 20:29:39.109783 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109752    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab027928-e912-40fb-a0d5-58e094785f87" containerName="util"
May 20 20:29:39.109783 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109764    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd6af2fa-96f7-4621-ab43-bc95eaa91865" containerName="util"
May 20 20:29:39.109783 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109770    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd6af2fa-96f7-4621-ab43-bc95eaa91865" containerName="util"
May 20 20:29:39.109783 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109775    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="696c47a1-0faf-431e-b922-c8c4d171a118" containerName="util"
May 20 20:29:39.109783 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109780    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="696c47a1-0faf-431e-b922-c8c4d171a118" containerName="util"
May 20 20:29:39.109783 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109786    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab027928-e912-40fb-a0d5-58e094785f87" containerName="extract"
May 20 20:29:39.110098 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109791    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab027928-e912-40fb-a0d5-58e094785f87" containerName="extract"
May 20 20:29:39.110098 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109801    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0124fc3-4896-4717-8ca3-e1485f7d0095" containerName="extract"
May 20 20:29:39.110098 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109806    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0124fc3-4896-4717-8ca3-e1485f7d0095" containerName="extract"
May 20 20:29:39.110098 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109811    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="696c47a1-0faf-431e-b922-c8c4d171a118" containerName="pull"
May 20 20:29:39.110098 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109816    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="696c47a1-0faf-431e-b922-c8c4d171a118" containerName="pull"
May 20 20:29:39.110098 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109822    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="696c47a1-0faf-431e-b922-c8c4d171a118" containerName="extract"
May 20 20:29:39.110098 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109827    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="696c47a1-0faf-431e-b922-c8c4d171a118" containerName="extract"
May 20 20:29:39.110098 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109834    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd6af2fa-96f7-4621-ab43-bc95eaa91865" containerName="extract"
May 20 20:29:39.110098 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109839    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd6af2fa-96f7-4621-ab43-bc95eaa91865" containerName="extract"
May 20 20:29:39.110098 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109845    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0124fc3-4896-4717-8ca3-e1485f7d0095" containerName="pull"
May 20 20:29:39.110098 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109850    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0124fc3-4896-4717-8ca3-e1485f7d0095" containerName="pull"
May 20 20:29:39.110098 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109856    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd6af2fa-96f7-4621-ab43-bc95eaa91865" containerName="pull"
May 20 20:29:39.110098 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109860    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd6af2fa-96f7-4621-ab43-bc95eaa91865" containerName="pull"
May 20 20:29:39.110098 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109865    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab027928-e912-40fb-a0d5-58e094785f87" containerName="pull"
May 20 20:29:39.110098 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109869    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab027928-e912-40fb-a0d5-58e094785f87" containerName="pull"
May 20 20:29:39.110098 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109952    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0124fc3-4896-4717-8ca3-e1485f7d0095" containerName="extract"
May 20 20:29:39.110098 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109964    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="696c47a1-0faf-431e-b922-c8c4d171a118" containerName="extract"
May 20 20:29:39.110098 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109971    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="fd6af2fa-96f7-4621-ab43-bc95eaa91865" containerName="extract"
May 20 20:29:39.110098 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.109979    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="ab027928-e912-40fb-a0d5-58e094785f87" containerName="extract"
May 20 20:29:39.113038 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.113019    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg"
May 20 20:29:39.115690 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.115671    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 20 20:29:39.116563 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.116543    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 20 20:29:39.116652 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.116564    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6kvkl\""
May 20 20:29:39.124856 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.124827    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg"]
May 20 20:29:39.185765 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.185732    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmtjm\" (UniqueName: \"kubernetes.io/projected/e82194cb-31d8-46da-868e-c4b9efe4c864-kube-api-access-zmtjm\") pod \"limitador-operator-controller-manager-85c4996f8c-6jjrg\" (UID: \"e82194cb-31d8-46da-868e-c4b9efe4c864\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg"
May 20 20:29:39.286766 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.286724    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmtjm\" (UniqueName: \"kubernetes.io/projected/e82194cb-31d8-46da-868e-c4b9efe4c864-kube-api-access-zmtjm\") pod \"limitador-operator-controller-manager-85c4996f8c-6jjrg\" (UID: \"e82194cb-31d8-46da-868e-c4b9efe4c864\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg"
May 20 20:29:39.298229 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.298199    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmtjm\" (UniqueName: \"kubernetes.io/projected/e82194cb-31d8-46da-868e-c4b9efe4c864-kube-api-access-zmtjm\") pod \"limitador-operator-controller-manager-85c4996f8c-6jjrg\" (UID: \"e82194cb-31d8-46da-868e-c4b9efe4c864\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg"
May 20 20:29:39.425010 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.424921    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg"
May 20 20:29:39.560365 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:39.560339    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg"]
May 20 20:29:39.563335 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:29:39.563310    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode82194cb_31d8_46da_868e_c4b9efe4c864.slice/crio-4d18b5e195df4150d8ceeff488a72b0966514bb3b4eea158d3c3eaa64db6498a WatchSource:0}: Error finding container 4d18b5e195df4150d8ceeff488a72b0966514bb3b4eea158d3c3eaa64db6498a: Status 404 returned error can't find the container with id 4d18b5e195df4150d8ceeff488a72b0966514bb3b4eea158d3c3eaa64db6498a
May 20 20:29:40.461655 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:40.461622    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg" event={"ID":"e82194cb-31d8-46da-868e-c4b9efe4c864","Type":"ContainerStarted","Data":"4d18b5e195df4150d8ceeff488a72b0966514bb3b4eea158d3c3eaa64db6498a"}
May 20 20:29:42.470411 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:42.470377    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg" event={"ID":"e82194cb-31d8-46da-868e-c4b9efe4c864","Type":"ContainerStarted","Data":"bfda1c5b300f301b5bb97dec9e629c466dbcd584c8a25b08e9811d6ab8d017ac"}
May 20 20:29:42.470804 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:42.470468    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg"
May 20 20:29:42.498745 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:42.498698    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg" podStartSLOduration=1.6343244609999998 podStartE2EDuration="3.498685613s" podCreationTimestamp="2026-05-20 20:29:39 +0000 UTC" firstStartedPulling="2026-05-20 20:29:39.565649973 +0000 UTC m=+593.596815781" lastFinishedPulling="2026-05-20 20:29:41.430011124 +0000 UTC m=+595.461176933" observedRunningTime="2026-05-20 20:29:42.497542916 +0000 UTC m=+596.528708740" watchObservedRunningTime="2026-05-20 20:29:42.498685613 +0000 UTC m=+596.529851440"
May 20 20:29:53.476655 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:29:53.476625    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg"
May 20 20:30:02.902956 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:02.902921    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg"]
May 20 20:30:02.903359 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:02.903176    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg" podUID="e82194cb-31d8-46da-868e-c4b9efe4c864" containerName="manager" containerID="cri-o://bfda1c5b300f301b5bb97dec9e629c466dbcd584c8a25b08e9811d6ab8d017ac" gracePeriod=2
May 20 20:30:02.935938 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:02.935907    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg"]
May 20 20:30:02.953592 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:02.953563    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l8562"]
May 20 20:30:02.953942 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:02.953923    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e82194cb-31d8-46da-868e-c4b9efe4c864" containerName="manager"
May 20 20:30:02.953942 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:02.953939    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e82194cb-31d8-46da-868e-c4b9efe4c864" containerName="manager"
May 20 20:30:02.954100 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:02.954010    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="e82194cb-31d8-46da-868e-c4b9efe4c864" containerName="manager"
May 20 20:30:02.956841 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:02.956822    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l8562"
May 20 20:30:02.959726 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:02.959698    2566 status_manager.go:895] "Failed to get status for pod" podUID="1cac4d11-4f4a-4d17-a328-02e0c188bede" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l8562" err="pods \"limitador-operator-controller-manager-85c4996f8c-l8562\" is forbidden: User \"system:node:ip-10-0-129-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-75.ec2.internal' and this object"
May 20 20:30:03.022847 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.022817    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l8562"]
May 20 20:30:03.082710 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.082641    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lspt\" (UniqueName: \"kubernetes.io/projected/1cac4d11-4f4a-4d17-a328-02e0c188bede-kube-api-access-2lspt\") pod \"limitador-operator-controller-manager-85c4996f8c-l8562\" (UID: \"1cac4d11-4f4a-4d17-a328-02e0c188bede\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l8562"
May 20 20:30:03.145164 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.145139    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg"
May 20 20:30:03.179574 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.179494    2566 status_manager.go:895] "Failed to get status for pod" podUID="e82194cb-31d8-46da-868e-c4b9efe4c864" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg" err="pods \"limitador-operator-controller-manager-85c4996f8c-6jjrg\" is forbidden: User \"system:node:ip-10-0-129-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-75.ec2.internal' and this object"
May 20 20:30:03.183563 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.183538    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmtjm\" (UniqueName: \"kubernetes.io/projected/e82194cb-31d8-46da-868e-c4b9efe4c864-kube-api-access-zmtjm\") pod \"e82194cb-31d8-46da-868e-c4b9efe4c864\" (UID: \"e82194cb-31d8-46da-868e-c4b9efe4c864\") "
May 20 20:30:03.183770 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.183752    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2lspt\" (UniqueName: \"kubernetes.io/projected/1cac4d11-4f4a-4d17-a328-02e0c188bede-kube-api-access-2lspt\") pod \"limitador-operator-controller-manager-85c4996f8c-l8562\" (UID: \"1cac4d11-4f4a-4d17-a328-02e0c188bede\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l8562"
May 20 20:30:03.185498 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.185476    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e82194cb-31d8-46da-868e-c4b9efe4c864-kube-api-access-zmtjm" (OuterVolumeSpecName: "kube-api-access-zmtjm") pod "e82194cb-31d8-46da-868e-c4b9efe4c864" (UID: "e82194cb-31d8-46da-868e-c4b9efe4c864"). InnerVolumeSpecName "kube-api-access-zmtjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:30:03.194025 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.194001    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lspt\" (UniqueName: \"kubernetes.io/projected/1cac4d11-4f4a-4d17-a328-02e0c188bede-kube-api-access-2lspt\") pod \"limitador-operator-controller-manager-85c4996f8c-l8562\" (UID: \"1cac4d11-4f4a-4d17-a328-02e0c188bede\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l8562"
May 20 20:30:03.285209 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.285175    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmtjm\" (UniqueName: \"kubernetes.io/projected/e82194cb-31d8-46da-868e-c4b9efe4c864-kube-api-access-zmtjm\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:30:03.294977 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.294949    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l8562"
May 20 20:30:03.452247 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.452221    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l8562"]
May 20 20:30:03.453029 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:30:03.453005    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cac4d11_4f4a_4d17_a328_02e0c188bede.slice/crio-945b91cdfbe1c5cbaf75376bbcb1c02eab25637c8a3a80eb1494a05dec1c46c0 WatchSource:0}: Error finding container 945b91cdfbe1c5cbaf75376bbcb1c02eab25637c8a3a80eb1494a05dec1c46c0: Status 404 returned error can't find the container with id 945b91cdfbe1c5cbaf75376bbcb1c02eab25637c8a3a80eb1494a05dec1c46c0
May 20 20:30:03.547009 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.546979    2566 generic.go:358] "Generic (PLEG): container finished" podID="e82194cb-31d8-46da-868e-c4b9efe4c864" containerID="bfda1c5b300f301b5bb97dec9e629c466dbcd584c8a25b08e9811d6ab8d017ac" exitCode=0
May 20 20:30:03.547106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.547032    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg"
May 20 20:30:03.547106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.547074    2566 scope.go:117] "RemoveContainer" containerID="bfda1c5b300f301b5bb97dec9e629c466dbcd584c8a25b08e9811d6ab8d017ac"
May 20 20:30:03.548699 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.548671    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l8562" event={"ID":"1cac4d11-4f4a-4d17-a328-02e0c188bede","Type":"ContainerStarted","Data":"79c0bfa57a182a7b8398520b28a8bce67ee0102e0c6f4a1be744878aef0f3122"}
May 20 20:30:03.548800 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.548713    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l8562" event={"ID":"1cac4d11-4f4a-4d17-a328-02e0c188bede","Type":"ContainerStarted","Data":"945b91cdfbe1c5cbaf75376bbcb1c02eab25637c8a3a80eb1494a05dec1c46c0"}
May 20 20:30:03.548800 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.548775    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l8562"
May 20 20:30:03.549743 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.549722    2566 status_manager.go:895] "Failed to get status for pod" podUID="e82194cb-31d8-46da-868e-c4b9efe4c864" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg" err="pods \"limitador-operator-controller-manager-85c4996f8c-6jjrg\" is forbidden: User \"system:node:ip-10-0-129-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-75.ec2.internal' and this object"
May 20 20:30:03.555765 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.555750    2566 scope.go:117] "RemoveContainer" containerID="bfda1c5b300f301b5bb97dec9e629c466dbcd584c8a25b08e9811d6ab8d017ac"
May 20 20:30:03.556075 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:30:03.556054    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfda1c5b300f301b5bb97dec9e629c466dbcd584c8a25b08e9811d6ab8d017ac\": container with ID starting with bfda1c5b300f301b5bb97dec9e629c466dbcd584c8a25b08e9811d6ab8d017ac not found: ID does not exist" containerID="bfda1c5b300f301b5bb97dec9e629c466dbcd584c8a25b08e9811d6ab8d017ac"
May 20 20:30:03.556165 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.556080    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfda1c5b300f301b5bb97dec9e629c466dbcd584c8a25b08e9811d6ab8d017ac"} err="failed to get container status \"bfda1c5b300f301b5bb97dec9e629c466dbcd584c8a25b08e9811d6ab8d017ac\": rpc error: code = NotFound desc = could not find container \"bfda1c5b300f301b5bb97dec9e629c466dbcd584c8a25b08e9811d6ab8d017ac\": container with ID starting with bfda1c5b300f301b5bb97dec9e629c466dbcd584c8a25b08e9811d6ab8d017ac not found: ID does not exist"
May 20 20:30:03.583655 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.583629    2566 status_manager.go:895] "Failed to get status for pod" podUID="e82194cb-31d8-46da-868e-c4b9efe4c864" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg" err="pods \"limitador-operator-controller-manager-85c4996f8c-6jjrg\" is forbidden: User \"system:node:ip-10-0-129-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-75.ec2.internal' and this object"
May 20 20:30:03.590817 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.585849    2566 status_manager.go:895] "Failed to get status for pod" podUID="e82194cb-31d8-46da-868e-c4b9efe4c864" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jjrg" err="pods \"limitador-operator-controller-manager-85c4996f8c-6jjrg\" is forbidden: User \"system:node:ip-10-0-129-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-75.ec2.internal' and this object"
May 20 20:30:03.590817 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:03.587444    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l8562" podStartSLOduration=1.587428761 podStartE2EDuration="1.587428761s" podCreationTimestamp="2026-05-20 20:30:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:30:03.581123758 +0000 UTC m=+617.612289582" watchObservedRunningTime="2026-05-20 20:30:03.587428761 +0000 UTC m=+617.618594589"
May 20 20:30:04.556763 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:04.556730    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e82194cb-31d8-46da-868e-c4b9efe4c864" path="/var/lib/kubelet/pods/e82194cb-31d8-46da-868e-c4b9efe4c864/volumes"
May 20 20:30:14.557596 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:14.557569    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l8562"
May 20 20:30:35.917477 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:35.917444    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g4ssq"]
May 20 20:30:35.925278 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:35.924992    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-g4ssq"
May 20 20:30:35.928317 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:35.928292    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 20 20:30:35.929763 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:35.929744    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4sntc\""
May 20 20:30:35.934810 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:35.934788    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g4ssq"]
May 20 20:30:36.001188 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:36.001154    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g4ssq"]
May 20 20:30:36.071307 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:36.071276    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxj4j\" (UniqueName: \"kubernetes.io/projected/21f8b061-9829-4c21-b2f9-2aa205b117ce-kube-api-access-zxj4j\") pod \"limitador-limitador-7d549b5b-g4ssq\" (UID: \"21f8b061-9829-4c21-b2f9-2aa205b117ce\") " pod="kuadrant-system/limitador-limitador-7d549b5b-g4ssq"
May 20 20:30:36.071465 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:36.071362    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/21f8b061-9829-4c21-b2f9-2aa205b117ce-config-file\") pod \"limitador-limitador-7d549b5b-g4ssq\" (UID: \"21f8b061-9829-4c21-b2f9-2aa205b117ce\") " pod="kuadrant-system/limitador-limitador-7d549b5b-g4ssq"
May 20 20:30:36.172851 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:36.172760    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zxj4j\" (UniqueName: \"kubernetes.io/projected/21f8b061-9829-4c21-b2f9-2aa205b117ce-kube-api-access-zxj4j\") pod \"limitador-limitador-7d549b5b-g4ssq\" (UID: \"21f8b061-9829-4c21-b2f9-2aa205b117ce\") " pod="kuadrant-system/limitador-limitador-7d549b5b-g4ssq"
May 20 20:30:36.172851 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:36.172833    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/21f8b061-9829-4c21-b2f9-2aa205b117ce-config-file\") pod \"limitador-limitador-7d549b5b-g4ssq\" (UID: \"21f8b061-9829-4c21-b2f9-2aa205b117ce\") " pod="kuadrant-system/limitador-limitador-7d549b5b-g4ssq"
May 20 20:30:36.173403 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:36.173385    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/21f8b061-9829-4c21-b2f9-2aa205b117ce-config-file\") pod \"limitador-limitador-7d549b5b-g4ssq\" (UID: \"21f8b061-9829-4c21-b2f9-2aa205b117ce\") " pod="kuadrant-system/limitador-limitador-7d549b5b-g4ssq"
May 20 20:30:36.181592 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:36.181567    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxj4j\" (UniqueName: \"kubernetes.io/projected/21f8b061-9829-4c21-b2f9-2aa205b117ce-kube-api-access-zxj4j\") pod \"limitador-limitador-7d549b5b-g4ssq\" (UID: \"21f8b061-9829-4c21-b2f9-2aa205b117ce\") " pod="kuadrant-system/limitador-limitador-7d549b5b-g4ssq"
May 20 20:30:36.238534 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:36.238505    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-g4ssq"
May 20 20:30:36.384780 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:36.384671    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g4ssq"]
May 20 20:30:36.387067 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:30:36.387027    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f8b061_9829_4c21_b2f9_2aa205b117ce.slice/crio-1e92c265466aabd738a287aa6e157c75ca5861ce29ba199252292cc579aac1ed WatchSource:0}: Error finding container 1e92c265466aabd738a287aa6e157c75ca5861ce29ba199252292cc579aac1ed: Status 404 returned error can't find the container with id 1e92c265466aabd738a287aa6e157c75ca5861ce29ba199252292cc579aac1ed
May 20 20:30:36.690734 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:36.690689    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-g4ssq" event={"ID":"21f8b061-9829-4c21-b2f9-2aa205b117ce","Type":"ContainerStarted","Data":"1e92c265466aabd738a287aa6e157c75ca5861ce29ba199252292cc579aac1ed"}
May 20 20:30:39.704970 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:39.704928    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-g4ssq" event={"ID":"21f8b061-9829-4c21-b2f9-2aa205b117ce","Type":"ContainerStarted","Data":"f482ffe0689d676fe850016a3fb1f4fc598cc87396ddf32436e1daa8c44299d5"}
May 20 20:30:39.705366 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:39.705047    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-g4ssq"
May 20 20:30:39.726261 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:39.726212    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-g4ssq" podStartSLOduration=2.136826738 podStartE2EDuration="4.726196957s" podCreationTimestamp="2026-05-20 20:30:35 +0000 UTC" firstStartedPulling="2026-05-20 20:30:36.388992475 +0000 UTC m=+650.420158280" lastFinishedPulling="2026-05-20 20:30:38.978362691 +0000 UTC m=+653.009528499" observedRunningTime="2026-05-20 20:30:39.724128447 +0000 UTC m=+653.755294275" watchObservedRunningTime="2026-05-20 20:30:39.726196957 +0000 UTC m=+653.757362785"
May 20 20:30:50.710431 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:50.710394    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-g4ssq"
May 20 20:30:52.946581 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:52.946543    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g4ssq"]
May 20 20:30:52.947046 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:52.946801    2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-g4ssq" podUID="21f8b061-9829-4c21-b2f9-2aa205b117ce" containerName="limitador" containerID="cri-o://f482ffe0689d676fe850016a3fb1f4fc598cc87396ddf32436e1daa8c44299d5" gracePeriod=30
May 20 20:30:53.494154 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:53.494132    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-g4ssq"
May 20 20:30:53.507824 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:53.507762    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/21f8b061-9829-4c21-b2f9-2aa205b117ce-config-file\") pod \"21f8b061-9829-4c21-b2f9-2aa205b117ce\" (UID: \"21f8b061-9829-4c21-b2f9-2aa205b117ce\") "
May 20 20:30:53.507936 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:53.507827    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxj4j\" (UniqueName: \"kubernetes.io/projected/21f8b061-9829-4c21-b2f9-2aa205b117ce-kube-api-access-zxj4j\") pod \"21f8b061-9829-4c21-b2f9-2aa205b117ce\" (UID: \"21f8b061-9829-4c21-b2f9-2aa205b117ce\") "
May 20 20:30:53.508112 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:53.508088    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21f8b061-9829-4c21-b2f9-2aa205b117ce-config-file" (OuterVolumeSpecName: "config-file") pod "21f8b061-9829-4c21-b2f9-2aa205b117ce" (UID: "21f8b061-9829-4c21-b2f9-2aa205b117ce"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:30:53.509725 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:53.509708    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21f8b061-9829-4c21-b2f9-2aa205b117ce-kube-api-access-zxj4j" (OuterVolumeSpecName: "kube-api-access-zxj4j") pod "21f8b061-9829-4c21-b2f9-2aa205b117ce" (UID: "21f8b061-9829-4c21-b2f9-2aa205b117ce"). InnerVolumeSpecName "kube-api-access-zxj4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:30:53.608870 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:53.608835    2566 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/21f8b061-9829-4c21-b2f9-2aa205b117ce-config-file\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:30:53.608870 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:53.608866    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxj4j\" (UniqueName: \"kubernetes.io/projected/21f8b061-9829-4c21-b2f9-2aa205b117ce-kube-api-access-zxj4j\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:30:53.767353 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:53.767253    2566 generic.go:358] "Generic (PLEG): container finished" podID="21f8b061-9829-4c21-b2f9-2aa205b117ce" containerID="f482ffe0689d676fe850016a3fb1f4fc598cc87396ddf32436e1daa8c44299d5" exitCode=0
May 20 20:30:53.767353 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:53.767293    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-g4ssq" event={"ID":"21f8b061-9829-4c21-b2f9-2aa205b117ce","Type":"ContainerDied","Data":"f482ffe0689d676fe850016a3fb1f4fc598cc87396ddf32436e1daa8c44299d5"}
May 20 20:30:53.767353 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:53.767319    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-g4ssq"
May 20 20:30:53.767353 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:53.767330    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-g4ssq" event={"ID":"21f8b061-9829-4c21-b2f9-2aa205b117ce","Type":"ContainerDied","Data":"1e92c265466aabd738a287aa6e157c75ca5861ce29ba199252292cc579aac1ed"}
May 20 20:30:53.767353 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:53.767351    2566 scope.go:117] "RemoveContainer" containerID="f482ffe0689d676fe850016a3fb1f4fc598cc87396ddf32436e1daa8c44299d5"
May 20 20:30:53.776037 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:53.776016    2566 scope.go:117] "RemoveContainer" containerID="f482ffe0689d676fe850016a3fb1f4fc598cc87396ddf32436e1daa8c44299d5"
May 20 20:30:53.776267 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:30:53.776250    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f482ffe0689d676fe850016a3fb1f4fc598cc87396ddf32436e1daa8c44299d5\": container with ID starting with f482ffe0689d676fe850016a3fb1f4fc598cc87396ddf32436e1daa8c44299d5 not found: ID does not exist" containerID="f482ffe0689d676fe850016a3fb1f4fc598cc87396ddf32436e1daa8c44299d5"
May 20 20:30:53.776318 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:53.776274    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f482ffe0689d676fe850016a3fb1f4fc598cc87396ddf32436e1daa8c44299d5"} err="failed to get container status \"f482ffe0689d676fe850016a3fb1f4fc598cc87396ddf32436e1daa8c44299d5\": rpc error: code = NotFound desc = could not find container \"f482ffe0689d676fe850016a3fb1f4fc598cc87396ddf32436e1daa8c44299d5\": container with ID starting with f482ffe0689d676fe850016a3fb1f4fc598cc87396ddf32436e1daa8c44299d5 not found: ID does not exist"
May 20 20:30:53.794408 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:53.794382    2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g4ssq"]
May 20 20:30:53.799934 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:53.799914    2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-g4ssq"]
May 20 20:30:54.557428 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:54.557393    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21f8b061-9829-4c21-b2f9-2aa205b117ce" path="/var/lib/kubelet/pods/21f8b061-9829-4c21-b2f9-2aa205b117ce/volumes"
May 20 20:30:56.988194 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:56.988149    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-5g7x5"]
May 20 20:30:56.988681 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:56.988661    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f8b061-9829-4c21-b2f9-2aa205b117ce" containerName="limitador"
May 20 20:30:56.988752 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:56.988685    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f8b061-9829-4c21-b2f9-2aa205b117ce" containerName="limitador"
May 20 20:30:56.988806 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:56.988785    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="21f8b061-9829-4c21-b2f9-2aa205b117ce" containerName="limitador"
May 20 20:30:56.993023 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:56.993002    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-5g7x5"
May 20 20:30:56.995659 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:56.995633    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 20 20:30:56.995776 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:56.995724    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mww7f\""
May 20 20:30:57.006809 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:57.006776    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-5g7x5"]
May 20 20:30:57.034488 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:57.034455    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f014d003-ac8d-4ee5-9d9e-94b3698a4edb-data\") pod \"postgres-68c4fbbd6f-5g7x5\" (UID: \"f014d003-ac8d-4ee5-9d9e-94b3698a4edb\") " pod="opendatahub/postgres-68c4fbbd6f-5g7x5"
May 20 20:30:57.034673 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:57.034541    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d98g\" (UniqueName: \"kubernetes.io/projected/f014d003-ac8d-4ee5-9d9e-94b3698a4edb-kube-api-access-9d98g\") pod \"postgres-68c4fbbd6f-5g7x5\" (UID: \"f014d003-ac8d-4ee5-9d9e-94b3698a4edb\") " pod="opendatahub/postgres-68c4fbbd6f-5g7x5"
May 20 20:30:57.135178 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:57.135134    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f014d003-ac8d-4ee5-9d9e-94b3698a4edb-data\") pod \"postgres-68c4fbbd6f-5g7x5\" (UID: \"f014d003-ac8d-4ee5-9d9e-94b3698a4edb\") " pod="opendatahub/postgres-68c4fbbd6f-5g7x5"
May 20 20:30:57.135374 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:57.135226    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9d98g\" (UniqueName: \"kubernetes.io/projected/f014d003-ac8d-4ee5-9d9e-94b3698a4edb-kube-api-access-9d98g\") pod \"postgres-68c4fbbd6f-5g7x5\" (UID: \"f014d003-ac8d-4ee5-9d9e-94b3698a4edb\") " pod="opendatahub/postgres-68c4fbbd6f-5g7x5"
May 20 20:30:57.135512 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:57.135487    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f014d003-ac8d-4ee5-9d9e-94b3698a4edb-data\") pod \"postgres-68c4fbbd6f-5g7x5\" (UID: \"f014d003-ac8d-4ee5-9d9e-94b3698a4edb\") " pod="opendatahub/postgres-68c4fbbd6f-5g7x5"
May 20 20:30:57.147042 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:57.147014    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d98g\" (UniqueName: \"kubernetes.io/projected/f014d003-ac8d-4ee5-9d9e-94b3698a4edb-kube-api-access-9d98g\") pod \"postgres-68c4fbbd6f-5g7x5\" (UID: \"f014d003-ac8d-4ee5-9d9e-94b3698a4edb\") " pod="opendatahub/postgres-68c4fbbd6f-5g7x5"
May 20 20:30:57.311443 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:57.311358    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-5g7x5"
May 20 20:30:57.442872 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:57.442850    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-5g7x5"]
May 20 20:30:57.445036 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:30:57.445011    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf014d003_ac8d_4ee5_9d9e_94b3698a4edb.slice/crio-c5429b8d6cddb6b2dbee6275e60922a876498bd0740d6ec09d6e2f7369c2a89c WatchSource:0}: Error finding container c5429b8d6cddb6b2dbee6275e60922a876498bd0740d6ec09d6e2f7369c2a89c: Status 404 returned error can't find the container with id c5429b8d6cddb6b2dbee6275e60922a876498bd0740d6ec09d6e2f7369c2a89c
May 20 20:30:57.784853 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:30:57.784813    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-5g7x5" event={"ID":"f014d003-ac8d-4ee5-9d9e-94b3698a4edb","Type":"ContainerStarted","Data":"c5429b8d6cddb6b2dbee6275e60922a876498bd0740d6ec09d6e2f7369c2a89c"}
May 20 20:31:04.817704 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:04.817664    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-5g7x5" event={"ID":"f014d003-ac8d-4ee5-9d9e-94b3698a4edb","Type":"ContainerStarted","Data":"318d7ce3fcd0096d28792a23205c51f42242e36e1189eff3dd5ccdfb8a8904f4"}
May 20 20:31:04.818109 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:04.817792    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-5g7x5"
May 20 20:31:04.838374 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:04.838320    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-5g7x5" podStartSLOduration=2.5128302959999997 podStartE2EDuration="8.83830446s" podCreationTimestamp="2026-05-20 20:30:56 +0000 UTC" firstStartedPulling="2026-05-20 20:30:57.446641736 +0000 UTC m=+671.477807541" lastFinishedPulling="2026-05-20 20:31:03.77211589 +0000 UTC m=+677.803281705" observedRunningTime="2026-05-20 20:31:04.835473984 +0000 UTC m=+678.866639811" watchObservedRunningTime="2026-05-20 20:31:04.83830446 +0000 UTC m=+678.869470285"
May 20 20:31:10.850269 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:10.850241    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-5g7x5"
May 20 20:31:12.418752 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:12.418715    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf"]
May 20 20:31:12.428261 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:12.428236    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf"
May 20 20:31:12.430581 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:12.430549    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 20:31:12.430581 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:12.430566    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cf5mm\""
May 20 20:31:12.430805 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:12.430756    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf"]
May 20 20:31:12.431448 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:12.431432    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 20:31:12.567079 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:12.567044    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55e815d2-e87d-4780-89a7-0a8fcceba411-bundle\") pod \"7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf\" (UID: \"55e815d2-e87d-4780-89a7-0a8fcceba411\") " pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf"
May 20 20:31:12.567250 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:12.567095    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d5zh\" (UniqueName: \"kubernetes.io/projected/55e815d2-e87d-4780-89a7-0a8fcceba411-kube-api-access-8d5zh\") pod \"7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf\" (UID: \"55e815d2-e87d-4780-89a7-0a8fcceba411\") " pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf"
May 20 20:31:12.567250 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:12.567199    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55e815d2-e87d-4780-89a7-0a8fcceba411-util\") pod \"7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf\" (UID: \"55e815d2-e87d-4780-89a7-0a8fcceba411\") " pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf"
May 20 20:31:12.668336 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:12.668300    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55e815d2-e87d-4780-89a7-0a8fcceba411-util\") pod \"7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf\" (UID: \"55e815d2-e87d-4780-89a7-0a8fcceba411\") " pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf"
May 20 20:31:12.668520 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:12.668371    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55e815d2-e87d-4780-89a7-0a8fcceba411-bundle\") pod \"7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf\" (UID: \"55e815d2-e87d-4780-89a7-0a8fcceba411\") " pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf"
May 20 20:31:12.668520 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:12.668402    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8d5zh\" (UniqueName: \"kubernetes.io/projected/55e815d2-e87d-4780-89a7-0a8fcceba411-kube-api-access-8d5zh\") pod \"7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf\" (UID: \"55e815d2-e87d-4780-89a7-0a8fcceba411\") " pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf"
May 20 20:31:12.668687 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:12.668657    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55e815d2-e87d-4780-89a7-0a8fcceba411-util\") pod \"7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf\" (UID: \"55e815d2-e87d-4780-89a7-0a8fcceba411\") " pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf"
May 20 20:31:12.668789 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:12.668738    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55e815d2-e87d-4780-89a7-0a8fcceba411-bundle\") pod \"7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf\" (UID: \"55e815d2-e87d-4780-89a7-0a8fcceba411\") " pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf"
May 20 20:31:12.677435 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:12.677406    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d5zh\" (UniqueName: \"kubernetes.io/projected/55e815d2-e87d-4780-89a7-0a8fcceba411-kube-api-access-8d5zh\") pod \"7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf\" (UID: \"55e815d2-e87d-4780-89a7-0a8fcceba411\") " pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf"
May 20 20:31:12.739443 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:12.739412    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf"
May 20 20:31:12.871149 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:12.870994    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf"]
May 20 20:31:12.873923 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:31:12.873878    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55e815d2_e87d_4780_89a7_0a8fcceba411.slice/crio-a6caa56e53cc5663591784b07cbc2c9d151f1a05b4386fb039902c5598e77105 WatchSource:0}: Error finding container a6caa56e53cc5663591784b07cbc2c9d151f1a05b4386fb039902c5598e77105: Status 404 returned error can't find the container with id a6caa56e53cc5663591784b07cbc2c9d151f1a05b4386fb039902c5598e77105
May 20 20:31:13.854662 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:13.854629    2566 generic.go:358] "Generic (PLEG): container finished" podID="55e815d2-e87d-4780-89a7-0a8fcceba411" containerID="b2c81df4e2fe160c29088498af75f97c86811806524d5c427e09c7692207bf9a" exitCode=0
May 20 20:31:13.855073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:13.854713    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf" event={"ID":"55e815d2-e87d-4780-89a7-0a8fcceba411","Type":"ContainerDied","Data":"b2c81df4e2fe160c29088498af75f97c86811806524d5c427e09c7692207bf9a"}
May 20 20:31:13.855073 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:13.854755    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf" event={"ID":"55e815d2-e87d-4780-89a7-0a8fcceba411","Type":"ContainerStarted","Data":"a6caa56e53cc5663591784b07cbc2c9d151f1a05b4386fb039902c5598e77105"}
May 20 20:31:15.064628 ip-10-0-129-75 kubenswrapper[2566]: E0520 20:31:15.064599    2566 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55e815d2_e87d_4780_89a7_0a8fcceba411.slice/crio-058a08a2d7483382bb946a0efd488938a3fff8bc9864f7fd96a0c7a3ffb903fa.scope\": RecentStats: unable to find data in memory cache]"
May 20 20:31:15.870080 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:15.870039    2566 generic.go:358] "Generic (PLEG): container finished" podID="55e815d2-e87d-4780-89a7-0a8fcceba411" containerID="058a08a2d7483382bb946a0efd488938a3fff8bc9864f7fd96a0c7a3ffb903fa" exitCode=0
May 20 20:31:15.870286 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:15.870085    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf" event={"ID":"55e815d2-e87d-4780-89a7-0a8fcceba411","Type":"ContainerDied","Data":"058a08a2d7483382bb946a0efd488938a3fff8bc9864f7fd96a0c7a3ffb903fa"}
May 20 20:31:16.876036 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:16.875998    2566 generic.go:358] "Generic (PLEG): container finished" podID="55e815d2-e87d-4780-89a7-0a8fcceba411" containerID="3b0b6533dec545631ad99357598702bde93d32bee665be997db7fef8a06cd193" exitCode=0
May 20 20:31:16.876426 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:16.876046    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf" event={"ID":"55e815d2-e87d-4780-89a7-0a8fcceba411","Type":"ContainerDied","Data":"3b0b6533dec545631ad99357598702bde93d32bee665be997db7fef8a06cd193"}
May 20 20:31:18.019528 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:18.019506    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf"
May 20 20:31:18.117158 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:18.117129    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55e815d2-e87d-4780-89a7-0a8fcceba411-bundle\") pod \"55e815d2-e87d-4780-89a7-0a8fcceba411\" (UID: \"55e815d2-e87d-4780-89a7-0a8fcceba411\") "
May 20 20:31:18.117158 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:18.117161    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55e815d2-e87d-4780-89a7-0a8fcceba411-util\") pod \"55e815d2-e87d-4780-89a7-0a8fcceba411\" (UID: \"55e815d2-e87d-4780-89a7-0a8fcceba411\") "
May 20 20:31:18.117351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:18.117286    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8d5zh\" (UniqueName: \"kubernetes.io/projected/55e815d2-e87d-4780-89a7-0a8fcceba411-kube-api-access-8d5zh\") pod \"55e815d2-e87d-4780-89a7-0a8fcceba411\" (UID: \"55e815d2-e87d-4780-89a7-0a8fcceba411\") "
May 20 20:31:18.117626 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:18.117595    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55e815d2-e87d-4780-89a7-0a8fcceba411-bundle" (OuterVolumeSpecName: "bundle") pod "55e815d2-e87d-4780-89a7-0a8fcceba411" (UID: "55e815d2-e87d-4780-89a7-0a8fcceba411"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:31:18.119319 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:18.119296    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55e815d2-e87d-4780-89a7-0a8fcceba411-kube-api-access-8d5zh" (OuterVolumeSpecName: "kube-api-access-8d5zh") pod "55e815d2-e87d-4780-89a7-0a8fcceba411" (UID: "55e815d2-e87d-4780-89a7-0a8fcceba411"). InnerVolumeSpecName "kube-api-access-8d5zh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:31:18.123203 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:18.123170    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55e815d2-e87d-4780-89a7-0a8fcceba411-util" (OuterVolumeSpecName: "util") pod "55e815d2-e87d-4780-89a7-0a8fcceba411" (UID: "55e815d2-e87d-4780-89a7-0a8fcceba411"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:31:18.218507 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:18.218430    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8d5zh\" (UniqueName: \"kubernetes.io/projected/55e815d2-e87d-4780-89a7-0a8fcceba411-kube-api-access-8d5zh\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:31:18.218507 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:18.218459    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55e815d2-e87d-4780-89a7-0a8fcceba411-bundle\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:31:18.218507 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:18.218468    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55e815d2-e87d-4780-89a7-0a8fcceba411-util\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:31:18.885937 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:18.885908    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf"
May 20 20:31:18.886105 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:18.885913    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae1350rzxcf" event={"ID":"55e815d2-e87d-4780-89a7-0a8fcceba411","Type":"ContainerDied","Data":"a6caa56e53cc5663591784b07cbc2c9d151f1a05b4386fb039902c5598e77105"}
May 20 20:31:18.886105 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:18.886016    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6caa56e53cc5663591784b07cbc2c9d151f1a05b4386fb039902c5598e77105"
May 20 20:31:25.622284 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:25.622243    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-5c4df598dd-wz4qz"]
May 20 20:31:25.622770 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:25.622751    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55e815d2-e87d-4780-89a7-0a8fcceba411" containerName="pull"
May 20 20:31:25.622846 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:25.622774    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="55e815d2-e87d-4780-89a7-0a8fcceba411" containerName="pull"
May 20 20:31:25.622846 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:25.622788    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55e815d2-e87d-4780-89a7-0a8fcceba411" containerName="extract"
May 20 20:31:25.622846 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:25.622820    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="55e815d2-e87d-4780-89a7-0a8fcceba411" containerName="extract"
May 20 20:31:25.623042 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:25.622847    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55e815d2-e87d-4780-89a7-0a8fcceba411" containerName="util"
May 20 20:31:25.623042 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:25.622856    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="55e815d2-e87d-4780-89a7-0a8fcceba411" containerName="util"
May 20 20:31:25.623042 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:25.622966    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="55e815d2-e87d-4780-89a7-0a8fcceba411" containerName="extract"
May 20 20:31:25.627234 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:25.627215    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-5c4df598dd-wz4qz"
May 20 20:31:25.629789 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:25.629769    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
May 20 20:31:25.630937 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:25.630923    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-fzxkx\""
May 20 20:31:25.631034 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:25.630949    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
May 20 20:31:25.635196 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:25.635175    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-5c4df598dd-wz4qz"]
May 20 20:31:25.786672 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:25.786639    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cbxv\" (UniqueName: \"kubernetes.io/projected/053753bd-f2d1-400c-9ebd-110dd7b0dffc-kube-api-access-8cbxv\") pod \"keycloak-operator-5c4df598dd-wz4qz\" (UID: \"053753bd-f2d1-400c-9ebd-110dd7b0dffc\") " pod="keycloak-system/keycloak-operator-5c4df598dd-wz4qz"
May 20 20:31:25.887838 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:25.887759    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cbxv\" (UniqueName: \"kubernetes.io/projected/053753bd-f2d1-400c-9ebd-110dd7b0dffc-kube-api-access-8cbxv\") pod \"keycloak-operator-5c4df598dd-wz4qz\" (UID: \"053753bd-f2d1-400c-9ebd-110dd7b0dffc\") " pod="keycloak-system/keycloak-operator-5c4df598dd-wz4qz"
May 20 20:31:25.897930 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:25.897885    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cbxv\" (UniqueName: \"kubernetes.io/projected/053753bd-f2d1-400c-9ebd-110dd7b0dffc-kube-api-access-8cbxv\") pod \"keycloak-operator-5c4df598dd-wz4qz\" (UID: \"053753bd-f2d1-400c-9ebd-110dd7b0dffc\") " pod="keycloak-system/keycloak-operator-5c4df598dd-wz4qz"
May 20 20:31:25.938195 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:25.938166    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-5c4df598dd-wz4qz"
May 20 20:31:26.066318 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:26.066291    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-5c4df598dd-wz4qz"]
May 20 20:31:26.067684 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:31:26.067645    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod053753bd_f2d1_400c_9ebd_110dd7b0dffc.slice/crio-e3c5873ad7559e6f3e00f103dfecc4e9913db4c020d9540fd3e959a78894d87a WatchSource:0}: Error finding container e3c5873ad7559e6f3e00f103dfecc4e9913db4c020d9540fd3e959a78894d87a: Status 404 returned error can't find the container with id e3c5873ad7559e6f3e00f103dfecc4e9913db4c020d9540fd3e959a78894d87a
May 20 20:31:26.919541 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:26.919484    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-5c4df598dd-wz4qz" event={"ID":"053753bd-f2d1-400c-9ebd-110dd7b0dffc","Type":"ContainerStarted","Data":"e3c5873ad7559e6f3e00f103dfecc4e9913db4c020d9540fd3e959a78894d87a"}
May 20 20:31:32.946758 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:32.946715    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-5c4df598dd-wz4qz" event={"ID":"053753bd-f2d1-400c-9ebd-110dd7b0dffc","Type":"ContainerStarted","Data":"f970bec3a6bfe2297054a9e37a6c8e6954b2dfcdbda6f1fa38414035dd316a57"}
May 20 20:31:32.964811 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:31:32.964755    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-5c4df598dd-wz4qz" podStartSLOduration=1.7255103040000002 podStartE2EDuration="7.964739828s" podCreationTimestamp="2026-05-20 20:31:25 +0000 UTC" firstStartedPulling="2026-05-20 20:31:26.069095135 +0000 UTC m=+700.100260939" lastFinishedPulling="2026-05-20 20:31:32.308324644 +0000 UTC m=+706.339490463" observedRunningTime="2026-05-20 20:31:32.962108762 +0000 UTC m=+706.993274590" watchObservedRunningTime="2026-05-20 20:31:32.964739828 +0000 UTC m=+706.995905654"
May 20 20:33:58.833553 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:58.833518    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"]
May 20 20:33:58.836106 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:58.836083    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:33:58.839786 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:58.839764    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 20 20:33:58.839786 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:58.839777    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6ktj8\""
May 20 20:33:58.839982 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:58.839780    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 20 20:33:58.839982 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:58.839779    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 20 20:33:58.846421 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:58.846397    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"]
May 20 20:33:58.928089 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:58.928053    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkbdt\" (UniqueName: \"kubernetes.io/projected/201c27f3-08f9-495d-985c-b5d6dba9dbb3-kube-api-access-gkbdt\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z\" (UID: \"201c27f3-08f9-495d-985c-b5d6dba9dbb3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:33:58.928248 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:58.928094    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/201c27f3-08f9-495d-985c-b5d6dba9dbb3-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z\" (UID: \"201c27f3-08f9-495d-985c-b5d6dba9dbb3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:33:58.928248 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:58.928156    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/201c27f3-08f9-495d-985c-b5d6dba9dbb3-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z\" (UID: \"201c27f3-08f9-495d-985c-b5d6dba9dbb3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:33:58.928248 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:58.928187    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/201c27f3-08f9-495d-985c-b5d6dba9dbb3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z\" (UID: \"201c27f3-08f9-495d-985c-b5d6dba9dbb3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:33:58.928248 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:58.928208    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/201c27f3-08f9-495d-985c-b5d6dba9dbb3-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z\" (UID: \"201c27f3-08f9-495d-985c-b5d6dba9dbb3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:33:58.928248 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:58.928242    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/201c27f3-08f9-495d-985c-b5d6dba9dbb3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z\" (UID: \"201c27f3-08f9-495d-985c-b5d6dba9dbb3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:33:59.029340 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:59.029295    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gkbdt\" (UniqueName: \"kubernetes.io/projected/201c27f3-08f9-495d-985c-b5d6dba9dbb3-kube-api-access-gkbdt\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z\" (UID: \"201c27f3-08f9-495d-985c-b5d6dba9dbb3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:33:59.029534 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:59.029347    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/201c27f3-08f9-495d-985c-b5d6dba9dbb3-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z\" (UID: \"201c27f3-08f9-495d-985c-b5d6dba9dbb3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:33:59.029534 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:59.029399    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/201c27f3-08f9-495d-985c-b5d6dba9dbb3-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z\" (UID: \"201c27f3-08f9-495d-985c-b5d6dba9dbb3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:33:59.029534 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:59.029436    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/201c27f3-08f9-495d-985c-b5d6dba9dbb3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z\" (UID: \"201c27f3-08f9-495d-985c-b5d6dba9dbb3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:33:59.029534 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:59.029461    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/201c27f3-08f9-495d-985c-b5d6dba9dbb3-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z\" (UID: \"201c27f3-08f9-495d-985c-b5d6dba9dbb3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:33:59.029534 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:59.029515    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/201c27f3-08f9-495d-985c-b5d6dba9dbb3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z\" (UID: \"201c27f3-08f9-495d-985c-b5d6dba9dbb3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:33:59.029803 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:59.029763    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/201c27f3-08f9-495d-985c-b5d6dba9dbb3-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z\" (UID: \"201c27f3-08f9-495d-985c-b5d6dba9dbb3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:33:59.029861 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:59.029814    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/201c27f3-08f9-495d-985c-b5d6dba9dbb3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z\" (UID: \"201c27f3-08f9-495d-985c-b5d6dba9dbb3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:33:59.029942 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:59.029928    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/201c27f3-08f9-495d-985c-b5d6dba9dbb3-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z\" (UID: \"201c27f3-08f9-495d-985c-b5d6dba9dbb3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:33:59.031549 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:59.031531    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/201c27f3-08f9-495d-985c-b5d6dba9dbb3-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z\" (UID: \"201c27f3-08f9-495d-985c-b5d6dba9dbb3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:33:59.031998 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:59.031979    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/201c27f3-08f9-495d-985c-b5d6dba9dbb3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z\" (UID: \"201c27f3-08f9-495d-985c-b5d6dba9dbb3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:33:59.037970 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:59.037952    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkbdt\" (UniqueName: \"kubernetes.io/projected/201c27f3-08f9-495d-985c-b5d6dba9dbb3-kube-api-access-gkbdt\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z\" (UID: \"201c27f3-08f9-495d-985c-b5d6dba9dbb3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:33:59.147484 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:59.147456    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:33:59.282232 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:59.282207    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"]
May 20 20:33:59.283946 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:33:59.283915    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201c27f3_08f9_495d_985c_b5d6dba9dbb3.slice/crio-79d8c2373ecd998c374ffd9601b125e1c7881c1e2d9c84f4f25a15d1282cac4d WatchSource:0}: Error finding container 79d8c2373ecd998c374ffd9601b125e1c7881c1e2d9c84f4f25a15d1282cac4d: Status 404 returned error can't find the container with id 79d8c2373ecd998c374ffd9601b125e1c7881c1e2d9c84f4f25a15d1282cac4d
May 20 20:33:59.287496 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:59.286949    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 20:33:59.536830 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:33:59.536744    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z" event={"ID":"201c27f3-08f9-495d-985c-b5d6dba9dbb3","Type":"ContainerStarted","Data":"79d8c2373ecd998c374ffd9601b125e1c7881c1e2d9c84f4f25a15d1282cac4d"}
May 20 20:34:02.541848 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.541810    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"]
May 20 20:34:02.554731 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.554616    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:02.557410 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.557381    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 20 20:34:02.561459 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.561435    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"]
May 20 20:34:02.661965 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.661920    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdwts\" (UniqueName: \"kubernetes.io/projected/9fc7a54b-2918-4e5e-8e70-992428e1e10b-kube-api-access-mdwts\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv\" (UID: \"9fc7a54b-2918-4e5e-8e70-992428e1e10b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:02.661965 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.661967    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fc7a54b-2918-4e5e-8e70-992428e1e10b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv\" (UID: \"9fc7a54b-2918-4e5e-8e70-992428e1e10b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:02.662206 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.662045    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9fc7a54b-2918-4e5e-8e70-992428e1e10b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv\" (UID: \"9fc7a54b-2918-4e5e-8e70-992428e1e10b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:02.662206 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.662136    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fc7a54b-2918-4e5e-8e70-992428e1e10b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv\" (UID: \"9fc7a54b-2918-4e5e-8e70-992428e1e10b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:02.662206 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.662176    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fc7a54b-2918-4e5e-8e70-992428e1e10b-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv\" (UID: \"9fc7a54b-2918-4e5e-8e70-992428e1e10b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:02.662351 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.662304    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fc7a54b-2918-4e5e-8e70-992428e1e10b-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv\" (UID: \"9fc7a54b-2918-4e5e-8e70-992428e1e10b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:02.763500 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.763465    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fc7a54b-2918-4e5e-8e70-992428e1e10b-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv\" (UID: \"9fc7a54b-2918-4e5e-8e70-992428e1e10b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:02.763711 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.763540    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdwts\" (UniqueName: \"kubernetes.io/projected/9fc7a54b-2918-4e5e-8e70-992428e1e10b-kube-api-access-mdwts\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv\" (UID: \"9fc7a54b-2918-4e5e-8e70-992428e1e10b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:02.763711 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.763566    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fc7a54b-2918-4e5e-8e70-992428e1e10b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv\" (UID: \"9fc7a54b-2918-4e5e-8e70-992428e1e10b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:02.763711 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.763594    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9fc7a54b-2918-4e5e-8e70-992428e1e10b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv\" (UID: \"9fc7a54b-2918-4e5e-8e70-992428e1e10b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:02.763711 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.763633    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fc7a54b-2918-4e5e-8e70-992428e1e10b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv\" (UID: \"9fc7a54b-2918-4e5e-8e70-992428e1e10b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:02.763711 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.763658    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fc7a54b-2918-4e5e-8e70-992428e1e10b-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv\" (UID: \"9fc7a54b-2918-4e5e-8e70-992428e1e10b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:02.764059 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.764037    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9fc7a54b-2918-4e5e-8e70-992428e1e10b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv\" (UID: \"9fc7a54b-2918-4e5e-8e70-992428e1e10b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:02.764126 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.764106    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fc7a54b-2918-4e5e-8e70-992428e1e10b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv\" (UID: \"9fc7a54b-2918-4e5e-8e70-992428e1e10b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:02.764211 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.764187    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fc7a54b-2918-4e5e-8e70-992428e1e10b-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv\" (UID: \"9fc7a54b-2918-4e5e-8e70-992428e1e10b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:02.765995 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.765972    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fc7a54b-2918-4e5e-8e70-992428e1e10b-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv\" (UID: \"9fc7a54b-2918-4e5e-8e70-992428e1e10b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:02.766445 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.766420    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fc7a54b-2918-4e5e-8e70-992428e1e10b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv\" (UID: \"9fc7a54b-2918-4e5e-8e70-992428e1e10b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:02.773677 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.773656    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdwts\" (UniqueName: \"kubernetes.io/projected/9fc7a54b-2918-4e5e-8e70-992428e1e10b-kube-api-access-mdwts\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv\" (UID: \"9fc7a54b-2918-4e5e-8e70-992428e1e10b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:02.866875 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:02.866838    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:04.577410 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:04.577388    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"]
May 20 20:34:04.579241 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:34:04.579199    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc7a54b_2918_4e5e_8e70_992428e1e10b.slice/crio-dce6a93296549137644a501f292359ef0dbf9172728c7df088e03042b25f98a7 WatchSource:0}: Error finding container dce6a93296549137644a501f292359ef0dbf9172728c7df088e03042b25f98a7: Status 404 returned error can't find the container with id dce6a93296549137644a501f292359ef0dbf9172728c7df088e03042b25f98a7
May 20 20:34:05.566384 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:05.566334    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z" event={"ID":"201c27f3-08f9-495d-985c-b5d6dba9dbb3","Type":"ContainerStarted","Data":"41b0c8c48e038f2d7ad425ffc0169c5b5f7ca9279cb9952cfa7f01a38452bdfe"}
May 20 20:34:05.567671 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:05.567639    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv" event={"ID":"9fc7a54b-2918-4e5e-8e70-992428e1e10b","Type":"ContainerStarted","Data":"538dfb58a43a8071ce57b361e114a58ae63677c1a72d2c4a3799cfbaf4a882ed"}
May 20 20:34:05.567789 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:05.567678    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv" event={"ID":"9fc7a54b-2918-4e5e-8e70-992428e1e10b","Type":"ContainerStarted","Data":"dce6a93296549137644a501f292359ef0dbf9172728c7df088e03042b25f98a7"}
May 20 20:34:10.588679 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:10.588640    2566 generic.go:358] "Generic (PLEG): container finished" podID="201c27f3-08f9-495d-985c-b5d6dba9dbb3" containerID="41b0c8c48e038f2d7ad425ffc0169c5b5f7ca9279cb9952cfa7f01a38452bdfe" exitCode=0
May 20 20:34:10.589126 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:10.588773    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z" event={"ID":"201c27f3-08f9-495d-985c-b5d6dba9dbb3","Type":"ContainerDied","Data":"41b0c8c48e038f2d7ad425ffc0169c5b5f7ca9279cb9952cfa7f01a38452bdfe"}
May 20 20:34:12.602251 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:12.602213    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z" event={"ID":"201c27f3-08f9-495d-985c-b5d6dba9dbb3","Type":"ContainerStarted","Data":"ffe6da89b057d7823d5a66a58c859abf41a1ee60518ff712adfb5ba67ccd1092"}
May 20 20:34:12.602674 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:12.602460    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:34:12.627756 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:12.627694    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z" podStartSLOduration=2.104128082 podStartE2EDuration="14.627676024s" podCreationTimestamp="2026-05-20 20:33:58 +0000 UTC" firstStartedPulling="2026-05-20 20:33:59.287133998 +0000 UTC m=+853.318299817" lastFinishedPulling="2026-05-20 20:34:11.810681954 +0000 UTC m=+865.841847759" observedRunningTime="2026-05-20 20:34:12.624023205 +0000 UTC m=+866.655189032" watchObservedRunningTime="2026-05-20 20:34:12.627676024 +0000 UTC m=+866.658841851"
May 20 20:34:13.607772 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:13.607735    2566 generic.go:358] "Generic (PLEG): container finished" podID="9fc7a54b-2918-4e5e-8e70-992428e1e10b" containerID="538dfb58a43a8071ce57b361e114a58ae63677c1a72d2c4a3799cfbaf4a882ed" exitCode=0
May 20 20:34:13.608266 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:13.607808    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv" event={"ID":"9fc7a54b-2918-4e5e-8e70-992428e1e10b","Type":"ContainerDied","Data":"538dfb58a43a8071ce57b361e114a58ae63677c1a72d2c4a3799cfbaf4a882ed"}
May 20 20:34:14.613840 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:14.613803    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv" event={"ID":"9fc7a54b-2918-4e5e-8e70-992428e1e10b","Type":"ContainerStarted","Data":"290fa099d263e948770aa9da97f792cf5f9f26c8736ca2a81654998fb43b6e4d"}
May 20 20:34:14.614353 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:14.614031    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:34:14.635176 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:14.635129    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv" podStartSLOduration=12.431479596 podStartE2EDuration="12.635115455s" podCreationTimestamp="2026-05-20 20:34:02 +0000 UTC" firstStartedPulling="2026-05-20 20:34:13.608629976 +0000 UTC m=+867.639795781" lastFinishedPulling="2026-05-20 20:34:13.812265821 +0000 UTC m=+867.843431640" observedRunningTime="2026-05-20 20:34:14.632230348 +0000 UTC m=+868.663396193" watchObservedRunningTime="2026-05-20 20:34:14.635115455 +0000 UTC m=+868.666281302"
May 20 20:34:23.621644 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:23.621610    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z"
May 20 20:34:25.630972 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:34:25.630931    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv"
May 20 20:45:00.180591 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:45:00.180549    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29655165-l6n9k"]
May 20 20:45:00.183364 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:45:00.183341    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655165-l6n9k"
May 20 20:45:00.185859 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:45:00.185840    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7tt4d\""
May 20 20:45:00.216874 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:45:00.216841    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf6xq\" (UniqueName: \"kubernetes.io/projected/42f80c33-56f1-48b9-a99b-6f5ed15b872a-kube-api-access-bf6xq\") pod \"maas-api-key-cleanup-29655165-l6n9k\" (UID: \"42f80c33-56f1-48b9-a99b-6f5ed15b872a\") " pod="opendatahub/maas-api-key-cleanup-29655165-l6n9k"
May 20 20:45:00.239803 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:45:00.239775    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29655165-l6n9k"]
May 20 20:45:00.317630 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:45:00.317590    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bf6xq\" (UniqueName: \"kubernetes.io/projected/42f80c33-56f1-48b9-a99b-6f5ed15b872a-kube-api-access-bf6xq\") pod \"maas-api-key-cleanup-29655165-l6n9k\" (UID: \"42f80c33-56f1-48b9-a99b-6f5ed15b872a\") " pod="opendatahub/maas-api-key-cleanup-29655165-l6n9k"
May 20 20:45:00.327797 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:45:00.327772    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf6xq\" (UniqueName: \"kubernetes.io/projected/42f80c33-56f1-48b9-a99b-6f5ed15b872a-kube-api-access-bf6xq\") pod \"maas-api-key-cleanup-29655165-l6n9k\" (UID: \"42f80c33-56f1-48b9-a99b-6f5ed15b872a\") " pod="opendatahub/maas-api-key-cleanup-29655165-l6n9k"
May 20 20:45:00.494020 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:45:00.493934    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655165-l6n9k"
May 20 20:45:00.626643 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:45:00.626618    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29655165-l6n9k"]
May 20 20:45:00.628456 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:45:00.628422    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42f80c33_56f1_48b9_a99b_6f5ed15b872a.slice/crio-4b2cac2500e651be520cc7d6d5b381b9f60c6de8635805aaed45cb60a7e6c31c WatchSource:0}: Error finding container 4b2cac2500e651be520cc7d6d5b381b9f60c6de8635805aaed45cb60a7e6c31c: Status 404 returned error can't find the container with id 4b2cac2500e651be520cc7d6d5b381b9f60c6de8635805aaed45cb60a7e6c31c
May 20 20:45:00.630176 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:45:00.630160    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 20:45:01.194201 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:45:01.194163    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655165-l6n9k" event={"ID":"42f80c33-56f1-48b9-a99b-6f5ed15b872a","Type":"ContainerStarted","Data":"4b2cac2500e651be520cc7d6d5b381b9f60c6de8635805aaed45cb60a7e6c31c"}
May 20 20:45:04.210300 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:45:04.210262    2566 generic.go:358] "Generic (PLEG): container finished" podID="42f80c33-56f1-48b9-a99b-6f5ed15b872a" containerID="6c60231538a687e2a612a457c945ee34e6f553e80592e44ed72b0e300b764960" exitCode=0
May 20 20:45:04.210681 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:45:04.210354    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655165-l6n9k" event={"ID":"42f80c33-56f1-48b9-a99b-6f5ed15b872a","Type":"ContainerDied","Data":"6c60231538a687e2a612a457c945ee34e6f553e80592e44ed72b0e300b764960"}
May 20 20:45:05.346514 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:45:05.346492    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655165-l6n9k"
May 20 20:45:05.463177 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:45:05.463143    2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf6xq\" (UniqueName: \"kubernetes.io/projected/42f80c33-56f1-48b9-a99b-6f5ed15b872a-kube-api-access-bf6xq\") pod \"42f80c33-56f1-48b9-a99b-6f5ed15b872a\" (UID: \"42f80c33-56f1-48b9-a99b-6f5ed15b872a\") "
May 20 20:45:05.465316 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:45:05.465256    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42f80c33-56f1-48b9-a99b-6f5ed15b872a-kube-api-access-bf6xq" (OuterVolumeSpecName: "kube-api-access-bf6xq") pod "42f80c33-56f1-48b9-a99b-6f5ed15b872a" (UID: "42f80c33-56f1-48b9-a99b-6f5ed15b872a"). InnerVolumeSpecName "kube-api-access-bf6xq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:45:05.564614 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:45:05.564581    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf6xq\" (UniqueName: \"kubernetes.io/projected/42f80c33-56f1-48b9-a99b-6f5ed15b872a-kube-api-access-bf6xq\") on node \"ip-10-0-129-75.ec2.internal\" DevicePath \"\""
May 20 20:45:06.219800 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:45:06.219729    2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655165-l6n9k"
May 20 20:45:06.219800 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:45:06.219752    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655165-l6n9k" event={"ID":"42f80c33-56f1-48b9-a99b-6f5ed15b872a","Type":"ContainerDied","Data":"4b2cac2500e651be520cc7d6d5b381b9f60c6de8635805aaed45cb60a7e6c31c"}
May 20 20:45:06.219800 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:45:06.219786    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b2cac2500e651be520cc7d6d5b381b9f60c6de8635805aaed45cb60a7e6c31c"
May 20 20:57:41.730868 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:41.730838    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-4v2bl_40863c5f-dffa-4200-8e42-ae5904f31021/manager/0.log"
May 20 20:57:41.969988 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:41.969952    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29655165-l6n9k_42f80c33-56f1-48b9-a99b-6f5ed15b872a/cleanup/0.log"
May 20 20:57:42.208716 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:42.208662    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-ms5vg_8a76dafc-3562-42a2-b958-e97b002c3c38/manager/2.log"
May 20 20:57:42.443943 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:42.443858    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76c978b984-htgkn_7db08fad-6de1-4d67-af26-cccd922354e8/manager/0.log"
May 20 20:57:42.665325 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:42.665300    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-5g7x5_f014d003-ac8d-4ee5-9d9e-94b3698a4edb/postgres/0.log"
May 20 20:57:43.426558 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:43.426524    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj_696c47a1-0faf-431e-b922-c8c4d171a118/util/0.log"
May 20 20:57:43.433475 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:43.433436    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj_696c47a1-0faf-431e-b922-c8c4d171a118/pull/0.log"
May 20 20:57:43.439729 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:43.439696    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj_696c47a1-0faf-431e-b922-c8c4d171a118/extract/0.log"
May 20 20:57:43.547699 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:43.547673    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955_fd6af2fa-96f7-4621-ab43-bc95eaa91865/util/0.log"
May 20 20:57:43.554292 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:43.554266    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955_fd6af2fa-96f7-4621-ab43-bc95eaa91865/pull/0.log"
May 20 20:57:43.560483 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:43.560460    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955_fd6af2fa-96f7-4621-ab43-bc95eaa91865/extract/0.log"
May 20 20:57:43.674337 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:43.674310    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6_f0124fc3-4896-4717-8ca3-e1485f7d0095/util/0.log"
May 20 20:57:43.681597 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:43.681527    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6_f0124fc3-4896-4717-8ca3-e1485f7d0095/pull/0.log"
May 20 20:57:43.688338 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:43.688316    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6_f0124fc3-4896-4717-8ca3-e1485f7d0095/extract/0.log"
May 20 20:57:43.797329 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:43.797305    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz_ab027928-e912-40fb-a0d5-58e094785f87/util/0.log"
May 20 20:57:43.804653 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:43.804631    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz_ab027928-e912-40fb-a0d5-58e094785f87/pull/0.log"
May 20 20:57:43.811483 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:43.811460    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz_ab027928-e912-40fb-a0d5-58e094785f87/extract/0.log"
May 20 20:57:44.730974 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:44.730923    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-l8562_1cac4d11-4f4a-4d17-a328-02e0c188bede/manager/0.log"
May 20 20:57:45.187201 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:45.187170    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-5kq7c_b5f86e28-174c-4a97-851c-80ae9325ffc2/discovery/0.log"
May 20 20:57:45.400984 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:45.400954    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85ffd6857f-lsvwj_f069973d-5577-48f5-9442-3df65ff55f95/kube-auth-proxy/0.log"
May 20 20:57:45.734094 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:45.734065    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-749647ff5d-8v29b_eed2efee-a682-4683-9b34-4449d997843b/router/0.log"
May 20 20:57:46.177752 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:46.177721    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z_201c27f3-08f9-495d-985c-b5d6dba9dbb3/storage-initializer/0.log"
May 20 20:57:46.185663 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:46.185644    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-qff5z_201c27f3-08f9-495d-985c-b5d6dba9dbb3/main/0.log"
May 20 20:57:46.667112 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:46.667076    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv_9fc7a54b-2918-4e5e-8e70-992428e1e10b/storage-initializer/0.log"
May 20 20:57:46.686090 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:46.686064    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-dpxcv_9fc7a54b-2918-4e5e-8e70-992428e1e10b/main/0.log"
May 20 20:57:54.300237 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:54.300210    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-btjv5_137212f9-191f-4845-bf90-69a40a5f1ac0/global-pull-secret-syncer/0.log"
May 20 20:57:54.559842 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:54.559763    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tqwsz_11b13fe0-9674-4919-ad3a-65e936aebf4d/konnectivity-agent/0.log"
May 20 20:57:54.593247 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:54.593220    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-75.ec2.internal_acc2ea8a697df6df18f7e95b5c7362f2/haproxy/0.log"
May 20 20:57:57.841117 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:57.841082    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj_696c47a1-0faf-431e-b922-c8c4d171a118/extract/0.log"
May 20 20:57:57.881474 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:57.881444    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj_696c47a1-0faf-431e-b922-c8c4d171a118/util/0.log"
May 20 20:57:57.929241 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:57.929215    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lnmvj_696c47a1-0faf-431e-b922-c8c4d171a118/pull/0.log"
May 20 20:57:57.997521 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:57.997478    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955_fd6af2fa-96f7-4621-ab43-bc95eaa91865/extract/0.log"
May 20 20:57:58.054292 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:58.054263    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955_fd6af2fa-96f7-4621-ab43-bc95eaa91865/util/0.log"
May 20 20:57:58.093641 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:58.093541    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xk955_fd6af2fa-96f7-4621-ab43-bc95eaa91865/pull/0.log"
May 20 20:57:58.151838 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:58.151806    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6_f0124fc3-4896-4717-8ca3-e1485f7d0095/extract/0.log"
May 20 20:57:58.183178 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:58.183149    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6_f0124fc3-4896-4717-8ca3-e1485f7d0095/util/0.log"
May 20 20:57:58.219690 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:58.219667    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ms2h6_f0124fc3-4896-4717-8ca3-e1485f7d0095/pull/0.log"
May 20 20:57:58.258279 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:58.258232    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz_ab027928-e912-40fb-a0d5-58e094785f87/extract/0.log"
May 20 20:57:58.332570 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:58.332542    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz_ab027928-e912-40fb-a0d5-58e094785f87/util/0.log"
May 20 20:57:58.371089 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:58.371006    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1925bz_ab027928-e912-40fb-a0d5-58e094785f87/pull/0.log"
May 20 20:57:59.096950 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:57:59.096920    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-l8562_1cac4d11-4f4a-4d17-a328-02e0c188bede/manager/0.log"
May 20 20:58:00.469427 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:00.469395    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1895a777-02b2-4648-b215-8bcd867a544c/alertmanager/0.log"
May 20 20:58:00.510315 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:00.510281    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1895a777-02b2-4648-b215-8bcd867a544c/config-reloader/0.log"
May 20 20:58:00.552387 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:00.552360    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1895a777-02b2-4648-b215-8bcd867a544c/kube-rbac-proxy-web/0.log"
May 20 20:58:00.577955 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:00.577913    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1895a777-02b2-4648-b215-8bcd867a544c/kube-rbac-proxy/0.log"
May 20 20:58:00.600863 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:00.600837    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1895a777-02b2-4648-b215-8bcd867a544c/kube-rbac-proxy-metric/0.log"
May 20 20:58:00.627251 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:00.627232    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1895a777-02b2-4648-b215-8bcd867a544c/prom-label-proxy/0.log"
May 20 20:58:00.658770 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:00.658749    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1895a777-02b2-4648-b215-8bcd867a544c/init-config-reloader/0.log"
May 20 20:58:01.008179 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:01.008150    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-kngww_7485cb5e-0ab0-402c-a156-8f50b837f2e9/monitoring-plugin/0.log"
May 20 20:58:01.046828 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:01.046807    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5z82t_8ed9197d-241f-42d8-8659-c108228b25f7/node-exporter/0.log"
May 20 20:58:01.076302 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:01.076280    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5z82t_8ed9197d-241f-42d8-8659-c108228b25f7/kube-rbac-proxy/0.log"
May 20 20:58:01.106781 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:01.106763    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5z82t_8ed9197d-241f-42d8-8659-c108228b25f7/init-textfile/0.log"
May 20 20:58:01.635942 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:01.635915    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-kcw58_e0fc9ae2-95a2-429e-8520-ab39e2528804/prometheus-operator/0.log"
May 20 20:58:01.660532 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:01.660505    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-kcw58_e0fc9ae2-95a2-429e-8520-ab39e2528804/kube-rbac-proxy/0.log"
May 20 20:58:02.462321 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.462286    2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"]
May 20 20:58:02.462740 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.462722    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42f80c33-56f1-48b9-a99b-6f5ed15b872a" containerName="cleanup"
May 20 20:58:02.462830 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.462743    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="42f80c33-56f1-48b9-a99b-6f5ed15b872a" containerName="cleanup"
May 20 20:58:02.462884 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.462849    2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="42f80c33-56f1-48b9-a99b-6f5ed15b872a" containerName="cleanup"
May 20 20:58:02.465972 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.465951    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"
May 20 20:58:02.469774 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.469635    2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q87q4\"/\"default-dockercfg-8zml2\""
May 20 20:58:02.469774 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.469684    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q87q4\"/\"openshift-service-ca.crt\""
May 20 20:58:02.470873 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.470855    2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q87q4\"/\"kube-root-ca.crt\""
May 20 20:58:02.478698 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.478675    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"]
May 20 20:58:02.509485 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.509458    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce-podres\") pod \"perf-node-gather-daemonset-clzp2\" (UID: \"ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"
May 20 20:58:02.509656 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.509502    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce-lib-modules\") pod \"perf-node-gather-daemonset-clzp2\" (UID: \"ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"
May 20 20:58:02.509656 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.509611    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce-sys\") pod \"perf-node-gather-daemonset-clzp2\" (UID: \"ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"
May 20 20:58:02.509656 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.509637    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce-proc\") pod \"perf-node-gather-daemonset-clzp2\" (UID: \"ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"
May 20 20:58:02.509782 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.509667    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2jw2\" (UniqueName: \"kubernetes.io/projected/ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce-kube-api-access-f2jw2\") pod \"perf-node-gather-daemonset-clzp2\" (UID: \"ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"
May 20 20:58:02.610256 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.610223    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce-sys\") pod \"perf-node-gather-daemonset-clzp2\" (UID: \"ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"
May 20 20:58:02.610256 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.610259    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce-proc\") pod \"perf-node-gather-daemonset-clzp2\" (UID: \"ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"
May 20 20:58:02.610506 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.610283    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2jw2\" (UniqueName: \"kubernetes.io/projected/ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce-kube-api-access-f2jw2\") pod \"perf-node-gather-daemonset-clzp2\" (UID: \"ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"
May 20 20:58:02.610506 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.610318    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce-podres\") pod \"perf-node-gather-daemonset-clzp2\" (UID: \"ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"
May 20 20:58:02.610506 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.610342    2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce-lib-modules\") pod \"perf-node-gather-daemonset-clzp2\" (UID: \"ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"
May 20 20:58:02.610506 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.610351    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce-sys\") pod \"perf-node-gather-daemonset-clzp2\" (UID: \"ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"
May 20 20:58:02.610506 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.610352    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce-proc\") pod \"perf-node-gather-daemonset-clzp2\" (UID: \"ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"
May 20 20:58:02.610506 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.610473    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce-lib-modules\") pod \"perf-node-gather-daemonset-clzp2\" (UID: \"ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"
May 20 20:58:02.610506 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.610486    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce-podres\") pod \"perf-node-gather-daemonset-clzp2\" (UID: \"ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"
May 20 20:58:02.620182 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.620152    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2jw2\" (UniqueName: \"kubernetes.io/projected/ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce-kube-api-access-f2jw2\") pod \"perf-node-gather-daemonset-clzp2\" (UID: \"ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"
May 20 20:58:02.776519 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.776443    2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"
May 20 20:58:02.914208 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.914179    2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"]
May 20 20:58:02.915381 ip-10-0-129-75 kubenswrapper[2566]: W0520 20:58:02.915347    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podef12a6b4_22fa_4c12_90a3_c79b1f1e8dce.slice/crio-8a40f6ce7f833f27501cff2a816e0bfcea207cdf6cec92df24d7c0642309e160 WatchSource:0}: Error finding container 8a40f6ce7f833f27501cff2a816e0bfcea207cdf6cec92df24d7c0642309e160: Status 404 returned error can't find the container with id 8a40f6ce7f833f27501cff2a816e0bfcea207cdf6cec92df24d7c0642309e160
May 20 20:58:02.917036 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:02.917019    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 20:58:03.003948 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:03.003925    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-9rqk8_b77a7447-7dda-48f7-ae38-5aa565402fc3/networking-console-plugin/0.log"
May 20 20:58:03.312758 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:03.312725    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2" event={"ID":"ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce","Type":"ContainerStarted","Data":"7f664f8e21e8fec16c4489b88f4fa40404dac017235bfbc5d97b418c35e7c53f"}
May 20 20:58:03.312758 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:03.312759    2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2" event={"ID":"ef12a6b4-22fa-4c12-90a3-c79b1f1e8dce","Type":"ContainerStarted","Data":"8a40f6ce7f833f27501cff2a816e0bfcea207cdf6cec92df24d7c0642309e160"}
May 20 20:58:03.313001 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:03.312853    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"
May 20 20:58:03.353953 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:03.353911    2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2" podStartSLOduration=1.3538838499999999 podStartE2EDuration="1.35388385s" podCreationTimestamp="2026-05-20 20:58:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:58:03.3526754 +0000 UTC m=+2297.383841228" watchObservedRunningTime="2026-05-20 20:58:03.35388385 +0000 UTC m=+2297.385049689"
May 20 20:58:04.252430 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:04.252401    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74849c55b8-r7zgn_878b2382-6b64-42c2-8a19-c0066e293fa4/console/0.log"
May 20 20:58:05.795171 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:05.795140    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ptgqm_c2ece298-1b7c-43ed-a06d-4f0684ba0180/dns/0.log"
May 20 20:58:05.837406 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:05.837379    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ptgqm_c2ece298-1b7c-43ed-a06d-4f0684ba0180/kube-rbac-proxy/0.log"
May 20 20:58:05.885142 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:05.885112    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nkc5b_6cc19b57-f3ee-428d-a00e-b5ec641fd9bd/dns-node-resolver/0.log"
May 20 20:58:06.507731 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:06.507703    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rpxfx_8eed8f09-7a8b-414c-b186-0733b5881f70/node-ca/0.log"
May 20 20:58:07.521005 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:07.520976    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-5kq7c_b5f86e28-174c-4a97-851c-80ae9325ffc2/discovery/0.log"
May 20 20:58:07.580025 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:07.579999    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85ffd6857f-lsvwj_f069973d-5577-48f5-9442-3df65ff55f95/kube-auth-proxy/0.log"
May 20 20:58:07.754987 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:07.754958    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-749647ff5d-8v29b_eed2efee-a682-4683-9b34-4449d997843b/router/0.log"
May 20 20:58:08.365424 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:08.365398    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jx4zj_a60784d9-7267-4cdd-bfe1-9828b0ab3ee1/serve-healthcheck-canary/0.log"
May 20 20:58:08.940387 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:08.940354    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bgtlz_1490f9a1-4fa6-4042-8959-52e224a5823b/kube-rbac-proxy/0.log"
May 20 20:58:08.982142 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:08.982112    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bgtlz_1490f9a1-4fa6-4042-8959-52e224a5823b/exporter/0.log"
May 20 20:58:09.032032 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:09.032005    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bgtlz_1490f9a1-4fa6-4042-8959-52e224a5823b/extractor/0.log"
May 20 20:58:09.327285 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:09.327207    2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-clzp2"
May 20 20:58:11.487192 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:11.487111    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-4v2bl_40863c5f-dffa-4200-8e42-ae5904f31021/manager/0.log"
May 20 20:58:11.541511 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:11.541487    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29655165-l6n9k_42f80c33-56f1-48b9-a99b-6f5ed15b872a/cleanup/0.log"
May 20 20:58:11.646085 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:11.646058    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-ms5vg_8a76dafc-3562-42a2-b958-e97b002c3c38/manager/1.log"
May 20 20:58:11.668138 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:11.668107    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-ms5vg_8a76dafc-3562-42a2-b958-e97b002c3c38/manager/2.log"
May 20 20:58:11.773401 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:11.773312    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76c978b984-htgkn_7db08fad-6de1-4d67-af26-cccd922354e8/manager/0.log"
May 20 20:58:11.823627 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:11.823590    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-5g7x5_f014d003-ac8d-4ee5-9d9e-94b3698a4edb/postgres/0.log"
May 20 20:58:13.265794 ip-10-0-129-75 kubenswrapper[2566]: I0520 20:58:13.265763    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-jns6c_8d0c7939-640b-485e-8cf9-86de758b08c5/openshift-lws-operator/0.log"