May 21 21:21:27.443848 ip-10-0-129-28 systemd[1]: Starting Kubernetes Kubelet...
May 21 21:21:27.909378 ip-10-0-129-28 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 21:21:27.909378 ip-10-0-129-28 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 21 21:21:27.909378 ip-10-0-129-28 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 21:21:27.909378 ip-10-0-129-28 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 21 21:21:27.909378 ip-10-0-129-28 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 21:21:27.911079 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.910991    2559 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 21 21:21:27.916239 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916220    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 21:21:27.916239 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916235    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 21:21:27.916239 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916241    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 21:21:27.916239 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916245    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 21:21:27.916472 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916249    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 21:21:27.916472 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916253    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 21:21:27.916472 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916257    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 21:21:27.916472 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916261    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 21:21:27.916472 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916265    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 21:21:27.916472 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916268    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 21:21:27.916472 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916272    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 21:21:27.916472 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916276    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 21:21:27.916472 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916280    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 21:21:27.916472 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916284    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 21:21:27.916472 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916295    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 21:21:27.916472 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916299    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 21:21:27.916472 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916303    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 21:21:27.916472 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916307    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 21:21:27.916472 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916310    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 21:21:27.916472 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916314    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 21:21:27.916472 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916318    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 21:21:27.916472 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916322    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 21:21:27.916472 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916326    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 21:21:27.916472 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916330    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 21:21:27.917247 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916333    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 21:21:27.917247 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916337    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 21:21:27.917247 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916341    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 21:21:27.917247 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916345    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 21:21:27.917247 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916348    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 21:21:27.917247 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916352    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 21:21:27.917247 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916356    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 21:21:27.917247 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916360    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 21:21:27.917247 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916364    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 21:21:27.917247 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916368    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 21:21:27.917247 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916373    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 21:21:27.917247 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916377    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 21:21:27.917247 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916381    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 21:21:27.917247 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916387    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 21:21:27.917247 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916392    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 21:21:27.917247 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916397    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 21:21:27.917247 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916401    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 21:21:27.917247 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916406    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 21:21:27.917247 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916410    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 21:21:27.917790 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916415    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 21:21:27.917790 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916419    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 21:21:27.917790 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916423    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 21:21:27.917790 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916427    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 21 21:21:27.917790 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916432    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 21:21:27.917790 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916437    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 21:21:27.917790 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916441    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 21:21:27.917790 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916446    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 21:21:27.917790 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916452    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 21:21:27.917790 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916457    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 21:21:27.917790 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916461    2559 feature_gate.go:328] unrecognized feature gate: Example
May 21 21:21:27.917790 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916465    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 21:21:27.917790 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916469    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 21:21:27.917790 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916473    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 21:21:27.917790 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916477    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 21:21:27.917790 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916482    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 21:21:27.917790 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916486    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 21:21:27.917790 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916490    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 21:21:27.917790 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916494    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 21:21:27.917790 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916498    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 21:21:27.918290 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916502    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 21:21:27.918290 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916507    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 21:21:27.918290 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916511    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 21:21:27.918290 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916516    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 21:21:27.918290 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916520    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 21:21:27.918290 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916524    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 21:21:27.918290 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916529    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 21:21:27.918290 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916533    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 21:21:27.918290 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916538    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 21:21:27.918290 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916542    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 21:21:27.918290 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916546    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 21:21:27.918290 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916555    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 21:21:27.918290 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916562    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 21:21:27.918290 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916566    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 21:21:27.918290 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916570    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 21:21:27.918290 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916574    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 21:21:27.918290 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916578    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 21:21:27.918290 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916598    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 21:21:27.918290 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916607    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 21:21:27.918988 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916613    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 21:21:27.918988 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916618    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 21:21:27.918988 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916623    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 21:21:27.918988 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.916628    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 21:21:27.918988 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918679    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 21:21:27.918988 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918690    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 21:21:27.918988 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918695    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 21:21:27.918988 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918700    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 21:21:27.918988 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918706    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 21:21:27.918988 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918710    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 21:21:27.918988 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918715    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 21:21:27.918988 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918719    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 21:21:27.918988 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918723    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 21:21:27.918988 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918727    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 21:21:27.918988 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918731    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 21:21:27.918988 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918735    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 21 21:21:27.918988 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918739    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 21:21:27.918988 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918744    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 21:21:27.918988 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918748    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 21:21:27.918988 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918752    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 21:21:27.919879 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918756    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 21:21:27.919879 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918761    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 21:21:27.919879 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918765    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 21:21:27.919879 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918769    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 21:21:27.919879 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918773    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 21:21:27.919879 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918778    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 21:21:27.919879 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918782    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 21:21:27.919879 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918786    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 21:21:27.919879 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918790    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 21:21:27.919879 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918795    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 21:21:27.919879 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918800    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 21:21:27.919879 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918804    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 21:21:27.919879 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918808    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 21:21:27.919879 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918811    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 21:21:27.919879 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918816    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 21:21:27.919879 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918820    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 21:21:27.919879 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918824    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 21:21:27.919879 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918828    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 21:21:27.919879 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918832    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 21:21:27.920756 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918837    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 21:21:27.920756 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918841    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 21:21:27.920756 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918845    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 21:21:27.920756 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918851    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 21:21:27.920756 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918856    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 21:21:27.920756 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918861    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 21:21:27.920756 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918865    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 21:21:27.920756 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918869    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 21:21:27.920756 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918874    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 21:21:27.920756 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918879    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 21:21:27.920756 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918883    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 21:21:27.920756 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918887    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 21:21:27.920756 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918892    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 21:21:27.920756 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918896    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 21:21:27.920756 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918900    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 21:21:27.920756 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918904    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 21:21:27.920756 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918908    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 21:21:27.920756 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918913    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 21:21:27.920756 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918921    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 21:21:27.921487 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918928    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 21:21:27.921487 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918932    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 21:21:27.921487 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918936    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 21:21:27.921487 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918940    2559 feature_gate.go:328] unrecognized feature gate: Example
May 21 21:21:27.921487 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918944    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 21:21:27.921487 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918950    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 21:21:27.921487 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918955    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 21:21:27.921487 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918959    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 21:21:27.921487 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918963    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 21:21:27.921487 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918967    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 21:21:27.921487 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918971    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 21:21:27.921487 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918975    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 21:21:27.921487 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918980    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 21:21:27.921487 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918984    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 21:21:27.921487 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918987    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 21:21:27.921487 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918991    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 21:21:27.921487 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918995    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 21:21:27.921487 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.918999    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 21:21:27.921487 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.919003    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 21:21:27.921487 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.919007    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.919011    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.919016    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.919022    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.919027    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.919032    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.919036    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.919040    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.919044    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.919048    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.919052    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.919057    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.919062    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919158    2559 flags.go:64] FLAG: --address="0.0.0.0"
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919176    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919187    2559 flags.go:64] FLAG: --anonymous-auth="true"
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919194    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919201    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919207    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919221    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919233    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 21 21:21:27.922068 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919238    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919243    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919249    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919255    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919260    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919265    2559 flags.go:64] FLAG: --cgroup-root=""
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919270    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919275    2559 flags.go:64] FLAG: --client-ca-file=""
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919280    2559 flags.go:64] FLAG: --cloud-config=""
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919285    2559 flags.go:64] FLAG: --cloud-provider="external"
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919291    2559 flags.go:64] FLAG: --cluster-dns="[]"
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919297    2559 flags.go:64] FLAG: --cluster-domain=""
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919302    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919307    2559 flags.go:64] FLAG: --config-dir=""
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919312    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919318    2559 flags.go:64] FLAG: --container-log-max-files="5"
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919325    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919330    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919336    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919341    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919346    2559 flags.go:64] FLAG: --contention-profiling="false"
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919351    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919356    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919361    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919366    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 21 21:21:27.922622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919373    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919378    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919383    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919388    2559 flags.go:64] FLAG: --enable-load-reader="false"
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919393    2559 flags.go:64] FLAG: --enable-server="true"
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919397    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919407    2559 flags.go:64] FLAG: --event-burst="100"
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919412    2559 flags.go:64] FLAG: --event-qps="50"
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919416    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919421    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919426    2559 flags.go:64] FLAG: --eviction-hard=""
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919435    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919441    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919446    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919453    2559 flags.go:64] FLAG: --eviction-soft=""
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919458    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919463    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919468    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919474    2559 flags.go:64] FLAG: --experimental-mounter-path=""
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919479    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919484    2559 flags.go:64] FLAG: --fail-swap-on="true"
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919489    2559 flags.go:64] FLAG: --feature-gates=""
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919496    2559 flags.go:64] FLAG: --file-check-frequency="20s"
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919501    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919506    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 21 21:21:27.923229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919511    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919516    2559 flags.go:64] FLAG: --healthz-port="10248"
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919522    2559 flags.go:64] FLAG: --help="false"
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919526    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-129-28.ec2.internal"
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919531    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919537    2559 flags.go:64] FLAG: --http-check-frequency="20s"
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919542    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919548    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919554    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919559    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919564    2559 flags.go:64] FLAG: --image-service-endpoint=""
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919569    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919574    2559 flags.go:64] FLAG: --kube-api-burst="100"
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919580    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919604    2559 flags.go:64] FLAG: --kube-api-qps="50"
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919610    2559 flags.go:64] FLAG: --kube-reserved=""
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919615    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919620    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919625    2559 flags.go:64] FLAG: --kubelet-cgroups=""
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919629    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919634    2559 flags.go:64] FLAG: --lock-file=""
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919639    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919643    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919649    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 21 21:21:27.923844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919658    2559 flags.go:64] FLAG: --log-json-split-stream="false"
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919663    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919668    2559 flags.go:64] FLAG: --log-text-split-stream="false"
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919673    2559 flags.go:64] FLAG: --logging-format="text"
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919677    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919683    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919688    2559 flags.go:64] FLAG: --manifest-url=""
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919693    2559 flags.go:64] FLAG: --manifest-url-header=""
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919700    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919705    2559 flags.go:64] FLAG: --max-open-files="1000000"
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919712    2559 flags.go:64] FLAG: --max-pods="110"
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919716    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919721    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919726    2559 flags.go:64] FLAG: --memory-manager-policy="None"
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919731    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919736    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919741    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919749    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919761    2559 flags.go:64] FLAG: --node-status-max-images="50"
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919766    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919771    2559 flags.go:64] FLAG: --oom-score-adj="-999"
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919776    2559 flags.go:64] FLAG: --pod-cidr=""
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919781    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 21 21:21:27.924428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919790    2559 flags.go:64] FLAG: --pod-manifest-path=""
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919795    2559 flags.go:64] FLAG: --pod-max-pids="-1"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919800    2559 flags.go:64] FLAG: --pods-per-core="0"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919805    2559 flags.go:64] FLAG: --port="10250"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919810    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919814    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-089b5822b951ff446"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919820    2559 flags.go:64] FLAG: --qos-reserved=""
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919825    2559 flags.go:64] FLAG: --read-only-port="10255"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919829    2559 flags.go:64] FLAG: --register-node="true"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919834    2559 flags.go:64] FLAG: --register-schedulable="true"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919842    2559 flags.go:64] FLAG: --register-with-taints=""
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919849    2559 flags.go:64] FLAG: --registry-burst="10"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919853    2559 flags.go:64] FLAG: --registry-qps="5"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919858    2559 flags.go:64] FLAG: --reserved-cpus=""
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919863    2559 flags.go:64] FLAG: --reserved-memory=""
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919869    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919874    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919878    2559 flags.go:64] FLAG: --rotate-certificates="false"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919883    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919887    2559 flags.go:64] FLAG: --runonce="false"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919891    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919897    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919902    2559 flags.go:64] FLAG: --seccomp-default="false"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919906    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919911    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919916    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 21 21:21:27.925010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919927    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919932    2559 flags.go:64] FLAG: --storage-driver-password="root"
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919937    2559 flags.go:64] FLAG: --storage-driver-secure="false"
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919942    2559 flags.go:64] FLAG: --storage-driver-table="stats"
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919946    2559 flags.go:64] FLAG: --storage-driver-user="root"
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919951    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919956    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919962    2559 flags.go:64] FLAG: --system-cgroups=""
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919968    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919977    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919981    2559 flags.go:64] FLAG: --tls-cert-file=""
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919986    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919993    2559 flags.go:64] FLAG: --tls-min-version=""
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.919998    2559 flags.go:64] FLAG: --tls-private-key-file=""
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.920003    2559 flags.go:64] FLAG: --topology-manager-policy="none"
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.920008    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.920014    2559 flags.go:64] FLAG: --topology-manager-scope="container"
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.920019    2559 flags.go:64] FLAG: --v="2"
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.920026    2559 flags.go:64] FLAG: --version="false"
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.920033    2559 flags.go:64] FLAG: --vmodule=""
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.920039    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.920045    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920198    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920205    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 21:21:27.925651 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920209    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 21:21:27.926243 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920213    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 21:21:27.926243 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920218    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 21:21:27.926243 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920223    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 21:21:27.926243 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920227    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 21:21:27.926243 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920232    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 21:21:27.926243 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920236    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 21:21:27.926243 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920240    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 21:21:27.926243 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920246    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 21:21:27.926243 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920250    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 21:21:27.926243 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920254    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 21:21:27.926243 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920258    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 21:21:27.926243 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920262    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 21:21:27.926243 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920267    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 21:21:27.926243 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920271    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 21:21:27.926243 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920275    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 21:21:27.926243 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920280    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 21:21:27.926243 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920284    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 21:21:27.926243 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920288    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 21:21:27.926243 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920293    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 21:21:27.926243 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920297    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 21:21:27.926805 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920301    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 21:21:27.926805 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920305    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 21:21:27.926805 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920310    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 21:21:27.926805 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920315    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 21:21:27.926805 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920320    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 21:21:27.926805 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920324    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 21:21:27.926805 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920328    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 21:21:27.926805 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920332    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 21:21:27.926805 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920337    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 21:21:27.926805 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920341    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 21:21:27.926805 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920345    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 21:21:27.926805 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920349    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 21:21:27.926805 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920353    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 21:21:27.926805 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920357    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 21:21:27.926805 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920361    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 21:21:27.926805 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920366    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 21:21:27.926805 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920369    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 21:21:27.926805 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920374    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 21:21:27.926805 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920378    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 21:21:27.927271 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920383    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 21:21:27.927271 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920387    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 21:21:27.927271 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920392    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 21:21:27.927271 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920396    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 21:21:27.927271 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920400    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 21:21:27.927271 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920404    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 21:21:27.927271 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920408    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 21:21:27.927271 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920413    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 21:21:27.927271 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920416    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 21:21:27.927271 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920428    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 21:21:27.927271 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920433    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 21:21:27.927271 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920437    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 21:21:27.927271 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920441    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 21:21:27.927271 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920445    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 21:21:27.927271 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920449    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 21:21:27.927271 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920453    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 21:21:27.927271 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920459    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 21:21:27.927271 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920463    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 21:21:27.927271 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920468    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 21:21:27.927271 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920472    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 21:21:27.928124 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920476    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 21:21:27.928124 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920480    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 21:21:27.928124 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920484    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 21:21:27.928124 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920488    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 21:21:27.928124 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920492    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 21:21:27.928124 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920498    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 21:21:27.928124 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920502    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 21:21:27.928124 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920506    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 21:21:27.928124 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920510    2559 feature_gate.go:328] unrecognized feature gate: Example
May 21 21:21:27.928124 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920514    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 21:21:27.928124 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920518    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 21:21:27.928124 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920522    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 21:21:27.928124 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920531    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 21:21:27.928124 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920537    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 21:21:27.928124 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920542    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 21:21:27.928124 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920547    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 21:21:27.928124 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920553    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 21:21:27.928124 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920560    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 21:21:27.928124 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920565    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 21 21:21:27.928124 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920570    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 21:21:27.929069 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920575    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 21:21:27.929069 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920579    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 21:21:27.929069 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920661    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 21:21:27.929069 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.920725    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 21:21:27.929069 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.922139    2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 21:21:27.929350 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.929329    2559 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 21 21:21:27.929407 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.929353    2559 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 21 21:21:27.929455 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929427    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 21:21:27.929455 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929434    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 21:21:27.929455 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929440    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 21:21:27.929455 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929444    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 21:21:27.929455 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929449    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 21:21:27.929455 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929453    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 21:21:27.929455 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929457    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 21:21:27.929788 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929462    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 21:21:27.929788 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929466    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 21:21:27.929788 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929470    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 21:21:27.929788 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929475    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 21:21:27.929788 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929479    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 21:21:27.929788 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929483    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 21:21:27.929788 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929487    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 21:21:27.929788 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929491    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 21:21:27.929788 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929495    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 21:21:27.929788 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929499    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 21:21:27.929788 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929504    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 21:21:27.929788 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929508    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 21:21:27.929788 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929512    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 21:21:27.929788 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929517    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 21:21:27.929788 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929522    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 21:21:27.929788 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929526    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 21:21:27.929788 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929530    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 21:21:27.929788 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929535    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 21:21:27.929788 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929540    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 21:21:27.929788 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929543    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 21:21:27.930623 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929548    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 21:21:27.930623 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929551    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 21:21:27.930623 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929555    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 21:21:27.930623 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929559    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 21:21:27.930623 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929564    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 21:21:27.930623 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929568    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 21:21:27.930623 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929573    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 21:21:27.930623 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929578    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 21:21:27.930623 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929582    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 21:21:27.930623 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929602    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 21:21:27.930623 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929606    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 21:21:27.930623 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929611    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 21:21:27.930623 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929615    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 21:21:27.930623 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929620    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 21:21:27.930623 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929624    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 21:21:27.930623 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929628    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 21:21:27.930623 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929633    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 21:21:27.930623 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929637    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 21:21:27.930623 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929642    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 21:21:27.930623 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929646    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 21:21:27.931120 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929650    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 21:21:27.931120 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929655    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 21:21:27.931120 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929659    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 21:21:27.931120 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929664    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 21:21:27.931120 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929668    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 21:21:27.931120 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929673    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 21:21:27.931120 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929680    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 21:21:27.931120 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929686    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 21:21:27.931120 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929691    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 21:21:27.931120 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929696    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 21:21:27.931120 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929700    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 21:21:27.931120 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929705    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 21:21:27.931120 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929709    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 21:21:27.931120 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929713    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 21:21:27.931120 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929718    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 21:21:27.931120 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929722    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 21:21:27.931120 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929726    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 21:21:27.931120 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929730    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 21:21:27.931120 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929734    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 21:21:27.931720 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929741    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 21:21:27.931720 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929746    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 21:21:27.931720 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929750    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 21:21:27.931720 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929755    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 21:21:27.931720 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929760    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 21:21:27.931720 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929764    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 21:21:27.931720 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929768    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 21:21:27.931720 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929772    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 21:21:27.931720 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929777    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 21:21:27.931720 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929781    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 21:21:27.931720 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929785    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 21 21:21:27.931720 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929789    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 21:21:27.931720 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929793    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 21:21:27.931720 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929797    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 21:21:27.931720 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929801    2559 feature_gate.go:328] unrecognized feature gate: Example
May 21 21:21:27.931720 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929805    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 21:21:27.931720 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929810    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 21:21:27.931720 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929814    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 21:21:27.931720 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929818    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 21:21:27.931720 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929823    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 21:21:27.932442 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.929831    2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 21:21:27.932442 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929991    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 21:21:27.932442 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.929999    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 21:21:27.932442 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930003    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 21:21:27.932442 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930008    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 21:21:27.932442 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930012    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 21:21:27.932442 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930016    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 21:21:27.932442 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930021    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 21:21:27.932442 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930025    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 21:21:27.932442 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930030    2559 feature_gate.go:328] unrecognized feature gate: Example
May 21 21:21:27.932442 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930035    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 21:21:27.932442 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930039    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 21:21:27.932442 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930043    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 21:21:27.932442 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930048    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 21:21:27.932442 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930053    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 21:21:27.932442 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930057    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 21:21:27.932961 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930062    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 21:21:27.932961 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930067    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 21:21:27.932961 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930072    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 21:21:27.932961 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930077    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 21:21:27.932961 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930081    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 21:21:27.932961 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930086    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 21:21:27.932961 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930091    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 21:21:27.932961 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930095    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 21:21:27.932961 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930101    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 21:21:27.932961 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930106    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 21:21:27.932961 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930110    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 21:21:27.932961 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930114    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 21:21:27.932961 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930118    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 21:21:27.932961 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930122    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 21:21:27.932961 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930126    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 21:21:27.932961 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930130    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 21:21:27.932961 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930134    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 21:21:27.932961 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930138    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 21:21:27.932961 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930142    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 21:21:27.933538 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930146    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 21:21:27.933538 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930151    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 21:21:27.933538 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930155    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 21:21:27.933538 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930160    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 21:21:27.933538 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930164    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 21:21:27.933538 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930168    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 21:21:27.933538 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930172    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 21:21:27.933538 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930176    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 21:21:27.933538 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930180    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 21:21:27.933538 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930184    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 21:21:27.933538 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930189    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 21:21:27.933538 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930193    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 21:21:27.933538 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930197    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 21:21:27.933538 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930201    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 21 21:21:27.933538 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930205    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 21:21:27.933538 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930210    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 21:21:27.933538 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930214    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 21:21:27.933538 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930221    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 21:21:27.933538 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930227    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 21:21:27.934353 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930232    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 21:21:27.934353 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930238    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 21:21:27.934353 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930242    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 21:21:27.934353 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930247    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 21:21:27.934353 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930251    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 21:21:27.934353 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930255    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 21:21:27.934353 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930259    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 21:21:27.934353 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930263    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 21:21:27.934353 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930268    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 21:21:27.934353 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930272    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 21:21:27.934353 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930276    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 21:21:27.934353 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930281    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 21:21:27.934353 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930285    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 21:21:27.934353 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930290    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 21:21:27.934353 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930294    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 21:21:27.934353 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930298    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 21:21:27.934353 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930302    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 21:21:27.934353 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930306    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 21:21:27.934353 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930310    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 21:21:27.934886 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930314    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 21:21:27.934886 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930319    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 21:21:27.934886 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930324    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 21:21:27.934886 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930328    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 21:21:27.934886 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930332    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 21:21:27.934886 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930337    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 21:21:27.934886 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930341    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 21:21:27.934886 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930345    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 21:21:27.934886 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930349    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 21:21:27.934886 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930353    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 21:21:27.934886 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930357    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 21:21:27.934886 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930361    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 21:21:27.934886 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930365    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 21:21:27.934886 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:27.930369    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 21:21:27.934886 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.930377    2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 21:21:27.934886 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.931359    2559 server.go:962] "Client rotation is on, will bootstrap in background"
May 21 21:21:27.935387 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.934929    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 21 21:21:27.935934 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.935920    2559 server.go:1019] "Starting client certificate rotation"
May 21 21:21:27.936036 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.936021    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 21:21:27.936071 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.936055    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 21:21:27.961990 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.961964    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 21:21:27.966622 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.966605    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 21:21:27.984277 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.984254    2559 log.go:25] "Validated CRI v1 runtime API"
May 21 21:21:27.989427 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.989412    2559 log.go:25] "Validated CRI v1 image API"
May 21 21:21:27.990642 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.990624    2559 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 21 21:21:27.991851 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.991833    2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 21:21:27.993116 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.993097    2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a5fa1b5a-dfb6-4182-983b-69338e7fb6c4:/dev/nvme0n1p4 fd90aa04-02f6-4647-92a3-06606e1cb4d9:/dev/nvme0n1p3]
May 21 21:21:27.993170 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.993116    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 21 21:21:27.997426 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.997311    2559 manager.go:217] Machine: {Timestamp:2026-05-21 21:21:27.996791288 +0000 UTC m=+0.429802775 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099017 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e481259f349a7e883b2b3487bdd03 SystemUUID:ec2e4812-59f3-49a7-e883-b2b3487bdd03 BootID:b454f873-6004-4f93-87cf-94494c63259e Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:98:7e:5e:88:57 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:98:7e:5e:88:57 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:0a:a3:97:4c:ef Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 21 21:21:27.998328 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.998317    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 21 21:21:27.998413 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:27.998402    2559 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 21 21:21:28.001300 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.001267    2559 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 21 21:21:28.001444 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.001303    2559 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-28.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 21 21:21:28.001494 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.001458    2559 topology_manager.go:138] "Creating topology manager with none policy"
May 21 21:21:28.001494 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.001467    2559 container_manager_linux.go:306] "Creating device plugin manager"
May 21 21:21:28.001494 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.001476    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 21:21:28.001494 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.001489    2559 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 21:21:28.003548 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.003537    2559 state_mem.go:36] "Initialized new in-memory state store"
May 21 21:21:28.003674 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.003665    2559 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 21 21:21:28.006002 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.005992    2559 kubelet.go:491] "Attempting to sync node with API server"
May 21 21:21:28.006040 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.006007    2559 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 21 21:21:28.006040 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.006018    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 21 21:21:28.006093 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.006051    2559 kubelet.go:397] "Adding apiserver pod source"
May 21 21:21:28.006093 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.006086    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 21 21:21:28.007434 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.007420    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 21:21:28.007474 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.007443    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 21:21:28.011005 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.010990    2559 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 21 21:21:28.011254 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.011236    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bkv9p"
May 21 21:21:28.013164 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.013147    2559 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 21 21:21:28.014404 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.014389    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 21 21:21:28.014472 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.014411    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 21 21:21:28.014472 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.014420    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 21 21:21:28.014472 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.014428    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 21 21:21:28.014472 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.014440    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 21 21:21:28.014472 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.014470    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 21 21:21:28.014688 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.014480    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 21 21:21:28.014688 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.014488    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 21 21:21:28.014688 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.014499    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 21 21:21:28.014688 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.014508    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 21 21:21:28.014688 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.014528    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 21 21:21:28.014688 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.014537    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 21 21:21:28.015511 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.015500    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 21 21:21:28.015558 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.015514    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 21 21:21:28.018388 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.018371    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bkv9p"
May 21 21:21:28.018747 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:28.018727    2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-28.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 21 21:21:28.018747 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:28.018728    2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 21 21:21:28.018849 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.018747    2559 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-28.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 21 21:21:28.019397 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.019385    2559 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 21 21:21:28.019431 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.019425    2559 server.go:1295] "Started kubelet"
May 21 21:21:28.019577 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.019499    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 21 21:21:28.020085 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.019993    2559 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 21 21:21:28.020152 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.020106    2559 server_v1.go:47] "podresources" method="list" useActivePods=true
May 21 21:21:28.020359 ip-10-0-129-28 systemd[1]: Started Kubernetes Kubelet.
May 21 21:21:28.021644 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.021630    2559 server.go:317] "Adding debug handlers to kubelet server"
May 21 21:21:28.023510 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.023491    2559 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 21 21:21:28.028186 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.028161    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 21 21:21:28.028335 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.028315    2559 volume_manager.go:295] "The desired_state_of_world populator starts"
May 21 21:21:28.028398 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.028338    2559 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 21 21:21:28.028501 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.028489    2559 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 21 21:21:28.028557 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.028317    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 21 21:21:28.028635 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.028619    2559 reconstruct.go:97] "Volume reconstruction finished"
May 21 21:21:28.028635 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.028627    2559 reconciler.go:26] "Reconciler: start to sync state"
May 21 21:21:28.029571 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:28.029547    2559 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 21 21:21:28.029701 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:28.029556    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-28.ec2.internal\" not found"
May 21 21:21:28.030072 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.030055    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 21 21:21:28.030236 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.030203    2559 factory.go:55] Registering systemd factory
May 21 21:21:28.030236 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.030235    2559 factory.go:223] Registration of the systemd container factory successfully
May 21 21:21:28.030729 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.030714    2559 factory.go:153] Registering CRI-O factory
May 21 21:21:28.030812 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.030732    2559 factory.go:223] Registration of the crio container factory successfully
May 21 21:21:28.030812 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.030753    2559 factory.go:103] Registering Raw factory
May 21 21:21:28.030812 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.030767    2559 manager.go:1196] Started watching for new ooms in manager
May 21 21:21:28.031212 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.031201    2559 manager.go:319] Starting recovery of all containers
May 21 21:21:28.036868 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.036845    2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 21:21:28.040824 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.040703    2559 manager.go:324] Recovery completed
May 21 21:21:28.043110 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:28.043089    2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-28.ec2.internal\" not found" node="ip-10-0-129-28.ec2.internal"
May 21 21:21:28.045477 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.045465    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 21:21:28.047229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.047214    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientMemory"
May 21 21:21:28.047296 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.047248    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasNoDiskPressure"
May 21 21:21:28.047296 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.047263    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientPID"
May 21 21:21:28.047764 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.047750    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 21 21:21:28.047764 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.047763    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 21 21:21:28.047835 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.047778    2559 state_mem.go:36] "Initialized new in-memory state store"
May 21 21:21:28.050377 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.050366    2559 policy_none.go:49] "None policy: Start"
May 21 21:21:28.050421 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.050382    2559 memory_manager.go:186] "Starting memorymanager" policy="None"
May 21 21:21:28.050421 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.050393    2559 state_mem.go:35] "Initializing new in-memory state store"
May 21 21:21:28.090148 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.090132    2559 manager.go:341] "Starting Device Plugin manager"
May 21 21:21:28.096467 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:28.090166    2559 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 21 21:21:28.096467 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.090178    2559 server.go:85] "Starting device plugin registration server"
May 21 21:21:28.096467 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.090404    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
May 21 21:21:28.096467 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.090418    2559 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 21 21:21:28.096467 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.090556    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 21 21:21:28.096467 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.090652    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 21 21:21:28.096467 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.090661    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 21 21:21:28.096467 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:28.091053    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 21 21:21:28.096467 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:28.091080    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-28.ec2.internal\" not found"
May 21 21:21:28.160621 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.160550    2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 21 21:21:28.161697 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.161680    2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 21 21:21:28.161752 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.161716    2559 status_manager.go:230] "Starting to sync pod status with apiserver"
May 21 21:21:28.161752 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.161742    2559 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 21 21:21:28.161752 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.161752    2559 kubelet.go:2451] "Starting kubelet main sync loop"
May 21 21:21:28.161892 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:28.161796    2559 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 21 21:21:28.165335 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.165313    2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 21:21:28.191457 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.191441    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 21:21:28.192354 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.192338    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientMemory"
May 21 21:21:28.192433 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.192368    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasNoDiskPressure"
May 21 21:21:28.192433 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.192386    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientPID"
May 21 21:21:28.192433 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.192413    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-28.ec2.internal"
May 21 21:21:28.207682 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.207661    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-28.ec2.internal"
May 21 21:21:28.207682 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:28.207683    2559 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-28.ec2.internal\": node \"ip-10-0-129-28.ec2.internal\" not found"
May 21 21:21:28.237618 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:28.237581    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-28.ec2.internal\" not found"
May 21 21:21:28.262697 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.262630    2559 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal"]
May 21 21:21:28.262802 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.262738    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 21:21:28.263604 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.263576    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientMemory"
May 21 21:21:28.263663 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.263615    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasNoDiskPressure"
May 21 21:21:28.263663 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.263625    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientPID"
May 21 21:21:28.264863 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.264851    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 21:21:28.265017 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.265003    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal"
May 21 21:21:28.265061 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.265031    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 21:21:28.265599 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.265568    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientMemory"
May 21 21:21:28.265663 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.265608    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasNoDiskPressure"
May 21 21:21:28.265663 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.265619    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientPID"
May 21 21:21:28.265726 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.265576    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientMemory"
May 21 21:21:28.265726 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.265686    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasNoDiskPressure"
May 21 21:21:28.265726 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.265696    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientPID"
May 21 21:21:28.266842 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.266826    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal"
May 21 21:21:28.266923 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.266852    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 21:21:28.267439 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.267426    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientMemory"
May 21 21:21:28.267507 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.267451    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasNoDiskPressure"
May 21 21:21:28.267507 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.267462    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientPID"
May 21 21:21:28.295140 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:28.295122    2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-28.ec2.internal\" not found" node="ip-10-0-129-28.ec2.internal"
May 21 21:21:28.299555 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:28.299538    2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-28.ec2.internal\" not found" node="ip-10-0-129-28.ec2.internal"
May 21 21:21:28.330288 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.330270    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9314b3678577e7d789a7829260b3bc01-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal\" (UID: \"9314b3678577e7d789a7829260b3bc01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal"
May 21 21:21:28.330392 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.330295    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9314b3678577e7d789a7829260b3bc01-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal\" (UID: \"9314b3678577e7d789a7829260b3bc01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal"
May 21 21:21:28.330392 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.330312    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b2a50c1e9e4450e9a9c6602d61d82b0-config\") pod \"kube-apiserver-proxy-ip-10-0-129-28.ec2.internal\" (UID: \"3b2a50c1e9e4450e9a9c6602d61d82b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal"
May 21 21:21:28.338377 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:28.338358    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-28.ec2.internal\" not found"
May 21 21:21:28.430698 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.430616    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9314b3678577e7d789a7829260b3bc01-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal\" (UID: \"9314b3678577e7d789a7829260b3bc01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal"
May 21 21:21:28.430698 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.430654    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9314b3678577e7d789a7829260b3bc01-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal\" (UID: \"9314b3678577e7d789a7829260b3bc01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal"
May 21 21:21:28.430698 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.430686    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b2a50c1e9e4450e9a9c6602d61d82b0-config\") pod \"kube-apiserver-proxy-ip-10-0-129-28.ec2.internal\" (UID: \"3b2a50c1e9e4450e9a9c6602d61d82b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal"
May 21 21:21:28.430893 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.430708    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9314b3678577e7d789a7829260b3bc01-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal\" (UID: \"9314b3678577e7d789a7829260b3bc01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal"
May 21 21:21:28.430893 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.430726    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b2a50c1e9e4450e9a9c6602d61d82b0-config\") pod \"kube-apiserver-proxy-ip-10-0-129-28.ec2.internal\" (UID: \"3b2a50c1e9e4450e9a9c6602d61d82b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal"
May 21 21:21:28.430893 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.430758    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9314b3678577e7d789a7829260b3bc01-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal\" (UID: \"9314b3678577e7d789a7829260b3bc01\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal"
May 21 21:21:28.438695 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:28.438677    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-28.ec2.internal\" not found"
May 21 21:21:28.539687 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:28.539661    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-28.ec2.internal\" not found"
May 21 21:21:28.597845 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.597825    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal"
May 21 21:21:28.602669 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.602650    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal"
May 21 21:21:28.640136 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:28.640104    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-28.ec2.internal\" not found"
May 21 21:21:28.740685 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:28.740618    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-28.ec2.internal\" not found"
May 21 21:21:28.839719 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.839691    2559 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 21:21:28.841640 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:28.841620    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-28.ec2.internal\" not found"
May 21 21:21:28.935300 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.935270    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 21 21:21:28.935300 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.935300    2559 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 21:21:28.935868 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.935398    2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 21:21:28.935868 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.935419    2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 21:21:28.935868 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:28.935418    2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 21:21:29.006519 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.006442    2559 apiserver.go:52] "Watching apiserver"
May 21 21:21:29.015630 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.015604    2559 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 21 21:21:29.016555 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.016535    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-78x7g","openshift-network-operator/iptables-alerter-wpdwz","kube-system/konnectivity-agent-5s5xc","openshift-multus/network-metrics-daemon-kj49t","openshift-ovn-kubernetes/ovnkube-node-fdmjr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl","openshift-cluster-node-tuning-operator/tuned-vvtx9","openshift-dns/node-resolver-4hz2n","openshift-image-registry/node-ca-s57t7","openshift-multus/multus-additional-cni-plugins-v5cj2","openshift-multus/multus-bdchd"]
May 21 21:21:29.019114 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.019098    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:29.019213 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:29.019194    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78x7g" podUID="792ea57c-0076-4d0f-a836-ee11edfcd5ea"
May 21 21:21:29.020038 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.020013    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 21:16:28 +0000 UTC" deadline="2028-01-19 18:56:00.300464248 +0000 UTC"
May 21 21:21:29.020109 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.020038    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14589h34m31.280429997s"
May 21 21:21:29.020147 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.020104    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wpdwz"
May 21 21:21:29.021362 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.021336    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5s5xc"
May 21 21:21:29.021473 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.021401    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:29.021473 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:29.021460    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj49t" podUID="7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd"
May 21 21:21:29.022842 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.022823    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 21 21:21:29.023039 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.023018    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5rfxv\""
May 21 21:21:29.023128 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.023072    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 21 21:21:29.023128 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.023079    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 21 21:21:29.023936 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.023917    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n8n94\""
May 21 21:21:29.023936 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.023944    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 21 21:21:29.024100 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.023981    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 21 21:21:29.024171 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.024151    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.027452 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.027427    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 21 21:21:29.028074 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.027653    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 21 21:21:29.028074 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.027727    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 21 21:21:29.028234 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.028083    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 21 21:21:29.028234 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.028126    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 21 21:21:29.028234 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.028158    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4xzfr\""
May 21 21:21:29.028721 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.028698    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 21 21:21:29.028721 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.028723    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.028880 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.028776    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.029318 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.029302    2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal"
May 21 21:21:29.029736 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.029648    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 21 21:21:29.030139 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.030123    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4hz2n"
May 21 21:21:29.032578 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.032494    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 21 21:21:29.032578 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.032525    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 21 21:21:29.032578 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.032529    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 21 21:21:29.032578 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.032558    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 21 21:21:29.032851 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.032556    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m5sh6\""
May 21 21:21:29.032904 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.032895    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 21 21:21:29.033026 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.033010    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6v8cd\""
May 21 21:21:29.033259 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.033246    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s57t7"
May 21 21:21:29.033865 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.033848    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bacb9d64-b7a0-4535-adae-872327dd1f03-ovnkube-script-lib\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.033929 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.033875    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-sysctl-conf\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.033929 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.033895    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-sys-fs\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.033929 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.033917    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bacb9d64-b7a0-4535-adae-872327dd1f03-ovn-node-metrics-cert\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.034035 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.033943    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-modprobe-d\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.034035 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.033995    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-systemd\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.034138 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.034056    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-sys\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.034138 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.034093    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-host\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.034138 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.034119    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9ct4\" (UniqueName: \"kubernetes.io/projected/3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9-kube-api-access-r9ct4\") pod \"node-resolver-4hz2n\" (UID: \"3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9\") " pod="openshift-dns/node-resolver-4hz2n"
May 21 21:21:29.034271 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.034146    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85q2g\" (UniqueName: \"kubernetes.io/projected/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-kube-api-access-85q2g\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.034271 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.034169    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7886b88e-df8d-407c-9cf6-7a2158eca9c0-host-slash\") pod \"iptables-alerter-wpdwz\" (UID: \"7886b88e-df8d-407c-9cf6-7a2158eca9c0\") " pod="openshift-network-operator/iptables-alerter-wpdwz"
May 21 21:21:29.034271 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.034192    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-kubelet\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.034271 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.034244    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-etc-openvswitch\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.034415 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.034308    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-node-log\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.034415 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.034333    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 21 21:21:29.034415 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.034339    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9-tmp-dir\") pod \"node-resolver-4hz2n\" (UID: \"3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9\") " pod="openshift-dns/node-resolver-4hz2n"
May 21 21:21:29.034415 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.034355    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4qhs9\""
May 21 21:21:29.034415 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.034369    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.034415 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.034393    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-run-systemd\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.034654 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.034437    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bacb9d64-b7a0-4535-adae-872327dd1f03-env-overrides\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.034654 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.034462    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-lib-modules\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.035076 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.034492    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skj56\" (UniqueName: \"kubernetes.io/projected/050019f5-56d2-4d47-b7fa-443c92ec5cdd-kube-api-access-skj56\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.035137 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035110    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9-hosts-file\") pod \"node-resolver-4hz2n\" (UID: \"3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9\") " pod="openshift-dns/node-resolver-4hz2n"
May 21 21:21:29.035192 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035140    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5v7b\" (UniqueName: \"kubernetes.io/projected/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-kube-api-access-s5v7b\") pod \"network-metrics-daemon-kj49t\" (UID: \"7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd\") " pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:29.035192 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.034763    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 21 21:21:29.035192 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.034752    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.035192 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035168    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-device-dir\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.035363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035194    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-etc-selinux\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.035363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035218    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-var-lib-openvswitch\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.035363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035243    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-cni-bin\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.035363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035287    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-kubernetes\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.035363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035325    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-sysctl-d\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.035363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035351    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-var-lib-kubelet\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.035665 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035377    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/56805f88-45e2-41c0-ac11-aa92e3f555ca-konnectivity-ca\") pod \"konnectivity-agent-5s5xc\" (UID: \"56805f88-45e2-41c0-ac11-aa92e3f555ca\") " pod="kube-system/konnectivity-agent-5s5xc"
May 21 21:21:29.035665 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035403    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7886b88e-df8d-407c-9cf6-7a2158eca9c0-iptables-alerter-script\") pod \"iptables-alerter-wpdwz\" (UID: \"7886b88e-df8d-407c-9cf6-7a2158eca9c0\") " pod="openshift-network-operator/iptables-alerter-wpdwz"
May 21 21:21:29.035665 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035464    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-run-netns\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.035665 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035491    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-log-socket\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.035665 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035535    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bacb9d64-b7a0-4535-adae-872327dd1f03-ovnkube-config\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.035665 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035565    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-run\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.035665 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035616    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-tuned\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.035665 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035640    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m5gns\""
May 21 21:21:29.035665 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035642    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/56805f88-45e2-41c0-ac11-aa92e3f555ca-agent-certs\") pod \"konnectivity-agent-5s5xc\" (UID: \"56805f88-45e2-41c0-ac11-aa92e3f555ca\") " pod="kube-system/konnectivity-agent-5s5xc"
May 21 21:21:29.035665 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035651    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 21 21:21:29.036117 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035671    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-socket-dir\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.036117 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035695    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x55l7\" (UniqueName: \"kubernetes.io/projected/7886b88e-df8d-407c-9cf6-7a2158eca9c0-kube-api-access-x55l7\") pod \"iptables-alerter-wpdwz\" (UID: \"7886b88e-df8d-407c-9cf6-7a2158eca9c0\") " pod="openshift-network-operator/iptables-alerter-wpdwz"
May 21 21:21:29.036117 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035748    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-cni-netd\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.036117 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035772    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r7v4\" (UniqueName: \"kubernetes.io/projected/bacb9d64-b7a0-4535-adae-872327dd1f03-kube-api-access-5r7v4\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.036117 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035802    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-sysconfig\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.036117 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035829    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs\") pod \"network-metrics-daemon-kj49t\" (UID: \"7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd\") " pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:29.036117 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035867    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 21 21:21:29.036117 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035886    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-registration-dir\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.036117 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035916    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-systemd-units\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.036117 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035940    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-slash\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.036117 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035941    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 21 21:21:29.036117 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.035980    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-run-ovn\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.036117 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.036013    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/050019f5-56d2-4d47-b7fa-443c92ec5cdd-tmp\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.036117 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.036037    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bdchd"
May 21 21:21:29.036117 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.036042    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdhhh\" (UniqueName: \"kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh\") pod \"network-check-target-78x7g\" (UID: \"792ea57c-0076-4d0f-a836-ee11edfcd5ea\") " pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:29.036117 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.036082    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-run-openvswitch\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.036117 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.036114    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-run-ovn-kubernetes\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.036908 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.036139    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.037675 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.037660    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 21 21:21:29.038102 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.038086    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-h9vjt\""
May 21 21:21:29.038165 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.038106    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 21 21:21:29.038165 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.038109    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 21 21:21:29.038410 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.038392    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 21 21:21:29.038484 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.038395    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rzc8h\""
May 21 21:21:29.038763 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.038747    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 21 21:21:29.038836 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.038786    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 21 21:21:29.041153 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.041133    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal"]
May 21 21:21:29.041918 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.041898    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 21:21:29.041995 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.041975    2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal"
May 21 21:21:29.044929 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.044913    2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 21:21:29.052386 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.052368    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 21:21:29.052513 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.052500    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal"]
May 21 21:21:29.065517 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.065502    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wfr5l"
May 21 21:21:29.074900 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.074881    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wfr5l"
May 21 21:21:29.079200 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:29.079178    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b2a50c1e9e4450e9a9c6602d61d82b0.slice/crio-0b19508d61f5a9883e9b15ba49b9a567779eefe18a9149b982c40f63a4181e55 WatchSource:0}: Error finding container 0b19508d61f5a9883e9b15ba49b9a567779eefe18a9149b982c40f63a4181e55: Status 404 returned error can't find the container with id 0b19508d61f5a9883e9b15ba49b9a567779eefe18a9149b982c40f63a4181e55
May 21 21:21:29.079424 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:29.079398    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9314b3678577e7d789a7829260b3bc01.slice/crio-8a0026c30ac9dfc6edf8a02936dd84e46faf363ee1bbcab12a41843792c6ec77 WatchSource:0}: Error finding container 8a0026c30ac9dfc6edf8a02936dd84e46faf363ee1bbcab12a41843792c6ec77: Status 404 returned error can't find the container with id 8a0026c30ac9dfc6edf8a02936dd84e46faf363ee1bbcab12a41843792c6ec77
May 21 21:21:29.082389 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.082377    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 21:21:29.129323 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.129300    2559 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 21 21:21:29.137081 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137063    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.137143 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137090    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bacb9d64-b7a0-4535-adae-872327dd1f03-env-overrides\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.137143 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137108    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-lib-modules\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.137143 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137123    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9-hosts-file\") pod \"node-resolver-4hz2n\" (UID: \"3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9\") " pod="openshift-dns/node-resolver-4hz2n"
May 21 21:21:29.137143 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137137    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-kubernetes\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.137330 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137151    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-sysctl-d\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.137330 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137168    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-var-lib-kubelet\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.137330 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137190    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-tuned\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.137330 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137220    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92a208e0-b4da-41b0-85e2-a5db658ee178-cni-binary-copy\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.137330 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137229    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.137330 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137244    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdmsh\" (UniqueName: \"kubernetes.io/projected/92a208e0-b4da-41b0-85e2-a5db658ee178-kube-api-access-sdmsh\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.137330 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137227    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9-hosts-file\") pod \"node-resolver-4hz2n\" (UID: \"3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9\") " pod="openshift-dns/node-resolver-4hz2n"
May 21 21:21:29.137330 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137260    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-lib-modules\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.137330 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137273    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7886b88e-df8d-407c-9cf6-7a2158eca9c0-iptables-alerter-script\") pod \"iptables-alerter-wpdwz\" (UID: \"7886b88e-df8d-407c-9cf6-7a2158eca9c0\") " pod="openshift-network-operator/iptables-alerter-wpdwz"
May 21 21:21:29.137330 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137260    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-var-lib-kubelet\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.137330 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137303    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-kubernetes\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.137330 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137313    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tfcg\" (UniqueName: \"kubernetes.io/projected/909a645a-db62-4ce2-8e92-c7d2380eb4dc-kube-api-access-2tfcg\") pod \"node-ca-s57t7\" (UID: \"909a645a-db62-4ce2-8e92-c7d2380eb4dc\") " pod="openshift-image-registry/node-ca-s57t7"
May 21 21:21:29.137884 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137345    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-sysctl-d\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.137884 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137401    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-host-var-lib-kubelet\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.137884 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137458    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-hostroot\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.137884 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137488    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/92a208e0-b4da-41b0-85e2-a5db658ee178-multus-daemon-config\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.137884 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137512    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-etc-kubernetes\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.137884 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137516    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 21 21:21:29.137884 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137540    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/56805f88-45e2-41c0-ac11-aa92e3f555ca-agent-certs\") pod \"konnectivity-agent-5s5xc\" (UID: \"56805f88-45e2-41c0-ac11-aa92e3f555ca\") " pod="kube-system/konnectivity-agent-5s5xc"
May 21 21:21:29.137884 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137564    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bacb9d64-b7a0-4535-adae-872327dd1f03-env-overrides\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.137884 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137571    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-socket-dir\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.137884 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137660    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-cni-netd\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.137884 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137680    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-socket-dir\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.137884 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137682    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5r7v4\" (UniqueName: \"kubernetes.io/projected/bacb9d64-b7a0-4535-adae-872327dd1f03-kube-api-access-5r7v4\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.137884 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137711    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db2f2e21-2561-411b-aedf-e1bcdbf66560-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.137884 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137736    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-host-run-k8s-cni-cncf-io\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.137884 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137757    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-cni-netd\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.137884 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137763    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs\") pod \"network-metrics-daemon-kj49t\" (UID: \"7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd\") " pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:29.137884 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137794    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-slash\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.138541 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137814    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7886b88e-df8d-407c-9cf6-7a2158eca9c0-iptables-alerter-script\") pod \"iptables-alerter-wpdwz\" (UID: \"7886b88e-df8d-407c-9cf6-7a2158eca9c0\") " pod="openshift-network-operator/iptables-alerter-wpdwz"
May 21 21:21:29.138541 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137818    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-run-ovn\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.138541 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:29.137842    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:29.138541 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137846    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-run-ovn\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.138541 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137867    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-multus-socket-dir-parent\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.138541 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137874    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-slash\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.138541 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:29.137921    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs podName:7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd nodeName:}" failed. No retries permitted until 2026-05-21 21:21:29.637884898 +0000 UTC m=+2.070896378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs") pod "network-metrics-daemon-kj49t" (UID: "7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:29.138541 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137944    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-host-var-lib-cni-bin\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.138541 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137973    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdhhh\" (UniqueName: \"kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh\") pod \"network-check-target-78x7g\" (UID: \"792ea57c-0076-4d0f-a836-ee11edfcd5ea\") " pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:29.138541 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.137995    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-run-openvswitch\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.138541 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138020    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db2f2e21-2561-411b-aedf-e1bcdbf66560-system-cni-dir\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.138541 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138045    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db2f2e21-2561-411b-aedf-e1bcdbf66560-cni-binary-copy\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.138541 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138060    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-run-openvswitch\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.138541 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138069    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db2f2e21-2561-411b-aedf-e1bcdbf66560-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.138541 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138096    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd6rs\" (UniqueName: \"kubernetes.io/projected/db2f2e21-2561-411b-aedf-e1bcdbf66560-kube-api-access-qd6rs\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.138541 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138121    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-modprobe-d\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.139361 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138139    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-systemd\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.139361 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138158    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-sys\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.139361 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138181    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-host\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.139361 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138188    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-modprobe-d\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.139361 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138208    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-systemd\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.139361 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138207    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db2f2e21-2561-411b-aedf-e1bcdbf66560-os-release\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.139361 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138248    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-host\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.139361 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138231    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-sys\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.139361 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138256    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-85q2g\" (UniqueName: \"kubernetes.io/projected/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-kube-api-access-85q2g\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.139361 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138295    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7886b88e-df8d-407c-9cf6-7a2158eca9c0-host-slash\") pod \"iptables-alerter-wpdwz\" (UID: \"7886b88e-df8d-407c-9cf6-7a2158eca9c0\") " pod="openshift-network-operator/iptables-alerter-wpdwz"
May 21 21:21:29.139361 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138320    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-kubelet\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.139361 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138343    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-node-log\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.139361 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138366    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7886b88e-df8d-407c-9cf6-7a2158eca9c0-host-slash\") pod \"iptables-alerter-wpdwz\" (UID: \"7886b88e-df8d-407c-9cf6-7a2158eca9c0\") " pod="openshift-network-operator/iptables-alerter-wpdwz"
May 21 21:21:29.139361 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138371    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-host-run-netns\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.139361 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138403    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-run-systemd\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.139361 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138426    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-node-log\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.139361 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138429    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-kubelet\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.139361 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138430    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-skj56\" (UniqueName: \"kubernetes.io/projected/050019f5-56d2-4d47-b7fa-443c92ec5cdd-kube-api-access-skj56\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.140167 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138465    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-run-systemd\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.140167 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138471    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-cnibin\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.140167 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138502    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5v7b\" (UniqueName: \"kubernetes.io/projected/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-kube-api-access-s5v7b\") pod \"network-metrics-daemon-kj49t\" (UID: \"7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd\") " pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:29.140167 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138527    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-device-dir\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.140167 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138573    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-device-dir\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.140167 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138698    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-etc-selinux\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.140167 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138717    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-var-lib-openvswitch\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.140167 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138732    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-cni-bin\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.140167 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138747    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/050019f5-56d2-4d47-b7fa-443c92ec5cdd-tmp\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.140167 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138764    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-multus-conf-dir\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.140167 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138786    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-var-lib-openvswitch\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.140167 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138792    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-cni-bin\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.140167 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138789    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/56805f88-45e2-41c0-ac11-aa92e3f555ca-konnectivity-ca\") pod \"konnectivity-agent-5s5xc\" (UID: \"56805f88-45e2-41c0-ac11-aa92e3f555ca\") " pod="kube-system/konnectivity-agent-5s5xc"
May 21 21:21:29.140167 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138840    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-run-netns\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.140167 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138845    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-etc-selinux\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.140167 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138866    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-log-socket\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.140167 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138887    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-run-netns\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.140854 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138892    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bacb9d64-b7a0-4535-adae-872327dd1f03-ovnkube-config\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.140854 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138918    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-run\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.140854 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138924    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-log-socket\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.140854 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138946    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/909a645a-db62-4ce2-8e92-c7d2380eb4dc-serviceca\") pod \"node-ca-s57t7\" (UID: \"909a645a-db62-4ce2-8e92-c7d2380eb4dc\") " pod="openshift-image-registry/node-ca-s57t7"
May 21 21:21:29.140854 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138970    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-run\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.140854 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.138969    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-system-cni-dir\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.140854 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139003    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x55l7\" (UniqueName: \"kubernetes.io/projected/7886b88e-df8d-407c-9cf6-7a2158eca9c0-kube-api-access-x55l7\") pod \"iptables-alerter-wpdwz\" (UID: \"7886b88e-df8d-407c-9cf6-7a2158eca9c0\") " pod="openshift-network-operator/iptables-alerter-wpdwz"
May 21 21:21:29.140854 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139029    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-sysconfig\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.140854 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139056    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-multus-cni-dir\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.140854 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139114    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-host-var-lib-cni-multus\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.140854 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139146    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-registration-dir\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.140854 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139155    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-sysconfig\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.140854 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139173    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-systemd-units\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.140854 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139199    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/909a645a-db62-4ce2-8e92-c7d2380eb4dc-host\") pod \"node-ca-s57t7\" (UID: \"909a645a-db62-4ce2-8e92-c7d2380eb4dc\") " pod="openshift-image-registry/node-ca-s57t7"
May 21 21:21:29.140854 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139225    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db2f2e21-2561-411b-aedf-e1bcdbf66560-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.140854 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139252    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-os-release\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.140854 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139256    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/56805f88-45e2-41c0-ac11-aa92e3f555ca-konnectivity-ca\") pod \"konnectivity-agent-5s5xc\" (UID: \"56805f88-45e2-41c0-ac11-aa92e3f555ca\") " pod="kube-system/konnectivity-agent-5s5xc"
May 21 21:21:29.141363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139260    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-registration-dir\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.141363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139279    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-run-ovn-kubernetes\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.141363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139267    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-systemd-units\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.141363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139321    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.141363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139352    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bacb9d64-b7a0-4535-adae-872327dd1f03-ovnkube-config\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.141363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139358    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-run-ovn-kubernetes\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.141363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139354    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bacb9d64-b7a0-4535-adae-872327dd1f03-ovnkube-script-lib\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.141363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139394    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-sysctl-conf\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.141363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139430    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.141363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139454    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-host-run-multus-certs\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.141363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139488    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-sys-fs\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.141363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139506    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bacb9d64-b7a0-4535-adae-872327dd1f03-ovn-node-metrics-cert\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.141363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139534    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-sysctl-conf\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.141363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139555    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r9ct4\" (UniqueName: \"kubernetes.io/projected/3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9-kube-api-access-r9ct4\") pod \"node-resolver-4hz2n\" (UID: \"3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9\") " pod="openshift-dns/node-resolver-4hz2n"
May 21 21:21:29.141363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139598    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db2f2e21-2561-411b-aedf-e1bcdbf66560-cnibin\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.141363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139624    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-etc-openvswitch\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.141363 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139648    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9-tmp-dir\") pod \"node-resolver-4hz2n\" (UID: \"3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9\") " pod="openshift-dns/node-resolver-4hz2n"
May 21 21:21:29.141873 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139741    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bacb9d64-b7a0-4535-adae-872327dd1f03-etc-openvswitch\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.141873 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139892    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-sys-fs\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.141873 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139975    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9-tmp-dir\") pod \"node-resolver-4hz2n\" (UID: \"3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9\") " pod="openshift-dns/node-resolver-4hz2n"
May 21 21:21:29.141873 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.139988    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bacb9d64-b7a0-4535-adae-872327dd1f03-ovnkube-script-lib\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.141873 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.140889    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/050019f5-56d2-4d47-b7fa-443c92ec5cdd-etc-tuned\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.141873 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.141097    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/56805f88-45e2-41c0-ac11-aa92e3f555ca-agent-certs\") pod \"konnectivity-agent-5s5xc\" (UID: \"56805f88-45e2-41c0-ac11-aa92e3f555ca\") " pod="kube-system/konnectivity-agent-5s5xc"
May 21 21:21:29.141873 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.141706    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/050019f5-56d2-4d47-b7fa-443c92ec5cdd-tmp\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.142078 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.141899    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bacb9d64-b7a0-4535-adae-872327dd1f03-ovn-node-metrics-cert\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.148933 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.148916    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x55l7\" (UniqueName: \"kubernetes.io/projected/7886b88e-df8d-407c-9cf6-7a2158eca9c0-kube-api-access-x55l7\") pod \"iptables-alerter-wpdwz\" (UID: \"7886b88e-df8d-407c-9cf6-7a2158eca9c0\") " pod="openshift-network-operator/iptables-alerter-wpdwz"
May 21 21:21:29.149114 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.149099    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skj56\" (UniqueName: \"kubernetes.io/projected/050019f5-56d2-4d47-b7fa-443c92ec5cdd-kube-api-access-skj56\") pod \"tuned-vvtx9\" (UID: \"050019f5-56d2-4d47-b7fa-443c92ec5cdd\") " pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.149167 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:29.149148    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 21:21:29.149167 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:29.149165    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 21:21:29.149244 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:29.149174    2559 projected.go:194] Error preparing data for projected volume kube-api-access-fdhhh for pod openshift-network-diagnostics/network-check-target-78x7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:29.149244 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:29.149219    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh podName:792ea57c-0076-4d0f-a836-ee11edfcd5ea nodeName:}" failed. No retries permitted until 2026-05-21 21:21:29.649205345 +0000 UTC m=+2.082216821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fdhhh" (UniqueName: "kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh") pod "network-check-target-78x7g" (UID: "792ea57c-0076-4d0f-a836-ee11edfcd5ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:29.149892 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.149870    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85q2g\" (UniqueName: \"kubernetes.io/projected/2fca0aa2-40cb-4d6b-8cd1-f73578491f10-kube-api-access-85q2g\") pod \"aws-ebs-csi-driver-node-8gqsl\" (UID: \"2fca0aa2-40cb-4d6b-8cd1-f73578491f10\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.151086 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.151062    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9ct4\" (UniqueName: \"kubernetes.io/projected/3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9-kube-api-access-r9ct4\") pod \"node-resolver-4hz2n\" (UID: \"3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9\") " pod="openshift-dns/node-resolver-4hz2n"
May 21 21:21:29.151726 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.151710    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r7v4\" (UniqueName: \"kubernetes.io/projected/bacb9d64-b7a0-4535-adae-872327dd1f03-kube-api-access-5r7v4\") pod \"ovnkube-node-fdmjr\" (UID: \"bacb9d64-b7a0-4535-adae-872327dd1f03\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.151833 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.151819    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5v7b\" (UniqueName: \"kubernetes.io/projected/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-kube-api-access-s5v7b\") pod \"network-metrics-daemon-kj49t\" (UID: \"7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd\") " pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:29.164946 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.164910    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal" event={"ID":"3b2a50c1e9e4450e9a9c6602d61d82b0","Type":"ContainerStarted","Data":"0b19508d61f5a9883e9b15ba49b9a567779eefe18a9149b982c40f63a4181e55"}
May 21 21:21:29.165779 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.165761    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal" event={"ID":"9314b3678577e7d789a7829260b3bc01","Type":"ContainerStarted","Data":"8a0026c30ac9dfc6edf8a02936dd84e46faf363ee1bbcab12a41843792c6ec77"}
May 21 21:21:29.240688 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.240659    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/909a645a-db62-4ce2-8e92-c7d2380eb4dc-host\") pod \"node-ca-s57t7\" (UID: \"909a645a-db62-4ce2-8e92-c7d2380eb4dc\") " pod="openshift-image-registry/node-ca-s57t7"
May 21 21:21:29.240688 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.240690    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db2f2e21-2561-411b-aedf-e1bcdbf66560-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.240898 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.240717    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-os-release\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.240898 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.240773    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/909a645a-db62-4ce2-8e92-c7d2380eb4dc-host\") pod \"node-ca-s57t7\" (UID: \"909a645a-db62-4ce2-8e92-c7d2380eb4dc\") " pod="openshift-image-registry/node-ca-s57t7"
May 21 21:21:29.240898 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.240822    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-host-run-multus-certs\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.240898 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.240851    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db2f2e21-2561-411b-aedf-e1bcdbf66560-cnibin\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.240898 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.240878    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92a208e0-b4da-41b0-85e2-a5db658ee178-cni-binary-copy\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.240898 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.240894    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sdmsh\" (UniqueName: \"kubernetes.io/projected/92a208e0-b4da-41b0-85e2-a5db658ee178-kube-api-access-sdmsh\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.241152 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.240906    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-host-run-multus-certs\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.241152 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.240915    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-os-release\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.241152 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.240933    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db2f2e21-2561-411b-aedf-e1bcdbf66560-cnibin\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.241152 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.240916    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2tfcg\" (UniqueName: \"kubernetes.io/projected/909a645a-db62-4ce2-8e92-c7d2380eb4dc-kube-api-access-2tfcg\") pod \"node-ca-s57t7\" (UID: \"909a645a-db62-4ce2-8e92-c7d2380eb4dc\") " pod="openshift-image-registry/node-ca-s57t7"
May 21 21:21:29.241152 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.240973    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-host-var-lib-kubelet\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.241152 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241006    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-hostroot\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.241152 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241049    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-host-var-lib-kubelet\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.241152 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241050    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/92a208e0-b4da-41b0-85e2-a5db658ee178-multus-daemon-config\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.241152 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241084    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-etc-kubernetes\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.241152 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241091    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-hostroot\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.241152 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241131    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-etc-kubernetes\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.241534 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241188    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db2f2e21-2561-411b-aedf-e1bcdbf66560-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.241534 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241493    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-host-run-k8s-cni-cncf-io\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.241669 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241554    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db2f2e21-2561-411b-aedf-e1bcdbf66560-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.241669 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241561    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db2f2e21-2561-411b-aedf-e1bcdbf66560-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.241669 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241572    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-multus-socket-dir-parent\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.241669 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241634    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-host-var-lib-cni-bin\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.241669 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241638    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-host-run-k8s-cni-cncf-io\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.241900 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241706    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-multus-socket-dir-parent\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.241900 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241716    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-host-var-lib-cni-bin\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.241900 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241747    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db2f2e21-2561-411b-aedf-e1bcdbf66560-system-cni-dir\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.241900 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241756    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92a208e0-b4da-41b0-85e2-a5db658ee178-cni-binary-copy\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.241900 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241789    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db2f2e21-2561-411b-aedf-e1bcdbf66560-cni-binary-copy\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.241900 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241834    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db2f2e21-2561-411b-aedf-e1bcdbf66560-system-cni-dir\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.241900 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241854    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/92a208e0-b4da-41b0-85e2-a5db658ee178-multus-daemon-config\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.242221 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241903    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db2f2e21-2561-411b-aedf-e1bcdbf66560-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.242221 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.241991    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qd6rs\" (UniqueName: \"kubernetes.io/projected/db2f2e21-2561-411b-aedf-e1bcdbf66560-kube-api-access-qd6rs\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.242221 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.242043    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db2f2e21-2561-411b-aedf-e1bcdbf66560-os-release\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.242221 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.242076    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-host-run-netns\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.242221 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.242112    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-cnibin\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.242221 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.242153    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-multus-conf-dir\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.242221 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.242194    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/909a645a-db62-4ce2-8e92-c7d2380eb4dc-serviceca\") pod \"node-ca-s57t7\" (UID: \"909a645a-db62-4ce2-8e92-c7d2380eb4dc\") " pod="openshift-image-registry/node-ca-s57t7"
May 21 21:21:29.242521 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.242228    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-system-cni-dir\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.242521 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.242271    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-multus-cni-dir\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.242521 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.242295    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db2f2e21-2561-411b-aedf-e1bcdbf66560-cni-binary-copy\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.242521 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.242331    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-host-var-lib-cni-multus\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.242521 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.242366    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-cnibin\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.242521 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.242444    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db2f2e21-2561-411b-aedf-e1bcdbf66560-os-release\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.242521 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.242492    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-host-run-netns\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.242934 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.242577    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-host-var-lib-cni-multus\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.242934 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.242642    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-multus-conf-dir\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.243040 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.243009    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/909a645a-db62-4ce2-8e92-c7d2380eb4dc-serviceca\") pod \"node-ca-s57t7\" (UID: \"909a645a-db62-4ce2-8e92-c7d2380eb4dc\") " pod="openshift-image-registry/node-ca-s57t7"
May 21 21:21:29.243092 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.243067    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-system-cni-dir\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.243139 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.243125    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92a208e0-b4da-41b0-85e2-a5db658ee178-multus-cni-dir\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.243188 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.243130    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db2f2e21-2561-411b-aedf-e1bcdbf66560-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.248721 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.248694    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tfcg\" (UniqueName: \"kubernetes.io/projected/909a645a-db62-4ce2-8e92-c7d2380eb4dc-kube-api-access-2tfcg\") pod \"node-ca-s57t7\" (UID: \"909a645a-db62-4ce2-8e92-c7d2380eb4dc\") " pod="openshift-image-registry/node-ca-s57t7"
May 21 21:21:29.248853 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.248778    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdmsh\" (UniqueName: \"kubernetes.io/projected/92a208e0-b4da-41b0-85e2-a5db658ee178-kube-api-access-sdmsh\") pod \"multus-bdchd\" (UID: \"92a208e0-b4da-41b0-85e2-a5db658ee178\") " pod="openshift-multus/multus-bdchd"
May 21 21:21:29.249296 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.249279    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd6rs\" (UniqueName: \"kubernetes.io/projected/db2f2e21-2561-411b-aedf-e1bcdbf66560-kube-api-access-qd6rs\") pod \"multus-additional-cni-plugins-v5cj2\" (UID: \"db2f2e21-2561-411b-aedf-e1bcdbf66560\") " pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.341442 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.341413    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wpdwz"
May 21 21:21:29.344165 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.344143    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5s5xc"
May 21 21:21:29.349426 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:29.349401    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7886b88e_df8d_407c_9cf6_7a2158eca9c0.slice/crio-68d9f151620658ee735a6c06c79cf3e6d954e7114953e75efe40af8539e9399e WatchSource:0}: Error finding container 68d9f151620658ee735a6c06c79cf3e6d954e7114953e75efe40af8539e9399e: Status 404 returned error can't find the container with id 68d9f151620658ee735a6c06c79cf3e6d954e7114953e75efe40af8539e9399e
May 21 21:21:29.351349 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:29.351329    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56805f88_45e2_41c0_ac11_aa92e3f555ca.slice/crio-b1522c5a1f0450508b9f3345d015a259ac71ed93249f43ebcfb4ba72b6f692cd WatchSource:0}: Error finding container b1522c5a1f0450508b9f3345d015a259ac71ed93249f43ebcfb4ba72b6f692cd: Status 404 returned error can't find the container with id b1522c5a1f0450508b9f3345d015a259ac71ed93249f43ebcfb4ba72b6f692cd
May 21 21:21:29.365567 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.365552    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:29.372542 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:29.372521    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbacb9d64_b7a0_4535_adae_872327dd1f03.slice/crio-8cefaad8938c394c668a6ba5b98e756c3faf4122c9177aa770305d88a840ac87 WatchSource:0}: Error finding container 8cefaad8938c394c668a6ba5b98e756c3faf4122c9177aa770305d88a840ac87: Status 404 returned error can't find the container with id 8cefaad8938c394c668a6ba5b98e756c3faf4122c9177aa770305d88a840ac87
May 21 21:21:29.386780 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.386760    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vvtx9"
May 21 21:21:29.391542 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:29.391523    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050019f5_56d2_4d47_b7fa_443c92ec5cdd.slice/crio-cbd0138100ee9e76281524f4344f0b5a60f98c88a8f45c3b52c929ac74895d56 WatchSource:0}: Error finding container cbd0138100ee9e76281524f4344f0b5a60f98c88a8f45c3b52c929ac74895d56: Status 404 returned error can't find the container with id cbd0138100ee9e76281524f4344f0b5a60f98c88a8f45c3b52c929ac74895d56
May 21 21:21:29.392109 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.392089    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl"
May 21 21:21:29.397908 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.397891    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4hz2n"
May 21 21:21:29.398167 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:29.398146    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fca0aa2_40cb_4d6b_8cd1_f73578491f10.slice/crio-afa5855fd1177d0abe7fedb683c7bb874480374bfaa0668b7bf26cc54bf8eb34 WatchSource:0}: Error finding container afa5855fd1177d0abe7fedb683c7bb874480374bfaa0668b7bf26cc54bf8eb34: Status 404 returned error can't find the container with id afa5855fd1177d0abe7fedb683c7bb874480374bfaa0668b7bf26cc54bf8eb34
May 21 21:21:29.403264 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:29.403244    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c1ce8fc_42cb_44ed_8b20_e3d6c2e3c2c9.slice/crio-c00f34c43ec35800329913388678374ac82c7f6d389c2bb40b1a1e278df8d606 WatchSource:0}: Error finding container c00f34c43ec35800329913388678374ac82c7f6d389c2bb40b1a1e278df8d606: Status 404 returned error can't find the container with id c00f34c43ec35800329913388678374ac82c7f6d389c2bb40b1a1e278df8d606
May 21 21:21:29.403876 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.403860    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s57t7"
May 21 21:21:29.409400 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:29.409370    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod909a645a_db62_4ce2_8e92_c7d2380eb4dc.slice/crio-3b711fc62467deaf7f5c8f2a60f3889c3b6b8a3ae3d8c7e7858ae71bf625b45b WatchSource:0}: Error finding container 3b711fc62467deaf7f5c8f2a60f3889c3b6b8a3ae3d8c7e7858ae71bf625b45b: Status 404 returned error can't find the container with id 3b711fc62467deaf7f5c8f2a60f3889c3b6b8a3ae3d8c7e7858ae71bf625b45b
May 21 21:21:29.412100 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.412085    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v5cj2"
May 21 21:21:29.415599 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.415570    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bdchd"
May 21 21:21:29.418800 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:29.418777    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb2f2e21_2561_411b_aedf_e1bcdbf66560.slice/crio-fa6cb8ab64b435edc8d266ae0b9aeaac03cb5ec694bb9b786364f9fbb9114212 WatchSource:0}: Error finding container fa6cb8ab64b435edc8d266ae0b9aeaac03cb5ec694bb9b786364f9fbb9114212: Status 404 returned error can't find the container with id fa6cb8ab64b435edc8d266ae0b9aeaac03cb5ec694bb9b786364f9fbb9114212
May 21 21:21:29.422741 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:21:29.422717    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a208e0_b4da_41b0_85e2_a5db658ee178.slice/crio-58086cbe07ae96ae3ac65b9f1ed5c1e7a3e96c25cb5d2d4bf47c6bba6b1f41e9 WatchSource:0}: Error finding container 58086cbe07ae96ae3ac65b9f1ed5c1e7a3e96c25cb5d2d4bf47c6bba6b1f41e9: Status 404 returned error can't find the container with id 58086cbe07ae96ae3ac65b9f1ed5c1e7a3e96c25cb5d2d4bf47c6bba6b1f41e9
May 21 21:21:29.644881 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.644802    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs\") pod \"network-metrics-daemon-kj49t\" (UID: \"7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd\") " pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:29.645049 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:29.644998    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:29.645116 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:29.645081    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs podName:7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd nodeName:}" failed. No retries permitted until 2026-05-21 21:21:30.645061738 +0000 UTC m=+3.078073225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs") pod "network-metrics-daemon-kj49t" (UID: "7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:29.746147 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:29.746111    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdhhh\" (UniqueName: \"kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh\") pod \"network-check-target-78x7g\" (UID: \"792ea57c-0076-4d0f-a836-ee11edfcd5ea\") " pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:29.746317 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:29.746273    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 21:21:29.746317 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:29.746298    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 21:21:29.746317 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:29.746311    2559 projected.go:194] Error preparing data for projected volume kube-api-access-fdhhh for pod openshift-network-diagnostics/network-check-target-78x7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:29.746495 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:29.746388    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh podName:792ea57c-0076-4d0f-a836-ee11edfcd5ea nodeName:}" failed. No retries permitted until 2026-05-21 21:21:30.746367734 +0000 UTC m=+3.179379222 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdhhh" (UniqueName: "kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh") pod "network-check-target-78x7g" (UID: "792ea57c-0076-4d0f-a836-ee11edfcd5ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:30.076072 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:30.075928    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 21:16:29 +0000 UTC" deadline="2027-12-02 15:57:07.041013887 +0000 UTC"
May 21 21:21:30.076072 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:30.075963    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13434h35m36.9650543s"
May 21 21:21:30.186345 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:30.186084    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bdchd" event={"ID":"92a208e0-b4da-41b0-85e2-a5db658ee178","Type":"ContainerStarted","Data":"58086cbe07ae96ae3ac65b9f1ed5c1e7a3e96c25cb5d2d4bf47c6bba6b1f41e9"}
May 21 21:21:30.192003 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:30.191943    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4hz2n" event={"ID":"3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9","Type":"ContainerStarted","Data":"c00f34c43ec35800329913388678374ac82c7f6d389c2bb40b1a1e278df8d606"}
May 21 21:21:30.193704 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:30.193681    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl" event={"ID":"2fca0aa2-40cb-4d6b-8cd1-f73578491f10","Type":"ContainerStarted","Data":"afa5855fd1177d0abe7fedb683c7bb874480374bfaa0668b7bf26cc54bf8eb34"}
May 21 21:21:30.205855 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:30.205742    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5s5xc" event={"ID":"56805f88-45e2-41c0-ac11-aa92e3f555ca","Type":"ContainerStarted","Data":"b1522c5a1f0450508b9f3345d015a259ac71ed93249f43ebcfb4ba72b6f692cd"}
May 21 21:21:30.215639 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:30.215615    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wpdwz" event={"ID":"7886b88e-df8d-407c-9cf6-7a2158eca9c0","Type":"ContainerStarted","Data":"68d9f151620658ee735a6c06c79cf3e6d954e7114953e75efe40af8539e9399e"}
May 21 21:21:30.223825 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:30.223793    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5cj2" event={"ID":"db2f2e21-2561-411b-aedf-e1bcdbf66560","Type":"ContainerStarted","Data":"fa6cb8ab64b435edc8d266ae0b9aeaac03cb5ec694bb9b786364f9fbb9114212"}
May 21 21:21:30.235213 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:30.235154    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s57t7" event={"ID":"909a645a-db62-4ce2-8e92-c7d2380eb4dc","Type":"ContainerStarted","Data":"3b711fc62467deaf7f5c8f2a60f3889c3b6b8a3ae3d8c7e7858ae71bf625b45b"}
May 21 21:21:30.240021 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:30.239994    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vvtx9" event={"ID":"050019f5-56d2-4d47-b7fa-443c92ec5cdd","Type":"ContainerStarted","Data":"cbd0138100ee9e76281524f4344f0b5a60f98c88a8f45c3b52c929ac74895d56"}
May 21 21:21:30.242400 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:30.242377    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr" event={"ID":"bacb9d64-b7a0-4535-adae-872327dd1f03","Type":"ContainerStarted","Data":"8cefaad8938c394c668a6ba5b98e756c3faf4122c9177aa770305d88a840ac87"}
May 21 21:21:30.285132 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:30.285102    2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 21:21:30.493952 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:30.493846    2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 21:21:30.654128 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:30.654083    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs\") pod \"network-metrics-daemon-kj49t\" (UID: \"7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd\") " pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:30.654295 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:30.654245    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:30.654364 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:30.654305    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs podName:7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd nodeName:}" failed. No retries permitted until 2026-05-21 21:21:32.654287954 +0000 UTC m=+5.087299429 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs") pod "network-metrics-daemon-kj49t" (UID: "7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:30.755407 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:30.755319    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdhhh\" (UniqueName: \"kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh\") pod \"network-check-target-78x7g\" (UID: \"792ea57c-0076-4d0f-a836-ee11edfcd5ea\") " pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:30.755558 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:30.755477    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 21:21:30.755558 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:30.755495    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 21:21:30.755558 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:30.755509    2559 projected.go:194] Error preparing data for projected volume kube-api-access-fdhhh for pod openshift-network-diagnostics/network-check-target-78x7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:30.755736 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:30.755564    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh podName:792ea57c-0076-4d0f-a836-ee11edfcd5ea nodeName:}" failed. No retries permitted until 2026-05-21 21:21:32.755547573 +0000 UTC m=+5.188559048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdhhh" (UniqueName: "kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh") pod "network-check-target-78x7g" (UID: "792ea57c-0076-4d0f-a836-ee11edfcd5ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:30.961230 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:30.961200    2559 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 21:21:31.077124 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:31.077077    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 21:16:29 +0000 UTC" deadline="2028-03-01 21:08:49.116822494 +0000 UTC"
May 21 21:21:31.077124 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:31.077118    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15599h47m18.039708528s"
May 21 21:21:31.162098 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:31.162069    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:31.162290 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:31.162208    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj49t" podUID="7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd"
May 21 21:21:31.162682 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:31.162657    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:31.162776 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:31.162747    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78x7g" podUID="792ea57c-0076-4d0f-a836-ee11edfcd5ea"
May 21 21:21:32.670619 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:32.670565    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs\") pod \"network-metrics-daemon-kj49t\" (UID: \"7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd\") " pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:32.671071 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:32.670748    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:32.671071 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:32.670814    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs podName:7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd nodeName:}" failed. No retries permitted until 2026-05-21 21:21:36.670794762 +0000 UTC m=+9.103806246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs") pod "network-metrics-daemon-kj49t" (UID: "7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:32.771290 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:32.771251    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdhhh\" (UniqueName: \"kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh\") pod \"network-check-target-78x7g\" (UID: \"792ea57c-0076-4d0f-a836-ee11edfcd5ea\") " pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:32.771471 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:32.771447    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 21:21:32.771471 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:32.771466    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 21:21:32.771603 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:32.771480    2559 projected.go:194] Error preparing data for projected volume kube-api-access-fdhhh for pod openshift-network-diagnostics/network-check-target-78x7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:32.771603 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:32.771537    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh podName:792ea57c-0076-4d0f-a836-ee11edfcd5ea nodeName:}" failed. No retries permitted until 2026-05-21 21:21:36.771518809 +0000 UTC m=+9.204530288 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdhhh" (UniqueName: "kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh") pod "network-check-target-78x7g" (UID: "792ea57c-0076-4d0f-a836-ee11edfcd5ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:33.163498 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:33.162766    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:33.163498 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:33.162904    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj49t" podUID="7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd"
May 21 21:21:33.163498 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:33.163361    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:33.163498 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:33.163450    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78x7g" podUID="792ea57c-0076-4d0f-a836-ee11edfcd5ea"
May 21 21:21:35.162445 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:35.162412    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:35.162918 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:35.162561    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj49t" podUID="7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd"
May 21 21:21:35.162918 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:35.162421    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:35.162918 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:35.162780    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78x7g" podUID="792ea57c-0076-4d0f-a836-ee11edfcd5ea"
May 21 21:21:36.706148 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:36.706110    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs\") pod \"network-metrics-daemon-kj49t\" (UID: \"7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd\") " pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:36.706491 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:36.706275    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:36.706491 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:36.706333    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs podName:7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd nodeName:}" failed. No retries permitted until 2026-05-21 21:21:44.706314442 +0000 UTC m=+17.139325918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs") pod "network-metrics-daemon-kj49t" (UID: "7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:36.807514 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:36.807479    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdhhh\" (UniqueName: \"kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh\") pod \"network-check-target-78x7g\" (UID: \"792ea57c-0076-4d0f-a836-ee11edfcd5ea\") " pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:36.807728 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:36.807673    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 21:21:36.807728 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:36.807699    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 21:21:36.807728 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:36.807714    2559 projected.go:194] Error preparing data for projected volume kube-api-access-fdhhh for pod openshift-network-diagnostics/network-check-target-78x7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:36.807889 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:36.807779    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh podName:792ea57c-0076-4d0f-a836-ee11edfcd5ea nodeName:}" failed. No retries permitted until 2026-05-21 21:21:44.8077607 +0000 UTC m=+17.240772177 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdhhh" (UniqueName: "kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh") pod "network-check-target-78x7g" (UID: "792ea57c-0076-4d0f-a836-ee11edfcd5ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:37.162544 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:37.162505    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:37.162744 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:37.162681    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78x7g" podUID="792ea57c-0076-4d0f-a836-ee11edfcd5ea"
May 21 21:21:37.163039 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:37.162513    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:37.163169 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:37.163144    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj49t" podUID="7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd"
May 21 21:21:39.162195 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:39.162054    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:39.162195 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:39.162107    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:39.162753 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:39.162211    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj49t" podUID="7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd"
May 21 21:21:39.162753 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:39.162338    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78x7g" podUID="792ea57c-0076-4d0f-a836-ee11edfcd5ea"
May 21 21:21:41.162454 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:41.162420    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:41.162454 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:41.162444    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:41.162967 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:41.162541    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78x7g" podUID="792ea57c-0076-4d0f-a836-ee11edfcd5ea"
May 21 21:21:41.162967 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:41.162688    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj49t" podUID="7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd"
May 21 21:21:43.162450 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:43.162348    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:43.162450 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:43.162406    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:43.162971 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:43.162482    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj49t" podUID="7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd"
May 21 21:21:43.162971 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:43.162568    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78x7g" podUID="792ea57c-0076-4d0f-a836-ee11edfcd5ea"
May 21 21:21:44.767164 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:44.766945    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs\") pod \"network-metrics-daemon-kj49t\" (UID: \"7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd\") " pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:44.767647 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:44.767097    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:44.767647 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:44.767307    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs podName:7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd nodeName:}" failed. No retries permitted until 2026-05-21 21:22:00.767286967 +0000 UTC m=+33.200298444 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs") pod "network-metrics-daemon-kj49t" (UID: "7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:44.868512 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:44.868474    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdhhh\" (UniqueName: \"kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh\") pod \"network-check-target-78x7g\" (UID: \"792ea57c-0076-4d0f-a836-ee11edfcd5ea\") " pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:44.868709 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:44.868667    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 21:21:44.868709 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:44.868690    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 21:21:44.868709 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:44.868701    2559 projected.go:194] Error preparing data for projected volume kube-api-access-fdhhh for pod openshift-network-diagnostics/network-check-target-78x7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:44.868860 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:44.868766    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh podName:792ea57c-0076-4d0f-a836-ee11edfcd5ea nodeName:}" failed. No retries permitted until 2026-05-21 21:22:00.868747836 +0000 UTC m=+33.301759321 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdhhh" (UniqueName: "kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh") pod "network-check-target-78x7g" (UID: "792ea57c-0076-4d0f-a836-ee11edfcd5ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:45.162795 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:45.162760    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:45.162972 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:45.162759    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:45.162972 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:45.162903    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj49t" podUID="7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd"
May 21 21:21:45.162972 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:45.162961    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78x7g" podUID="792ea57c-0076-4d0f-a836-ee11edfcd5ea"
May 21 21:21:47.162672 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:47.162638    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:47.163127 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:47.162640    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:47.163127 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:47.162772    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj49t" podUID="7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd"
May 21 21:21:47.163127 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:47.162839    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78x7g" podUID="792ea57c-0076-4d0f-a836-ee11edfcd5ea"
May 21 21:21:49.162282 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.162110    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:49.163117 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.162115    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:49.163117 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:49.162355    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78x7g" podUID="792ea57c-0076-4d0f-a836-ee11edfcd5ea"
May 21 21:21:49.163117 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:49.162427    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj49t" podUID="7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd"
May 21 21:21:49.285923 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.285805    2559 generic.go:358] "Generic (PLEG): container finished" podID="9314b3678577e7d789a7829260b3bc01" containerID="f8fa6f455c39a42ceee5958425c9a93b5358945de6ce08b14445472c8fe2fc4e" exitCode=0
May 21 21:21:49.285923 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.285838    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal" event={"ID":"9314b3678577e7d789a7829260b3bc01","Type":"ContainerDied","Data":"f8fa6f455c39a42ceee5958425c9a93b5358945de6ce08b14445472c8fe2fc4e"}
May 21 21:21:49.288011 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.287978    2559 generic.go:358] "Generic (PLEG): container finished" podID="db2f2e21-2561-411b-aedf-e1bcdbf66560" containerID="1ac4bc6bc94a2366dc2c1a090123ca1623d401877d6c2e418a71e6ce63c49e5f" exitCode=0
May 21 21:21:49.288123 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.288070    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5cj2" event={"ID":"db2f2e21-2561-411b-aedf-e1bcdbf66560","Type":"ContainerDied","Data":"1ac4bc6bc94a2366dc2c1a090123ca1623d401877d6c2e418a71e6ce63c49e5f"}
May 21 21:21:49.290053 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.290029    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s57t7" event={"ID":"909a645a-db62-4ce2-8e92-c7d2380eb4dc","Type":"ContainerStarted","Data":"9ca699435afb64d5cbec5781581f88ef0692a2a29e68bc7df90752a39be4de50"}
May 21 21:21:49.291570 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.291478    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vvtx9" event={"ID":"050019f5-56d2-4d47-b7fa-443c92ec5cdd","Type":"ContainerStarted","Data":"c878de06fc97e0a84df992e6b4ba6aa8c7ffcd7742075a56d9aa5e3db5aa7154"}
May 21 21:21:49.294874 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.294839    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr" event={"ID":"bacb9d64-b7a0-4535-adae-872327dd1f03","Type":"ContainerStarted","Data":"e1d26e423483eed75f765af8f0db987f617629a8793b8e55724fab914c80d125"}
May 21 21:21:49.294964 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.294872    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr" event={"ID":"bacb9d64-b7a0-4535-adae-872327dd1f03","Type":"ContainerStarted","Data":"0189ba48d3ea72b48401c28208938df54cf3bff7137bc5cca523d52b63473610"}
May 21 21:21:49.294964 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.294888    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr" event={"ID":"bacb9d64-b7a0-4535-adae-872327dd1f03","Type":"ContainerStarted","Data":"88063d6a7daeb1be73dba37917eea30f52f867ab4c853eb84d054ee42d891f4f"}
May 21 21:21:49.294964 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.294900    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr" event={"ID":"bacb9d64-b7a0-4535-adae-872327dd1f03","Type":"ContainerStarted","Data":"118b9b3e8e5ecc3a660fa3a48b2cfbdde6a93368f938be06881c62270e6ef270"}
May 21 21:21:49.294964 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.294914    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr" event={"ID":"bacb9d64-b7a0-4535-adae-872327dd1f03","Type":"ContainerStarted","Data":"7b3ec043b3b95727fb1b226c9183f0289a7e504f81600ea30e57dc3b7c0154c7"}
May 21 21:21:49.294964 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.294926    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr" event={"ID":"bacb9d64-b7a0-4535-adae-872327dd1f03","Type":"ContainerStarted","Data":"f2827e9d97e3812a7a07ee275107c2bd5b9e8db52aeb7c34f6959268a3b18cb6"}
May 21 21:21:49.296393 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.296375    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal" event={"ID":"3b2a50c1e9e4450e9a9c6602d61d82b0","Type":"ContainerStarted","Data":"4d6aade4cfa62f12d0e7ea837c8bd9cecc39ef9bf2d282b6637200f7f0e5793b"}
May 21 21:21:49.297846 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.297825    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bdchd" event={"ID":"92a208e0-b4da-41b0-85e2-a5db658ee178","Type":"ContainerStarted","Data":"7d071fc8644f2ccdd6c1f71ba0ed782917085e96695bee33cf0c57b653f9b3fd"}
May 21 21:21:49.299326 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.299292    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4hz2n" event={"ID":"3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9","Type":"ContainerStarted","Data":"3a420bc0970f6894f0d67a38f0421eb7b31688385cac763e58cc194c41bc40d6"}
May 21 21:21:49.301344 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.301321    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl" event={"ID":"2fca0aa2-40cb-4d6b-8cd1-f73578491f10","Type":"ContainerStarted","Data":"65b90496033cd06f927fb03ba0d752da60afec3c1269d155c96ecf44de12b985"}
May 21 21:21:49.304978 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.304764    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5s5xc" event={"ID":"56805f88-45e2-41c0-ac11-aa92e3f555ca","Type":"ContainerStarted","Data":"10fbb1806c6b344019184cfc20d0680296bc495b106961cf4a0a3a99f99d2f48"}
May 21 21:21:49.313455 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.313417    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal" podStartSLOduration=20.313405401 podStartE2EDuration="20.313405401s" podCreationTimestamp="2026-05-21 21:21:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:21:49.313175848 +0000 UTC m=+21.746187344" watchObservedRunningTime="2026-05-21 21:21:49.313405401 +0000 UTC m=+21.746416895"
May 21 21:21:49.331176 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.331127    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vvtx9" podStartSLOduration=2.696820473 podStartE2EDuration="21.331112825s" podCreationTimestamp="2026-05-21 21:21:28 +0000 UTC" firstStartedPulling="2026-05-21 21:21:29.39288347 +0000 UTC m=+1.825894942" lastFinishedPulling="2026-05-21 21:21:48.027175805 +0000 UTC m=+20.460187294" observedRunningTime="2026-05-21 21:21:49.330965653 +0000 UTC m=+21.763977149" watchObservedRunningTime="2026-05-21 21:21:49.331112825 +0000 UTC m=+21.764124322"
May 21 21:21:49.345261 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.345218    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-4hz2n" podStartSLOduration=2.724618364 podStartE2EDuration="21.345206774s" podCreationTimestamp="2026-05-21 21:21:28 +0000 UTC" firstStartedPulling="2026-05-21 21:21:29.404795468 +0000 UTC m=+1.837806940" lastFinishedPulling="2026-05-21 21:21:48.025383877 +0000 UTC m=+20.458395350" observedRunningTime="2026-05-21 21:21:49.345068365 +0000 UTC m=+21.778079860" watchObservedRunningTime="2026-05-21 21:21:49.345206774 +0000 UTC m=+21.778218268"
May 21 21:21:49.382207 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.382161    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-bdchd" podStartSLOduration=2.749002097 podStartE2EDuration="21.38214766s" podCreationTimestamp="2026-05-21 21:21:28 +0000 UTC" firstStartedPulling="2026-05-21 21:21:29.42410718 +0000 UTC m=+1.857118653" lastFinishedPulling="2026-05-21 21:21:48.057252738 +0000 UTC m=+20.490264216" observedRunningTime="2026-05-21 21:21:49.381924409 +0000 UTC m=+21.814935922" watchObservedRunningTime="2026-05-21 21:21:49.38214766 +0000 UTC m=+21.815159155"
May 21 21:21:49.406608 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.406525    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s57t7" podStartSLOduration=2.8531835279999997 podStartE2EDuration="21.406506736s" podCreationTimestamp="2026-05-21 21:21:28 +0000 UTC" firstStartedPulling="2026-05-21 21:21:29.41080509 +0000 UTC m=+1.843816563" lastFinishedPulling="2026-05-21 21:21:47.964128298 +0000 UTC m=+20.397139771" observedRunningTime="2026-05-21 21:21:49.40625076 +0000 UTC m=+21.839262256" watchObservedRunningTime="2026-05-21 21:21:49.406506736 +0000 UTC m=+21.839518252"
May 21 21:21:49.434666 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.434615    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5s5xc" podStartSLOduration=2.7827220280000002 podStartE2EDuration="21.434600865s" podCreationTimestamp="2026-05-21 21:21:28 +0000 UTC" firstStartedPulling="2026-05-21 21:21:29.353185857 +0000 UTC m=+1.786197331" lastFinishedPulling="2026-05-21 21:21:48.005064691 +0000 UTC m=+20.438076168" observedRunningTime="2026-05-21 21:21:49.434100899 +0000 UTC m=+21.867112395" watchObservedRunningTime="2026-05-21 21:21:49.434600865 +0000 UTC m=+21.867612352"
May 21 21:21:49.744929 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:49.744908    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 21 21:21:50.103151 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:50.103043    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T21:21:49.744925164Z","UUID":"5434b988-7f38-4ec0-889e-c2d5d96f3ece","Handler":null,"Name":"","Endpoint":""}
May 21 21:21:50.106329 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:50.106305    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 21 21:21:50.106479 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:50.106365    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 21 21:21:50.309032 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:50.308979    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl" event={"ID":"2fca0aa2-40cb-4d6b-8cd1-f73578491f10","Type":"ContainerStarted","Data":"a7a9bd2332cb8fd18d4c9f0ea19a5f4200e57f5dfadb4e4998c1b2cbe5333cf6"}
May 21 21:21:50.310826 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:50.310798    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wpdwz" event={"ID":"7886b88e-df8d-407c-9cf6-7a2158eca9c0","Type":"ContainerStarted","Data":"cddac8e6a3d0c08a8c54c401c6881124fab655c17fecab6b256811ecec749c1d"}
May 21 21:21:50.313154 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:50.313115    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal" event={"ID":"9314b3678577e7d789a7829260b3bc01","Type":"ContainerStarted","Data":"af550030ff9ffc55875d9b8004ac7cad33e73be895f2c6a0e45c0165b6a4d86e"}
May 21 21:21:50.339473 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:50.339417    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wpdwz" podStartSLOduration=3.666968891 podStartE2EDuration="22.33940129s" podCreationTimestamp="2026-05-21 21:21:28 +0000 UTC" firstStartedPulling="2026-05-21 21:21:29.350932822 +0000 UTC m=+1.783944295" lastFinishedPulling="2026-05-21 21:21:48.023365212 +0000 UTC m=+20.456376694" observedRunningTime="2026-05-21 21:21:50.324858307 +0000 UTC m=+22.757869802" watchObservedRunningTime="2026-05-21 21:21:50.33940129 +0000 UTC m=+22.772412785"
May 21 21:21:50.339852 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:50.339821    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal" podStartSLOduration=21.339808112 podStartE2EDuration="21.339808112s" podCreationTimestamp="2026-05-21 21:21:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:21:50.339070201 +0000 UTC m=+22.772081697" watchObservedRunningTime="2026-05-21 21:21:50.339808112 +0000 UTC m=+22.772819608"
May 21 21:21:50.967562 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:50.967468    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5s5xc"
May 21 21:21:50.968225 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:50.968204    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5s5xc"
May 21 21:21:51.162634 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:51.162156    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:51.162634 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:51.162283    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78x7g" podUID="792ea57c-0076-4d0f-a836-ee11edfcd5ea"
May 21 21:21:51.162814 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:51.162650    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:51.162814 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:51.162757    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj49t" podUID="7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd"
May 21 21:21:51.316892 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:51.316857    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl" event={"ID":"2fca0aa2-40cb-4d6b-8cd1-f73578491f10","Type":"ContainerStarted","Data":"66f9abf99dcbcd2deab8e4f06dcb48c61498653428610905d27fd9ba3cf42617"}
May 21 21:21:51.319684 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:51.319658    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr" event={"ID":"bacb9d64-b7a0-4535-adae-872327dd1f03","Type":"ContainerStarted","Data":"81366546a4250d400e44d1d5f6be87b18626f61557e95d487a495e6c4ae49489"}
May 21 21:21:51.320020 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:51.320004    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5s5xc"
May 21 21:21:51.320423 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:51.320405    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5s5xc"
May 21 21:21:51.336725 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:51.336679    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gqsl" podStartSLOduration=2.025067004 podStartE2EDuration="23.336664087s" podCreationTimestamp="2026-05-21 21:21:28 +0000 UTC" firstStartedPulling="2026-05-21 21:21:29.400378924 +0000 UTC m=+1.833390410" lastFinishedPulling="2026-05-21 21:21:50.71197602 +0000 UTC m=+23.144987493" observedRunningTime="2026-05-21 21:21:51.336148655 +0000 UTC m=+23.769160172" watchObservedRunningTime="2026-05-21 21:21:51.336664087 +0000 UTC m=+23.769675583"
May 21 21:21:53.162600 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:53.162553    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:53.163095 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:53.162608    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:53.163095 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:53.162689    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj49t" podUID="7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd"
May 21 21:21:53.163095 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:53.162814    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78x7g" podUID="792ea57c-0076-4d0f-a836-ee11edfcd5ea"
May 21 21:21:54.326442 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:54.326262    2559 generic.go:358] "Generic (PLEG): container finished" podID="db2f2e21-2561-411b-aedf-e1bcdbf66560" containerID="b30d87c792e9d6ba4a97a1012f54ffc3074e4636c6b432eb66d1f5979890f121" exitCode=0
May 21 21:21:54.327052 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:54.326344    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5cj2" event={"ID":"db2f2e21-2561-411b-aedf-e1bcdbf66560","Type":"ContainerDied","Data":"b30d87c792e9d6ba4a97a1012f54ffc3074e4636c6b432eb66d1f5979890f121"}
May 21 21:21:54.329830 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:54.329799    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr" event={"ID":"bacb9d64-b7a0-4535-adae-872327dd1f03","Type":"ContainerStarted","Data":"c028bbe73324980e4aab0933343f7014cc0787e29ca762c9f697c0e464036284"}
May 21 21:21:54.330086 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:54.330063    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:54.330191 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:54.330093    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:54.330191 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:54.330104    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:54.344947 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:54.344921    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:54.345074 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:54.345050    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:21:54.375159 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:54.375115    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr" podStartSLOduration=7.317935721 podStartE2EDuration="26.375103196s" podCreationTimestamp="2026-05-21 21:21:28 +0000 UTC" firstStartedPulling="2026-05-21 21:21:29.373915277 +0000 UTC m=+1.806926749" lastFinishedPulling="2026-05-21 21:21:48.431082751 +0000 UTC m=+20.864094224" observedRunningTime="2026-05-21 21:21:54.374813786 +0000 UTC m=+26.807825310" watchObservedRunningTime="2026-05-21 21:21:54.375103196 +0000 UTC m=+26.808114690"
May 21 21:21:55.161975 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:55.161951    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:55.162083 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:55.161951    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:55.162083 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:55.162061    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78x7g" podUID="792ea57c-0076-4d0f-a836-ee11edfcd5ea"
May 21 21:21:55.162155 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:55.162130    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj49t" podUID="7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd"
May 21 21:21:55.334837 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:55.334800    2559 generic.go:358] "Generic (PLEG): container finished" podID="db2f2e21-2561-411b-aedf-e1bcdbf66560" containerID="ffb1fd707fff40f6305ae91b6789d2aa4e432090436ca72c10ba0e08b7e4e6ef" exitCode=0
May 21 21:21:55.335527 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:55.334884    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5cj2" event={"ID":"db2f2e21-2561-411b-aedf-e1bcdbf66560","Type":"ContainerDied","Data":"ffb1fd707fff40f6305ae91b6789d2aa4e432090436ca72c10ba0e08b7e4e6ef"}
May 21 21:21:55.556080 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:55.555862    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-78x7g"]
May 21 21:21:55.556274 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:55.556150    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:55.556274 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:55.556246    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78x7g" podUID="792ea57c-0076-4d0f-a836-ee11edfcd5ea"
May 21 21:21:55.556468 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:55.556446    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kj49t"]
May 21 21:21:55.556573 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:55.556557    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:55.556704 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:55.556679    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj49t" podUID="7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd"
May 21 21:21:56.338783 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:56.338747    2559 generic.go:358] "Generic (PLEG): container finished" podID="db2f2e21-2561-411b-aedf-e1bcdbf66560" containerID="3e3662ecc71a09de1f96e5fbe22a0344575a9ae3c91bdfb4ba6ba0453657a354" exitCode=0
May 21 21:21:56.339240 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:56.338836    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5cj2" event={"ID":"db2f2e21-2561-411b-aedf-e1bcdbf66560","Type":"ContainerDied","Data":"3e3662ecc71a09de1f96e5fbe22a0344575a9ae3c91bdfb4ba6ba0453657a354"}
May 21 21:21:57.162725 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:57.162690    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:57.162894 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:57.162691    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:57.162894 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:57.162824    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78x7g" podUID="792ea57c-0076-4d0f-a836-ee11edfcd5ea"
May 21 21:21:57.163019 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:57.162898    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj49t" podUID="7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd"
May 21 21:21:59.162548 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:59.162461    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:21:59.163005 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:21:59.162470    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:21:59.163005 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:59.162569    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78x7g" podUID="792ea57c-0076-4d0f-a836-ee11edfcd5ea"
May 21 21:21:59.163005 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:21:59.162697    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj49t" podUID="7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd"
May 21 21:22:00.787164 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:00.787129    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs\") pod \"network-metrics-daemon-kj49t\" (UID: \"7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd\") " pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:22:00.787636 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:00.787300    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:22:00.787636 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:00.787374    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs podName:7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd nodeName:}" failed. No retries permitted until 2026-05-21 21:22:32.787353631 +0000 UTC m=+65.220365114 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs") pod "network-metrics-daemon-kj49t" (UID: "7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:22:00.887849 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:00.887819    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdhhh\" (UniqueName: \"kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh\") pod \"network-check-target-78x7g\" (UID: \"792ea57c-0076-4d0f-a836-ee11edfcd5ea\") " pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:22:00.887979 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:00.887944    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 21:22:00.887979 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:00.887962    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 21:22:00.887979 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:00.887978    2559 projected.go:194] Error preparing data for projected volume kube-api-access-fdhhh for pod openshift-network-diagnostics/network-check-target-78x7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:22:00.888104 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:00.888036    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh podName:792ea57c-0076-4d0f-a836-ee11edfcd5ea nodeName:}" failed. No retries permitted until 2026-05-21 21:22:32.888017338 +0000 UTC m=+65.321028816 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdhhh" (UniqueName: "kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh") pod "network-check-target-78x7g" (UID: "792ea57c-0076-4d0f-a836-ee11edfcd5ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:22:01.162864 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.162829    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:22:01.163118 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.162830    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:22:01.163118 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:01.162953    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj49t" podUID="7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd"
May 21 21:22:01.163118 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:01.163044    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78x7g" podUID="792ea57c-0076-4d0f-a836-ee11edfcd5ea"
May 21 21:22:01.367678 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.367641    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeReady"
May 21 21:22:01.367943 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.367810    2559 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 21 21:22:01.412765 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.412729    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kp68l"]
May 21 21:22:01.437407 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.437332    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jrlsm"]
May 21 21:22:01.437596 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.437567    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kp68l"
May 21 21:22:01.440393 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.440363    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bvcxl\""
May 21 21:22:01.440393 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.440363    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 21 21:22:01.440564 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.440363    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 21 21:22:01.457428 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.457373    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kp68l"]
May 21 21:22:01.457548 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.457450    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jrlsm"]
May 21 21:22:01.457548 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.457476    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jrlsm"
May 21 21:22:01.461041 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.460996    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 21 21:22:01.461200 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.460996    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6c5qz\""
May 21 21:22:01.461400 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.461382    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 21 21:22:01.461467 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.461405    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 21 21:22:01.591803 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.591759    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert\") pod \"ingress-canary-jrlsm\" (UID: \"0f00757c-1b31-47a9-8bf6-49cd582be267\") " pod="openshift-ingress-canary/ingress-canary-jrlsm"
May 21 21:22:01.592003 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.591880    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vlhm\" (UniqueName: \"kubernetes.io/projected/78c14074-82e5-4559-94e6-79a10e02938d-kube-api-access-7vlhm\") pod \"dns-default-kp68l\" (UID: \"78c14074-82e5-4559-94e6-79a10e02938d\") " pod="openshift-dns/dns-default-kp68l"
May 21 21:22:01.592003 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.591928    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9nl4\" (UniqueName: \"kubernetes.io/projected/0f00757c-1b31-47a9-8bf6-49cd582be267-kube-api-access-s9nl4\") pod \"ingress-canary-jrlsm\" (UID: \"0f00757c-1b31-47a9-8bf6-49cd582be267\") " pod="openshift-ingress-canary/ingress-canary-jrlsm"
May 21 21:22:01.592003 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.591955    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78c14074-82e5-4559-94e6-79a10e02938d-config-volume\") pod \"dns-default-kp68l\" (UID: \"78c14074-82e5-4559-94e6-79a10e02938d\") " pod="openshift-dns/dns-default-kp68l"
May 21 21:22:01.592155 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.592032    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78c14074-82e5-4559-94e6-79a10e02938d-tmp-dir\") pod \"dns-default-kp68l\" (UID: \"78c14074-82e5-4559-94e6-79a10e02938d\") " pod="openshift-dns/dns-default-kp68l"
May 21 21:22:01.592155 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.592079    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls\") pod \"dns-default-kp68l\" (UID: \"78c14074-82e5-4559-94e6-79a10e02938d\") " pod="openshift-dns/dns-default-kp68l"
May 21 21:22:01.693466 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.693386    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert\") pod \"ingress-canary-jrlsm\" (UID: \"0f00757c-1b31-47a9-8bf6-49cd582be267\") " pod="openshift-ingress-canary/ingress-canary-jrlsm"
May 21 21:22:01.693466 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.693461    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vlhm\" (UniqueName: \"kubernetes.io/projected/78c14074-82e5-4559-94e6-79a10e02938d-kube-api-access-7vlhm\") pod \"dns-default-kp68l\" (UID: \"78c14074-82e5-4559-94e6-79a10e02938d\") " pod="openshift-dns/dns-default-kp68l"
May 21 21:22:01.693710 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.693491    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s9nl4\" (UniqueName: \"kubernetes.io/projected/0f00757c-1b31-47a9-8bf6-49cd582be267-kube-api-access-s9nl4\") pod \"ingress-canary-jrlsm\" (UID: \"0f00757c-1b31-47a9-8bf6-49cd582be267\") " pod="openshift-ingress-canary/ingress-canary-jrlsm"
May 21 21:22:01.693710 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.693520    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78c14074-82e5-4559-94e6-79a10e02938d-config-volume\") pod \"dns-default-kp68l\" (UID: \"78c14074-82e5-4559-94e6-79a10e02938d\") " pod="openshift-dns/dns-default-kp68l"
May 21 21:22:01.693710 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.693552    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78c14074-82e5-4559-94e6-79a10e02938d-tmp-dir\") pod \"dns-default-kp68l\" (UID: \"78c14074-82e5-4559-94e6-79a10e02938d\") " pod="openshift-dns/dns-default-kp68l"
May 21 21:22:01.693710 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:01.693554    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 21:22:01.693710 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.693576    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls\") pod \"dns-default-kp68l\" (UID: \"78c14074-82e5-4559-94e6-79a10e02938d\") " pod="openshift-dns/dns-default-kp68l"
May 21 21:22:01.693710 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:01.693634    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert podName:0f00757c-1b31-47a9-8bf6-49cd582be267 nodeName:}" failed. No retries permitted until 2026-05-21 21:22:02.193612057 +0000 UTC m=+34.626623529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert") pod "ingress-canary-jrlsm" (UID: "0f00757c-1b31-47a9-8bf6-49cd582be267") : secret "canary-serving-cert" not found
May 21 21:22:01.694079 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:01.693745    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 21:22:01.694079 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:01.693783    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls podName:78c14074-82e5-4559-94e6-79a10e02938d nodeName:}" failed. No retries permitted until 2026-05-21 21:22:02.193769744 +0000 UTC m=+34.626781216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls") pod "dns-default-kp68l" (UID: "78c14074-82e5-4559-94e6-79a10e02938d") : secret "dns-default-metrics-tls" not found
May 21 21:22:01.694079 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.694067    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78c14074-82e5-4559-94e6-79a10e02938d-tmp-dir\") pod \"dns-default-kp68l\" (UID: \"78c14074-82e5-4559-94e6-79a10e02938d\") " pod="openshift-dns/dns-default-kp68l"
May 21 21:22:01.694349 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.694326    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78c14074-82e5-4559-94e6-79a10e02938d-config-volume\") pod \"dns-default-kp68l\" (UID: \"78c14074-82e5-4559-94e6-79a10e02938d\") " pod="openshift-dns/dns-default-kp68l"
May 21 21:22:01.711241 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.711062    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vlhm\" (UniqueName: \"kubernetes.io/projected/78c14074-82e5-4559-94e6-79a10e02938d-kube-api-access-7vlhm\") pod \"dns-default-kp68l\" (UID: \"78c14074-82e5-4559-94e6-79a10e02938d\") " pod="openshift-dns/dns-default-kp68l"
May 21 21:22:01.711385 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:01.711291    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9nl4\" (UniqueName: \"kubernetes.io/projected/0f00757c-1b31-47a9-8bf6-49cd582be267-kube-api-access-s9nl4\") pod \"ingress-canary-jrlsm\" (UID: \"0f00757c-1b31-47a9-8bf6-49cd582be267\") " pod="openshift-ingress-canary/ingress-canary-jrlsm"
May 21 21:22:02.198489 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:02.198453    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls\") pod \"dns-default-kp68l\" (UID: \"78c14074-82e5-4559-94e6-79a10e02938d\") " pod="openshift-dns/dns-default-kp68l"
May 21 21:22:02.198895 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:02.198498    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert\") pod \"ingress-canary-jrlsm\" (UID: \"0f00757c-1b31-47a9-8bf6-49cd582be267\") " pod="openshift-ingress-canary/ingress-canary-jrlsm"
May 21 21:22:02.198895 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:02.198635    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 21:22:02.198895 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:02.198698    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls podName:78c14074-82e5-4559-94e6-79a10e02938d nodeName:}" failed. No retries permitted until 2026-05-21 21:22:03.198682437 +0000 UTC m=+35.631693916 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls") pod "dns-default-kp68l" (UID: "78c14074-82e5-4559-94e6-79a10e02938d") : secret "dns-default-metrics-tls" not found
May 21 21:22:02.198895 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:02.198635    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 21:22:02.198895 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:02.198763    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert podName:0f00757c-1b31-47a9-8bf6-49cd582be267 nodeName:}" failed. No retries permitted until 2026-05-21 21:22:03.198751731 +0000 UTC m=+35.631763221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert") pod "ingress-canary-jrlsm" (UID: "0f00757c-1b31-47a9-8bf6-49cd582be267") : secret "canary-serving-cert" not found
May 21 21:22:03.162402 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:03.162371    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:22:03.162581 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:03.162372    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:22:03.165414 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:03.165399    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 21:22:03.166920 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:03.166905    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 21:22:03.166994 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:03.166944    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 21:22:03.167051 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:03.166946    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xmr9w\""
May 21 21:22:03.167051 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:03.166946    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jqv7p\""
May 21 21:22:03.206793 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:03.206766    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls\") pod \"dns-default-kp68l\" (UID: \"78c14074-82e5-4559-94e6-79a10e02938d\") " pod="openshift-dns/dns-default-kp68l"
May 21 21:22:03.207202 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:03.206817    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert\") pod \"ingress-canary-jrlsm\" (UID: \"0f00757c-1b31-47a9-8bf6-49cd582be267\") " pod="openshift-ingress-canary/ingress-canary-jrlsm"
May 21 21:22:03.207202 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:03.206914    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 21:22:03.207202 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:03.206915    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 21:22:03.207202 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:03.206969    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls podName:78c14074-82e5-4559-94e6-79a10e02938d nodeName:}" failed. No retries permitted until 2026-05-21 21:22:05.206954757 +0000 UTC m=+37.639966235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls") pod "dns-default-kp68l" (UID: "78c14074-82e5-4559-94e6-79a10e02938d") : secret "dns-default-metrics-tls" not found
May 21 21:22:03.207202 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:03.207043    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert podName:0f00757c-1b31-47a9-8bf6-49cd582be267 nodeName:}" failed. No retries permitted until 2026-05-21 21:22:05.207027084 +0000 UTC m=+37.640038571 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert") pod "ingress-canary-jrlsm" (UID: "0f00757c-1b31-47a9-8bf6-49cd582be267") : secret "canary-serving-cert" not found
May 21 21:22:03.352874 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:03.352843    2559 generic.go:358] "Generic (PLEG): container finished" podID="db2f2e21-2561-411b-aedf-e1bcdbf66560" containerID="bc9672a39a1bf150f090b4b615d6371965629a16eb9409541cf5378a12c26272" exitCode=0
May 21 21:22:03.353033 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:03.352901    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5cj2" event={"ID":"db2f2e21-2561-411b-aedf-e1bcdbf66560","Type":"ContainerDied","Data":"bc9672a39a1bf150f090b4b615d6371965629a16eb9409541cf5378a12c26272"}
May 21 21:22:04.357328 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:04.357294    2559 generic.go:358] "Generic (PLEG): container finished" podID="db2f2e21-2561-411b-aedf-e1bcdbf66560" containerID="842165bbf4676dcafbc38bb799a0f667a6c1316c174ba41588661312f179cf23" exitCode=0
May 21 21:22:04.357811 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:04.357368    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5cj2" event={"ID":"db2f2e21-2561-411b-aedf-e1bcdbf66560","Type":"ContainerDied","Data":"842165bbf4676dcafbc38bb799a0f667a6c1316c174ba41588661312f179cf23"}
May 21 21:22:05.222263 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:05.222212    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls\") pod \"dns-default-kp68l\" (UID: \"78c14074-82e5-4559-94e6-79a10e02938d\") " pod="openshift-dns/dns-default-kp68l"
May 21 21:22:05.222263 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:05.222261    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert\") pod \"ingress-canary-jrlsm\" (UID: \"0f00757c-1b31-47a9-8bf6-49cd582be267\") " pod="openshift-ingress-canary/ingress-canary-jrlsm"
May 21 21:22:05.222451 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:05.222369    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 21:22:05.222451 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:05.222447    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls podName:78c14074-82e5-4559-94e6-79a10e02938d nodeName:}" failed. No retries permitted until 2026-05-21 21:22:09.222432281 +0000 UTC m=+41.655443754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls") pod "dns-default-kp68l" (UID: "78c14074-82e5-4559-94e6-79a10e02938d") : secret "dns-default-metrics-tls" not found
May 21 21:22:05.222526 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:05.222373    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 21:22:05.222526 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:05.222503    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert podName:0f00757c-1b31-47a9-8bf6-49cd582be267 nodeName:}" failed. No retries permitted until 2026-05-21 21:22:09.222486651 +0000 UTC m=+41.655498124 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert") pod "ingress-canary-jrlsm" (UID: "0f00757c-1b31-47a9-8bf6-49cd582be267") : secret "canary-serving-cert" not found
May 21 21:22:05.362563 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:05.362492    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5cj2" event={"ID":"db2f2e21-2561-411b-aedf-e1bcdbf66560","Type":"ContainerStarted","Data":"534f99a1e39d4a46bf210f0d343ac472d8e5fd9cfb1a34c58d191646bf4740d2"}
May 21 21:22:05.387128 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:05.387083    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v5cj2" podStartSLOduration=4.352607925 podStartE2EDuration="37.387068468s" podCreationTimestamp="2026-05-21 21:21:28 +0000 UTC" firstStartedPulling="2026-05-21 21:21:29.42085641 +0000 UTC m=+1.853867883" lastFinishedPulling="2026-05-21 21:22:02.455316939 +0000 UTC m=+34.888328426" observedRunningTime="2026-05-21 21:22:05.385007642 +0000 UTC m=+37.818019116" watchObservedRunningTime="2026-05-21 21:22:05.387068468 +0000 UTC m=+37.820079963"
May 21 21:22:09.249858 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:09.249824    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls\") pod \"dns-default-kp68l\" (UID: \"78c14074-82e5-4559-94e6-79a10e02938d\") " pod="openshift-dns/dns-default-kp68l"
May 21 21:22:09.249858 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:09.249865    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert\") pod \"ingress-canary-jrlsm\" (UID: \"0f00757c-1b31-47a9-8bf6-49cd582be267\") " pod="openshift-ingress-canary/ingress-canary-jrlsm"
May 21 21:22:09.250342 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:09.249963    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 21:22:09.250342 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:09.249964    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 21:22:09.250342 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:09.250011    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert podName:0f00757c-1b31-47a9-8bf6-49cd582be267 nodeName:}" failed. No retries permitted until 2026-05-21 21:22:17.249998377 +0000 UTC m=+49.683009854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert") pod "ingress-canary-jrlsm" (UID: "0f00757c-1b31-47a9-8bf6-49cd582be267") : secret "canary-serving-cert" not found
May 21 21:22:09.250342 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:09.250024    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls podName:78c14074-82e5-4559-94e6-79a10e02938d nodeName:}" failed. No retries permitted until 2026-05-21 21:22:17.25001831 +0000 UTC m=+49.683029783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls") pod "dns-default-kp68l" (UID: "78c14074-82e5-4559-94e6-79a10e02938d") : secret "dns-default-metrics-tls" not found
May 21 21:22:17.307128 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:17.307082    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls\") pod \"dns-default-kp68l\" (UID: \"78c14074-82e5-4559-94e6-79a10e02938d\") " pod="openshift-dns/dns-default-kp68l"
May 21 21:22:17.321286 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:17.307139    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert\") pod \"ingress-canary-jrlsm\" (UID: \"0f00757c-1b31-47a9-8bf6-49cd582be267\") " pod="openshift-ingress-canary/ingress-canary-jrlsm"
May 21 21:22:17.321286 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:17.307237    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 21:22:17.321286 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:17.307261    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 21:22:17.321286 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:17.307307    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls podName:78c14074-82e5-4559-94e6-79a10e02938d nodeName:}" failed. No retries permitted until 2026-05-21 21:22:33.307289896 +0000 UTC m=+65.740301374 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls") pod "dns-default-kp68l" (UID: "78c14074-82e5-4559-94e6-79a10e02938d") : secret "dns-default-metrics-tls" not found
May 21 21:22:17.321286 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:17.307344    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert podName:0f00757c-1b31-47a9-8bf6-49cd582be267 nodeName:}" failed. No retries permitted until 2026-05-21 21:22:33.307327375 +0000 UTC m=+65.740338847 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert") pod "ingress-canary-jrlsm" (UID: "0f00757c-1b31-47a9-8bf6-49cd582be267") : secret "canary-serving-cert" not found
May 21 21:22:17.633820 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:17.633753    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88f94bff-pftn7"]
May 21 21:22:17.668031 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:17.668002    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88f94bff-pftn7"]
May 21 21:22:17.668031 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:17.668030    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88f94bff-pftn7"
May 21 21:22:17.671026 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:17.671008    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 21 21:22:17.672016 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:17.671998    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 21 21:22:17.672105 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:17.672005    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 21 21:22:17.672105 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:17.672029    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 21 21:22:17.811463 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:17.811419    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82ab6eb7-3ea1-4279-89dc-d6536a71623c-tmp\") pod \"klusterlet-addon-workmgr-5d88f94bff-pftn7\" (UID: \"82ab6eb7-3ea1-4279-89dc-d6536a71623c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88f94bff-pftn7"
May 21 21:22:17.811463 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:17.811465    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/82ab6eb7-3ea1-4279-89dc-d6536a71623c-klusterlet-config\") pod \"klusterlet-addon-workmgr-5d88f94bff-pftn7\" (UID: \"82ab6eb7-3ea1-4279-89dc-d6536a71623c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88f94bff-pftn7"
May 21 21:22:17.811711 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:17.811552    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6grt\" (UniqueName: \"kubernetes.io/projected/82ab6eb7-3ea1-4279-89dc-d6536a71623c-kube-api-access-g6grt\") pod \"klusterlet-addon-workmgr-5d88f94bff-pftn7\" (UID: \"82ab6eb7-3ea1-4279-89dc-d6536a71623c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88f94bff-pftn7"
May 21 21:22:17.912561 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:17.912491    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g6grt\" (UniqueName: \"kubernetes.io/projected/82ab6eb7-3ea1-4279-89dc-d6536a71623c-kube-api-access-g6grt\") pod \"klusterlet-addon-workmgr-5d88f94bff-pftn7\" (UID: \"82ab6eb7-3ea1-4279-89dc-d6536a71623c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88f94bff-pftn7"
May 21 21:22:17.912561 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:17.912554    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82ab6eb7-3ea1-4279-89dc-d6536a71623c-tmp\") pod \"klusterlet-addon-workmgr-5d88f94bff-pftn7\" (UID: \"82ab6eb7-3ea1-4279-89dc-d6536a71623c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88f94bff-pftn7"
May 21 21:22:17.912790 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:17.912763    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/82ab6eb7-3ea1-4279-89dc-d6536a71623c-klusterlet-config\") pod \"klusterlet-addon-workmgr-5d88f94bff-pftn7\" (UID: \"82ab6eb7-3ea1-4279-89dc-d6536a71623c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88f94bff-pftn7"
May 21 21:22:17.912921 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:17.912855    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82ab6eb7-3ea1-4279-89dc-d6536a71623c-tmp\") pod \"klusterlet-addon-workmgr-5d88f94bff-pftn7\" (UID: \"82ab6eb7-3ea1-4279-89dc-d6536a71623c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88f94bff-pftn7"
May 21 21:22:17.915553 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:17.915523    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/82ab6eb7-3ea1-4279-89dc-d6536a71623c-klusterlet-config\") pod \"klusterlet-addon-workmgr-5d88f94bff-pftn7\" (UID: \"82ab6eb7-3ea1-4279-89dc-d6536a71623c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88f94bff-pftn7"
May 21 21:22:17.920857 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:17.920838    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6grt\" (UniqueName: \"kubernetes.io/projected/82ab6eb7-3ea1-4279-89dc-d6536a71623c-kube-api-access-g6grt\") pod \"klusterlet-addon-workmgr-5d88f94bff-pftn7\" (UID: \"82ab6eb7-3ea1-4279-89dc-d6536a71623c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88f94bff-pftn7"
May 21 21:22:17.977730 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:17.977701    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88f94bff-pftn7"
May 21 21:22:18.154230 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:18.154202    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88f94bff-pftn7"]
May 21 21:22:18.159190 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:22:18.159164    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ab6eb7_3ea1_4279_89dc_d6536a71623c.slice/crio-a1b9470d6eb8e8fea6ce9dc24ad460e11c98bfb93f8a0b88bcd6844df9137677 WatchSource:0}: Error finding container a1b9470d6eb8e8fea6ce9dc24ad460e11c98bfb93f8a0b88bcd6844df9137677: Status 404 returned error can't find the container with id a1b9470d6eb8e8fea6ce9dc24ad460e11c98bfb93f8a0b88bcd6844df9137677
May 21 21:22:18.385541 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:18.385502    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88f94bff-pftn7" event={"ID":"82ab6eb7-3ea1-4279-89dc-d6536a71623c","Type":"ContainerStarted","Data":"a1b9470d6eb8e8fea6ce9dc24ad460e11c98bfb93f8a0b88bcd6844df9137677"}
May 21 21:22:23.398011 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:23.397974    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88f94bff-pftn7" event={"ID":"82ab6eb7-3ea1-4279-89dc-d6536a71623c","Type":"ContainerStarted","Data":"287e51f13ca90af37e2276e40876c363a4194e797c46495afa2283ab03b292b6"}
May 21 21:22:23.398389 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:23.398194    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88f94bff-pftn7"
May 21 21:22:23.399836 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:23.399816    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88f94bff-pftn7"
May 21 21:22:23.413547 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:23.413507    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88f94bff-pftn7" podStartSLOduration=1.6956891490000001 podStartE2EDuration="6.413496002s" podCreationTimestamp="2026-05-21 21:22:17 +0000 UTC" firstStartedPulling="2026-05-21 21:22:18.161546726 +0000 UTC m=+50.594558212" lastFinishedPulling="2026-05-21 21:22:22.879353583 +0000 UTC m=+55.312365065" observedRunningTime="2026-05-21 21:22:23.412384545 +0000 UTC m=+55.845396042" watchObservedRunningTime="2026-05-21 21:22:23.413496002 +0000 UTC m=+55.846507496"
May 21 21:22:26.348968 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:26.348943    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdmjr"
May 21 21:22:32.821216 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:32.821180    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs\") pod \"network-metrics-daemon-kj49t\" (UID: \"7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd\") " pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:22:32.823987 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:32.823967    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 21:22:32.832239 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:32.832221    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 21:22:32.832313 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:32.832276    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs podName:7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd nodeName:}" failed. No retries permitted until 2026-05-21 21:23:36.832260064 +0000 UTC m=+129.265271537 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs") pod "network-metrics-daemon-kj49t" (UID: "7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd") : secret "metrics-daemon-secret" not found
May 21 21:22:32.922223 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:32.922191    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdhhh\" (UniqueName: \"kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh\") pod \"network-check-target-78x7g\" (UID: \"792ea57c-0076-4d0f-a836-ee11edfcd5ea\") " pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:22:32.928303 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:32.928283    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 21:22:32.935871 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:32.935852    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 21:22:32.946243 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:32.946212    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdhhh\" (UniqueName: \"kubernetes.io/projected/792ea57c-0076-4d0f-a836-ee11edfcd5ea-kube-api-access-fdhhh\") pod \"network-check-target-78x7g\" (UID: \"792ea57c-0076-4d0f-a836-ee11edfcd5ea\") " pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:22:33.175276 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:33.175205    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xmr9w\""
May 21 21:22:33.183438 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:33.183420    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:22:33.301272 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:33.301239    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-78x7g"]
May 21 21:22:33.304561 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:22:33.304536    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod792ea57c_0076_4d0f_a836_ee11edfcd5ea.slice/crio-48ae45f5abd5d45c4d656a83130cdff03d984aca5b2393b4fea69af89d13f14f WatchSource:0}: Error finding container 48ae45f5abd5d45c4d656a83130cdff03d984aca5b2393b4fea69af89d13f14f: Status 404 returned error can't find the container with id 48ae45f5abd5d45c4d656a83130cdff03d984aca5b2393b4fea69af89d13f14f
May 21 21:22:33.325466 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:33.325444    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert\") pod \"ingress-canary-jrlsm\" (UID: \"0f00757c-1b31-47a9-8bf6-49cd582be267\") " pod="openshift-ingress-canary/ingress-canary-jrlsm"
May 21 21:22:33.325567 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:33.325520    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls\") pod \"dns-default-kp68l\" (UID: \"78c14074-82e5-4559-94e6-79a10e02938d\") " pod="openshift-dns/dns-default-kp68l"
May 21 21:22:33.325636 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:33.325617    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 21:22:33.325636 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:33.325629    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 21:22:33.325699 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:33.325680    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls podName:78c14074-82e5-4559-94e6-79a10e02938d nodeName:}" failed. No retries permitted until 2026-05-21 21:23:05.32566648 +0000 UTC m=+97.758677954 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls") pod "dns-default-kp68l" (UID: "78c14074-82e5-4559-94e6-79a10e02938d") : secret "dns-default-metrics-tls" not found
May 21 21:22:33.325699 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:33.325692    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert podName:0f00757c-1b31-47a9-8bf6-49cd582be267 nodeName:}" failed. No retries permitted until 2026-05-21 21:23:05.325686595 +0000 UTC m=+97.758698068 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert") pod "ingress-canary-jrlsm" (UID: "0f00757c-1b31-47a9-8bf6-49cd582be267") : secret "canary-serving-cert" not found
May 21 21:22:33.420372 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:33.420337    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-78x7g" event={"ID":"792ea57c-0076-4d0f-a836-ee11edfcd5ea","Type":"ContainerStarted","Data":"48ae45f5abd5d45c4d656a83130cdff03d984aca5b2393b4fea69af89d13f14f"}
May 21 21:22:36.428355 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:36.428261    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-78x7g" event={"ID":"792ea57c-0076-4d0f-a836-ee11edfcd5ea","Type":"ContainerStarted","Data":"8e97c030870bc3380848b0241458f55a4c3fea84286d4831a1489fb8ee4341a2"}
May 21 21:22:36.428724 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:36.428527    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:22:36.444008 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:36.443967    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-78x7g" podStartSLOduration=65.603856425 podStartE2EDuration="1m8.443955818s" podCreationTimestamp="2026-05-21 21:21:28 +0000 UTC" firstStartedPulling="2026-05-21 21:22:33.306455206 +0000 UTC m=+65.739466679" lastFinishedPulling="2026-05-21 21:22:36.14655459 +0000 UTC m=+68.579566072" observedRunningTime="2026-05-21 21:22:36.443816456 +0000 UTC m=+68.876827945" watchObservedRunningTime="2026-05-21 21:22:36.443955818 +0000 UTC m=+68.876967314"
May 21 21:22:47.615643 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:47.615526    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc"]
May 21 21:22:47.617378 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:47.617363    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc"
May 21 21:22:47.620031 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:47.620012    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 21 21:22:47.621221 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:47.621200    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 21 21:22:47.621726 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:47.621707    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bdg7k\""
May 21 21:22:47.623608 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:47.623282    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 21 21:22:47.623608 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:47.623365    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 21 21:22:47.647082 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:47.647038    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc"]
May 21 21:22:47.721442 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:47.721409    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8v8x\" (UniqueName: \"kubernetes.io/projected/56955214-c7d1-4bda-9f1e-2abd74ff1f85-kube-api-access-n8v8x\") pod \"cluster-monitoring-operator-6c75959455-8xcxc\" (UID: \"56955214-c7d1-4bda-9f1e-2abd74ff1f85\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc"
May 21 21:22:47.721571 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:47.721458    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/56955214-c7d1-4bda-9f1e-2abd74ff1f85-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-8xcxc\" (UID: \"56955214-c7d1-4bda-9f1e-2abd74ff1f85\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc"
May 21 21:22:47.721571 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:47.721550    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-8xcxc\" (UID: \"56955214-c7d1-4bda-9f1e-2abd74ff1f85\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc"
May 21 21:22:47.822741 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:47.822701    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-8xcxc\" (UID: \"56955214-c7d1-4bda-9f1e-2abd74ff1f85\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc"
May 21 21:22:47.822929 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:47.822774    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n8v8x\" (UniqueName: \"kubernetes.io/projected/56955214-c7d1-4bda-9f1e-2abd74ff1f85-kube-api-access-n8v8x\") pod \"cluster-monitoring-operator-6c75959455-8xcxc\" (UID: \"56955214-c7d1-4bda-9f1e-2abd74ff1f85\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc"
May 21 21:22:47.822929 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:47.822810    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/56955214-c7d1-4bda-9f1e-2abd74ff1f85-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-8xcxc\" (UID: \"56955214-c7d1-4bda-9f1e-2abd74ff1f85\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc"
May 21 21:22:47.822929 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:47.822864    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 21:22:47.823091 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:47.822958    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls podName:56955214-c7d1-4bda-9f1e-2abd74ff1f85 nodeName:}" failed. No retries permitted until 2026-05-21 21:22:48.322938452 +0000 UTC m=+80.755949941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-8xcxc" (UID: "56955214-c7d1-4bda-9f1e-2abd74ff1f85") : secret "cluster-monitoring-operator-tls" not found
May 21 21:22:47.823486 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:47.823464    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/56955214-c7d1-4bda-9f1e-2abd74ff1f85-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-8xcxc\" (UID: \"56955214-c7d1-4bda-9f1e-2abd74ff1f85\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc"
May 21 21:22:47.832085 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:47.832057    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8v8x\" (UniqueName: \"kubernetes.io/projected/56955214-c7d1-4bda-9f1e-2abd74ff1f85-kube-api-access-n8v8x\") pod \"cluster-monitoring-operator-6c75959455-8xcxc\" (UID: \"56955214-c7d1-4bda-9f1e-2abd74ff1f85\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc"
May 21 21:22:48.325843 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:48.325799    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-8xcxc\" (UID: \"56955214-c7d1-4bda-9f1e-2abd74ff1f85\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc"
May 21 21:22:48.326040 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:48.325969    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 21:22:48.326106 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:48.326052    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls podName:56955214-c7d1-4bda-9f1e-2abd74ff1f85 nodeName:}" failed. No retries permitted until 2026-05-21 21:22:49.326029984 +0000 UTC m=+81.759041463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-8xcxc" (UID: "56955214-c7d1-4bda-9f1e-2abd74ff1f85") : secret "cluster-monitoring-operator-tls" not found
May 21 21:22:49.333859 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:49.333802    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-8xcxc\" (UID: \"56955214-c7d1-4bda-9f1e-2abd74ff1f85\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc"
May 21 21:22:49.334257 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:49.333949    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 21:22:49.334257 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:49.334016    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls podName:56955214-c7d1-4bda-9f1e-2abd74ff1f85 nodeName:}" failed. No retries permitted until 2026-05-21 21:22:51.334001088 +0000 UTC m=+83.767012561 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-8xcxc" (UID: "56955214-c7d1-4bda-9f1e-2abd74ff1f85") : secret "cluster-monitoring-operator-tls" not found
May 21 21:22:50.605059 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:50.605028    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-pvsqr"]
May 21 21:22:50.608723 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:50.608703    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-pvsqr"
May 21 21:22:50.611565 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:50.611543    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 21 21:22:50.612783 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:50.612759    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 21 21:22:50.613046 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:50.612797    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 21 21:22:50.613046 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:50.612810    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-lk75n\""
May 21 21:22:50.613046 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:50.612897    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 21 21:22:50.614699 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:50.614678    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-pvsqr"]
May 21 21:22:50.643342 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:50.643322    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e696e0a-7b15-4b92-bd3a-4bd085747ecf-config\") pod \"kube-storage-version-migrator-operator-565644f49-pvsqr\" (UID: \"4e696e0a-7b15-4b92-bd3a-4bd085747ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-pvsqr"
May 21 21:22:50.643434 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:50.643389    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e696e0a-7b15-4b92-bd3a-4bd085747ecf-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-pvsqr\" (UID: \"4e696e0a-7b15-4b92-bd3a-4bd085747ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-pvsqr"
May 21 21:22:50.643474 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:50.643444    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8s8r\" (UniqueName: \"kubernetes.io/projected/4e696e0a-7b15-4b92-bd3a-4bd085747ecf-kube-api-access-g8s8r\") pod \"kube-storage-version-migrator-operator-565644f49-pvsqr\" (UID: \"4e696e0a-7b15-4b92-bd3a-4bd085747ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-pvsqr"
May 21 21:22:50.744015 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:50.743985    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e696e0a-7b15-4b92-bd3a-4bd085747ecf-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-pvsqr\" (UID: \"4e696e0a-7b15-4b92-bd3a-4bd085747ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-pvsqr"
May 21 21:22:50.744136 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:50.744023    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8s8r\" (UniqueName: \"kubernetes.io/projected/4e696e0a-7b15-4b92-bd3a-4bd085747ecf-kube-api-access-g8s8r\") pod \"kube-storage-version-migrator-operator-565644f49-pvsqr\" (UID: \"4e696e0a-7b15-4b92-bd3a-4bd085747ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-pvsqr"
May 21 21:22:50.744136 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:50.744062    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e696e0a-7b15-4b92-bd3a-4bd085747ecf-config\") pod \"kube-storage-version-migrator-operator-565644f49-pvsqr\" (UID: \"4e696e0a-7b15-4b92-bd3a-4bd085747ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-pvsqr"
May 21 21:22:50.744651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:50.744627    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e696e0a-7b15-4b92-bd3a-4bd085747ecf-config\") pod \"kube-storage-version-migrator-operator-565644f49-pvsqr\" (UID: \"4e696e0a-7b15-4b92-bd3a-4bd085747ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-pvsqr"
May 21 21:22:50.746142 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:50.746122    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e696e0a-7b15-4b92-bd3a-4bd085747ecf-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-pvsqr\" (UID: \"4e696e0a-7b15-4b92-bd3a-4bd085747ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-pvsqr"
May 21 21:22:50.758131 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:50.758102    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8s8r\" (UniqueName: \"kubernetes.io/projected/4e696e0a-7b15-4b92-bd3a-4bd085747ecf-kube-api-access-g8s8r\") pod \"kube-storage-version-migrator-operator-565644f49-pvsqr\" (UID: \"4e696e0a-7b15-4b92-bd3a-4bd085747ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-pvsqr"
May 21 21:22:50.918280 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:50.918191    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-pvsqr"
May 21 21:22:51.037482 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:51.037450    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-pvsqr"]
May 21 21:22:51.040180 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:22:51.040149    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e696e0a_7b15_4b92_bd3a_4bd085747ecf.slice/crio-2649ef3ed996045f31b1059a0d9e4a37f1f07853663008bb21adfb5cc6c391cf WatchSource:0}: Error finding container 2649ef3ed996045f31b1059a0d9e4a37f1f07853663008bb21adfb5cc6c391cf: Status 404 returned error can't find the container with id 2649ef3ed996045f31b1059a0d9e4a37f1f07853663008bb21adfb5cc6c391cf
May 21 21:22:51.348060 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:51.348022    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-8xcxc\" (UID: \"56955214-c7d1-4bda-9f1e-2abd74ff1f85\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc"
May 21 21:22:51.348244 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:51.348165    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 21:22:51.348244 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:51.348242    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls podName:56955214-c7d1-4bda-9f1e-2abd74ff1f85 nodeName:}" failed. No retries permitted until 2026-05-21 21:22:55.348223922 +0000 UTC m=+87.781235400 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-8xcxc" (UID: "56955214-c7d1-4bda-9f1e-2abd74ff1f85") : secret "cluster-monitoring-operator-tls" not found
May 21 21:22:51.459258 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:51.459221    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-pvsqr" event={"ID":"4e696e0a-7b15-4b92-bd3a-4bd085747ecf","Type":"ContainerStarted","Data":"2649ef3ed996045f31b1059a0d9e4a37f1f07853663008bb21adfb5cc6c391cf"}
May 21 21:22:52.624261 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:52.624223    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-d4m5b"]
May 21 21:22:52.627486 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:52.627460    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-d4m5b"
May 21 21:22:52.629987 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:52.629968    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 21 21:22:52.630268 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:52.630250    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 21 21:22:52.630339 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:52.630255    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 21 21:22:52.630728 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:52.630709    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 21 21:22:52.631450 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:52.631430    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-rqp5d\""
May 21 21:22:52.634580 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:52.634559    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-d4m5b"]
May 21 21:22:52.761902 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:52.761868    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k842b\" (UniqueName: \"kubernetes.io/projected/982cde8e-e1f2-4908-82ab-981e64a2cac9-kube-api-access-k842b\") pod \"service-ca-operator-57b5b68b8-d4m5b\" (UID: \"982cde8e-e1f2-4908-82ab-981e64a2cac9\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-d4m5b"
May 21 21:22:52.762123 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:52.761993    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/982cde8e-e1f2-4908-82ab-981e64a2cac9-config\") pod \"service-ca-operator-57b5b68b8-d4m5b\" (UID: \"982cde8e-e1f2-4908-82ab-981e64a2cac9\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-d4m5b"
May 21 21:22:52.762123 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:52.762023    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/982cde8e-e1f2-4908-82ab-981e64a2cac9-serving-cert\") pod \"service-ca-operator-57b5b68b8-d4m5b\" (UID: \"982cde8e-e1f2-4908-82ab-981e64a2cac9\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-d4m5b"
May 21 21:22:52.862837 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:52.862801    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/982cde8e-e1f2-4908-82ab-981e64a2cac9-config\") pod \"service-ca-operator-57b5b68b8-d4m5b\" (UID: \"982cde8e-e1f2-4908-82ab-981e64a2cac9\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-d4m5b"
May 21 21:22:52.862989 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:52.862913    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/982cde8e-e1f2-4908-82ab-981e64a2cac9-serving-cert\") pod \"service-ca-operator-57b5b68b8-d4m5b\" (UID: \"982cde8e-e1f2-4908-82ab-981e64a2cac9\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-d4m5b"
May 21 21:22:52.862989 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:52.862957    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k842b\" (UniqueName: \"kubernetes.io/projected/982cde8e-e1f2-4908-82ab-981e64a2cac9-kube-api-access-k842b\") pod \"service-ca-operator-57b5b68b8-d4m5b\" (UID: \"982cde8e-e1f2-4908-82ab-981e64a2cac9\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-d4m5b"
May 21 21:22:52.863297 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:52.863270    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/982cde8e-e1f2-4908-82ab-981e64a2cac9-config\") pod \"service-ca-operator-57b5b68b8-d4m5b\" (UID: \"982cde8e-e1f2-4908-82ab-981e64a2cac9\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-d4m5b"
May 21 21:22:52.865070 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:52.865041    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/982cde8e-e1f2-4908-82ab-981e64a2cac9-serving-cert\") pod \"service-ca-operator-57b5b68b8-d4m5b\" (UID: \"982cde8e-e1f2-4908-82ab-981e64a2cac9\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-d4m5b"
May 21 21:22:52.870629 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:52.870608    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k842b\" (UniqueName: \"kubernetes.io/projected/982cde8e-e1f2-4908-82ab-981e64a2cac9-kube-api-access-k842b\") pod \"service-ca-operator-57b5b68b8-d4m5b\" (UID: \"982cde8e-e1f2-4908-82ab-981e64a2cac9\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-d4m5b"
May 21 21:22:52.937466 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:52.937411    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-d4m5b"
May 21 21:22:53.053319 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:53.053285    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-d4m5b"]
May 21 21:22:53.057441 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:22:53.057414    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod982cde8e_e1f2_4908_82ab_981e64a2cac9.slice/crio-758bd77c6e1db1324d9e553197adbbac316a3b73459437b7d0a76e53e2cbb0e3 WatchSource:0}: Error finding container 758bd77c6e1db1324d9e553197adbbac316a3b73459437b7d0a76e53e2cbb0e3: Status 404 returned error can't find the container with id 758bd77c6e1db1324d9e553197adbbac316a3b73459437b7d0a76e53e2cbb0e3
May 21 21:22:53.464151 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:53.464114    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-d4m5b" event={"ID":"982cde8e-e1f2-4908-82ab-981e64a2cac9","Type":"ContainerStarted","Data":"758bd77c6e1db1324d9e553197adbbac316a3b73459437b7d0a76e53e2cbb0e3"}
May 21 21:22:53.758260 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:53.758193    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4hz2n_3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9/dns-node-resolver/0.log"
May 21 21:22:54.468083 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:54.468036    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-pvsqr" event={"ID":"4e696e0a-7b15-4b92-bd3a-4bd085747ecf","Type":"ContainerStarted","Data":"a562164c5fbe484a4861897eef666c8e0b01686c4ae4e9601dd3289d16d81243"}
May 21 21:22:54.484008 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:54.483959    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-pvsqr" podStartSLOduration=1.862191202 podStartE2EDuration="4.483940117s" podCreationTimestamp="2026-05-21 21:22:50 +0000 UTC" firstStartedPulling="2026-05-21 21:22:51.041903147 +0000 UTC m=+83.474914619" lastFinishedPulling="2026-05-21 21:22:53.663652049 +0000 UTC m=+86.096663534" observedRunningTime="2026-05-21 21:22:54.483471555 +0000 UTC m=+86.916483063" watchObservedRunningTime="2026-05-21 21:22:54.483940117 +0000 UTC m=+86.916951614"
May 21 21:22:54.958844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:54.958815    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s57t7_909a645a-db62-4ce2-8e92-c7d2380eb4dc/node-ca/0.log"
May 21 21:22:55.383188 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:55.383147    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-8xcxc\" (UID: \"56955214-c7d1-4bda-9f1e-2abd74ff1f85\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc"
May 21 21:22:55.383375 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:55.383302    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 21:22:55.383434 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:22:55.383391    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls podName:56955214-c7d1-4bda-9f1e-2abd74ff1f85 nodeName:}" failed. No retries permitted until 2026-05-21 21:23:03.383370005 +0000 UTC m=+95.816381487 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-8xcxc" (UID: "56955214-c7d1-4bda-9f1e-2abd74ff1f85") : secret "cluster-monitoring-operator-tls" not found
May 21 21:22:56.123511 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:56.123468    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-nlf5h"]
May 21 21:22:56.128773 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:56.128735    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-nlf5h"
May 21 21:22:56.131290 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:56.131266    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 21 21:22:56.131290 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:56.131286    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 21 21:22:56.132486 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:56.132464    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-gx82b\""
May 21 21:22:56.139397 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:56.139376    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-nlf5h"]
May 21 21:22:56.189156 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:56.189129    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptcdr\" (UniqueName: \"kubernetes.io/projected/cf1102a0-a05e-4d76-9d58-4fdd9c2d666b-kube-api-access-ptcdr\") pod \"migrator-b985f5d89-nlf5h\" (UID: \"cf1102a0-a05e-4d76-9d58-4fdd9c2d666b\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-nlf5h"
May 21 21:22:56.292310 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:56.289647    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptcdr\" (UniqueName: \"kubernetes.io/projected/cf1102a0-a05e-4d76-9d58-4fdd9c2d666b-kube-api-access-ptcdr\") pod \"migrator-b985f5d89-nlf5h\" (UID: \"cf1102a0-a05e-4d76-9d58-4fdd9c2d666b\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-nlf5h"
May 21 21:22:56.298424 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:56.298398    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptcdr\" (UniqueName: \"kubernetes.io/projected/cf1102a0-a05e-4d76-9d58-4fdd9c2d666b-kube-api-access-ptcdr\") pod \"migrator-b985f5d89-nlf5h\" (UID: \"cf1102a0-a05e-4d76-9d58-4fdd9c2d666b\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-nlf5h"
May 21 21:22:56.437991 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:56.437919    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-nlf5h"
May 21 21:22:56.474176 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:56.474136    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-d4m5b" event={"ID":"982cde8e-e1f2-4908-82ab-981e64a2cac9","Type":"ContainerStarted","Data":"6f41f4f20671d9c5e7c71d0cd2402270655b70c25dd0bdc43b14441c9c5331a7"}
May 21 21:22:56.488567 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:56.488502    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-d4m5b" podStartSLOduration=2.008675621 podStartE2EDuration="4.488482204s" podCreationTimestamp="2026-05-21 21:22:52 +0000 UTC" firstStartedPulling="2026-05-21 21:22:53.059312418 +0000 UTC m=+85.492323891" lastFinishedPulling="2026-05-21 21:22:55.539118987 +0000 UTC m=+87.972130474" observedRunningTime="2026-05-21 21:22:56.488343414 +0000 UTC m=+88.921354910" watchObservedRunningTime="2026-05-21 21:22:56.488482204 +0000 UTC m=+88.921493701"
May 21 21:22:56.557995 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:56.557950    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-nlf5h"]
May 21 21:22:56.560996 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:22:56.560972    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf1102a0_a05e_4d76_9d58_4fdd9c2d666b.slice/crio-a352c75f32ab8a6da71a42211505b03709ff4c35bf4577def5088117874b1fac WatchSource:0}: Error finding container a352c75f32ab8a6da71a42211505b03709ff4c35bf4577def5088117874b1fac: Status 404 returned error can't find the container with id a352c75f32ab8a6da71a42211505b03709ff4c35bf4577def5088117874b1fac
May 21 21:22:57.477357 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:57.477315    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-nlf5h" event={"ID":"cf1102a0-a05e-4d76-9d58-4fdd9c2d666b","Type":"ContainerStarted","Data":"a352c75f32ab8a6da71a42211505b03709ff4c35bf4577def5088117874b1fac"}
May 21 21:22:58.484735 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:58.484690    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-nlf5h" event={"ID":"cf1102a0-a05e-4d76-9d58-4fdd9c2d666b","Type":"ContainerStarted","Data":"548a21ad51a0ab775b836469e0746abe04f07e44dcedeb15a9d8f19b7ac70d47"}
May 21 21:22:58.484735 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:58.484741    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-nlf5h" event={"ID":"cf1102a0-a05e-4d76-9d58-4fdd9c2d666b","Type":"ContainerStarted","Data":"19a44fb3c822f8e27a64dcdce5a18204c0cb06f5e082d479dd4098995d381ee2"}
May 21 21:22:58.500190 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:58.500137    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-nlf5h" podStartSLOduration=1.161687486 podStartE2EDuration="2.500122839s" podCreationTimestamp="2026-05-21 21:22:56 +0000 UTC" firstStartedPulling="2026-05-21 21:22:56.563271945 +0000 UTC m=+88.996283419" lastFinishedPulling="2026-05-21 21:22:57.901707296 +0000 UTC m=+90.334718772" observedRunningTime="2026-05-21 21:22:58.49956467 +0000 UTC m=+90.932576164" watchObservedRunningTime="2026-05-21 21:22:58.500122839 +0000 UTC m=+90.933134335"
May 21 21:22:58.862262 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:58.862230    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-67wzm"]
May 21 21:22:58.864203 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:58.864187    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-67wzm"
May 21 21:22:58.867099 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:58.867072    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 21 21:22:58.867214 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:58.867098    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 21 21:22:58.867214 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:58.867168    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pfm2l\""
May 21 21:22:58.867328 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:58.867217    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 21 21:22:58.868139 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:58.868124    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 21 21:22:58.875288 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:58.875262    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-67wzm"]
May 21 21:22:58.910904 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:58.910880    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/99b36260-b31a-41b6-b6d4-26f6ca8bcf57-signing-key\") pod \"service-ca-67d667c7d-67wzm\" (UID: \"99b36260-b31a-41b6-b6d4-26f6ca8bcf57\") " pod="openshift-service-ca/service-ca-67d667c7d-67wzm"
May 21 21:22:58.911002 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:58.910979    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smmns\" (UniqueName: \"kubernetes.io/projected/99b36260-b31a-41b6-b6d4-26f6ca8bcf57-kube-api-access-smmns\") pod \"service-ca-67d667c7d-67wzm\" (UID: \"99b36260-b31a-41b6-b6d4-26f6ca8bcf57\") " pod="openshift-service-ca/service-ca-67d667c7d-67wzm"
May 21 21:22:58.911041 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:58.911024    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/99b36260-b31a-41b6-b6d4-26f6ca8bcf57-signing-cabundle\") pod \"service-ca-67d667c7d-67wzm\" (UID: \"99b36260-b31a-41b6-b6d4-26f6ca8bcf57\") " pod="openshift-service-ca/service-ca-67d667c7d-67wzm"
May 21 21:22:59.011697 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:59.011670    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smmns\" (UniqueName: \"kubernetes.io/projected/99b36260-b31a-41b6-b6d4-26f6ca8bcf57-kube-api-access-smmns\") pod \"service-ca-67d667c7d-67wzm\" (UID: \"99b36260-b31a-41b6-b6d4-26f6ca8bcf57\") " pod="openshift-service-ca/service-ca-67d667c7d-67wzm"
May 21 21:22:59.011810 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:59.011707    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/99b36260-b31a-41b6-b6d4-26f6ca8bcf57-signing-cabundle\") pod \"service-ca-67d667c7d-67wzm\" (UID: \"99b36260-b31a-41b6-b6d4-26f6ca8bcf57\") " pod="openshift-service-ca/service-ca-67d667c7d-67wzm"
May 21 21:22:59.011810 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:59.011758    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/99b36260-b31a-41b6-b6d4-26f6ca8bcf57-signing-key\") pod \"service-ca-67d667c7d-67wzm\" (UID: \"99b36260-b31a-41b6-b6d4-26f6ca8bcf57\") " pod="openshift-service-ca/service-ca-67d667c7d-67wzm"
May 21 21:22:59.012433 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:59.012415    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/99b36260-b31a-41b6-b6d4-26f6ca8bcf57-signing-cabundle\") pod \"service-ca-67d667c7d-67wzm\" (UID: \"99b36260-b31a-41b6-b6d4-26f6ca8bcf57\") " pod="openshift-service-ca/service-ca-67d667c7d-67wzm"
May 21 21:22:59.014183 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:59.014160    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/99b36260-b31a-41b6-b6d4-26f6ca8bcf57-signing-key\") pod \"service-ca-67d667c7d-67wzm\" (UID: \"99b36260-b31a-41b6-b6d4-26f6ca8bcf57\") " pod="openshift-service-ca/service-ca-67d667c7d-67wzm"
May 21 21:22:59.020018 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:59.019999    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smmns\" (UniqueName: \"kubernetes.io/projected/99b36260-b31a-41b6-b6d4-26f6ca8bcf57-kube-api-access-smmns\") pod \"service-ca-67d667c7d-67wzm\" (UID: \"99b36260-b31a-41b6-b6d4-26f6ca8bcf57\") " pod="openshift-service-ca/service-ca-67d667c7d-67wzm"
May 21 21:22:59.172466 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:59.172396    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-67wzm"
May 21 21:22:59.293862 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:59.293833    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-67wzm"]
May 21 21:22:59.297279 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:22:59.297250    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b36260_b31a_41b6_b6d4_26f6ca8bcf57.slice/crio-61a61d2614e4a03f2b74aa283dd3ff7c9b7fdffbfb77e30cba0662a27e7a70f2 WatchSource:0}: Error finding container 61a61d2614e4a03f2b74aa283dd3ff7c9b7fdffbfb77e30cba0662a27e7a70f2: Status 404 returned error can't find the container with id 61a61d2614e4a03f2b74aa283dd3ff7c9b7fdffbfb77e30cba0662a27e7a70f2
May 21 21:22:59.489347 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:59.489249    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-67wzm" event={"ID":"99b36260-b31a-41b6-b6d4-26f6ca8bcf57","Type":"ContainerStarted","Data":"82c6f2664826329ce66cb3974bb97ac14f34d705d146b56f0431d13adc27546a"}
May 21 21:22:59.489347 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:59.489292    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-67wzm" event={"ID":"99b36260-b31a-41b6-b6d4-26f6ca8bcf57","Type":"ContainerStarted","Data":"61a61d2614e4a03f2b74aa283dd3ff7c9b7fdffbfb77e30cba0662a27e7a70f2"}
May 21 21:22:59.508119 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:22:59.508072    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-67wzm" podStartSLOduration=1.508059323 podStartE2EDuration="1.508059323s" podCreationTimestamp="2026-05-21 21:22:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:22:59.506338632 +0000 UTC m=+91.939350138" watchObservedRunningTime="2026-05-21 21:22:59.508059323 +0000 UTC m=+91.941070818"
May 21 21:23:03.448770 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:03.448728    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-8xcxc\" (UID: \"56955214-c7d1-4bda-9f1e-2abd74ff1f85\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc"
May 21 21:23:03.449247 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:23:03.448848    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 21:23:03.449247 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:23:03.448902    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls podName:56955214-c7d1-4bda-9f1e-2abd74ff1f85 nodeName:}" failed. No retries permitted until 2026-05-21 21:23:19.448887858 +0000 UTC m=+111.881899335 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-8xcxc" (UID: "56955214-c7d1-4bda-9f1e-2abd74ff1f85") : secret "cluster-monitoring-operator-tls" not found
May 21 21:23:05.363757 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:05.363653    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls\") pod \"dns-default-kp68l\" (UID: \"78c14074-82e5-4559-94e6-79a10e02938d\") " pod="openshift-dns/dns-default-kp68l"
May 21 21:23:05.363757 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:05.363715    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert\") pod \"ingress-canary-jrlsm\" (UID: \"0f00757c-1b31-47a9-8bf6-49cd582be267\") " pod="openshift-ingress-canary/ingress-canary-jrlsm"
May 21 21:23:05.366018 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:05.365987    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78c14074-82e5-4559-94e6-79a10e02938d-metrics-tls\") pod \"dns-default-kp68l\" (UID: \"78c14074-82e5-4559-94e6-79a10e02938d\") " pod="openshift-dns/dns-default-kp68l"
May 21 21:23:05.366203 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:05.366181    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f00757c-1b31-47a9-8bf6-49cd582be267-cert\") pod \"ingress-canary-jrlsm\" (UID: \"0f00757c-1b31-47a9-8bf6-49cd582be267\") " pod="openshift-ingress-canary/ingress-canary-jrlsm"
May 21 21:23:05.369948 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:05.369931    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6c5qz\""
May 21 21:23:05.377330 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:05.377311    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jrlsm"
May 21 21:23:05.496079 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:05.496046    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jrlsm"]
May 21 21:23:05.499154 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:23:05.499129    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f00757c_1b31_47a9_8bf6_49cd582be267.slice/crio-d016305960f2e3333955f6e4adc989c4d7c73b083f95b2af9aff10b6a2113cbf WatchSource:0}: Error finding container d016305960f2e3333955f6e4adc989c4d7c73b083f95b2af9aff10b6a2113cbf: Status 404 returned error can't find the container with id d016305960f2e3333955f6e4adc989c4d7c73b083f95b2af9aff10b6a2113cbf
May 21 21:23:05.506206 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:05.506178    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jrlsm" event={"ID":"0f00757c-1b31-47a9-8bf6-49cd582be267","Type":"ContainerStarted","Data":"d016305960f2e3333955f6e4adc989c4d7c73b083f95b2af9aff10b6a2113cbf"}
May 21 21:23:05.651977 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:05.651900    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bvcxl\""
May 21 21:23:05.660392 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:05.660361    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kp68l"
May 21 21:23:05.775946 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:05.775916    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kp68l"]
May 21 21:23:05.778846 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:23:05.778825    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78c14074_82e5_4559_94e6_79a10e02938d.slice/crio-65bbd70cf8bebb57ff528facfc3bf6a13feb8ff9cd84d318e4ef9bdefc18c5be WatchSource:0}: Error finding container 65bbd70cf8bebb57ff528facfc3bf6a13feb8ff9cd84d318e4ef9bdefc18c5be: Status 404 returned error can't find the container with id 65bbd70cf8bebb57ff528facfc3bf6a13feb8ff9cd84d318e4ef9bdefc18c5be
May 21 21:23:06.510462 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:06.510400    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kp68l" event={"ID":"78c14074-82e5-4559-94e6-79a10e02938d","Type":"ContainerStarted","Data":"65bbd70cf8bebb57ff528facfc3bf6a13feb8ff9cd84d318e4ef9bdefc18c5be"}
May 21 21:23:07.433524 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:07.433495    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-78x7g"
May 21 21:23:08.516134 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:08.516092    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jrlsm" event={"ID":"0f00757c-1b31-47a9-8bf6-49cd582be267","Type":"ContainerStarted","Data":"ef801b6bef8727c01414eadff2d20963cb1d9498787b624d9769db961975f1a7"}
May 21 21:23:08.517538 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:08.517514    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kp68l" event={"ID":"78c14074-82e5-4559-94e6-79a10e02938d","Type":"ContainerStarted","Data":"75bda44d9ad1dc5f140db429b218aee4bea3db24cfb2031f0e3c854608479fe5"}
May 21 21:23:08.517659 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:08.517541    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kp68l" event={"ID":"78c14074-82e5-4559-94e6-79a10e02938d","Type":"ContainerStarted","Data":"50ca91c5b94668c774ee8cef898db5925726aa9dde462a84b22a261dd6897d5f"}
May 21 21:23:08.517659 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:08.517647    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kp68l"
May 21 21:23:08.533154 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:08.533116    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jrlsm" podStartSLOduration=65.27443149 podStartE2EDuration="1m7.533105148s" podCreationTimestamp="2026-05-21 21:22:01 +0000 UTC" firstStartedPulling="2026-05-21 21:23:05.500899507 +0000 UTC m=+97.933910988" lastFinishedPulling="2026-05-21 21:23:07.75957317 +0000 UTC m=+100.192584646" observedRunningTime="2026-05-21 21:23:08.532790914 +0000 UTC m=+100.965802408" watchObservedRunningTime="2026-05-21 21:23:08.533105148 +0000 UTC m=+100.966116659"
May 21 21:23:08.549467 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:08.549427    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-kp68l" podStartSLOduration=65.56902494 podStartE2EDuration="1m7.549415961s" podCreationTimestamp="2026-05-21 21:22:01 +0000 UTC" firstStartedPulling="2026-05-21 21:23:05.780465915 +0000 UTC m=+98.213477389" lastFinishedPulling="2026-05-21 21:23:07.760856934 +0000 UTC m=+100.193868410" observedRunningTime="2026-05-21 21:23:08.548969314 +0000 UTC m=+100.981980812" watchObservedRunningTime="2026-05-21 21:23:08.549415961 +0000 UTC m=+100.982427456"
May 21 21:23:18.521583 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:18.521546    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kp68l"
May 21 21:23:19.466285 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:19.466249    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-8xcxc\" (UID: \"56955214-c7d1-4bda-9f1e-2abd74ff1f85\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc"
May 21 21:23:19.468582 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:19.468563    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56955214-c7d1-4bda-9f1e-2abd74ff1f85-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-8xcxc\" (UID: \"56955214-c7d1-4bda-9f1e-2abd74ff1f85\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc"
May 21 21:23:19.745431 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:19.745337    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc"
May 21 21:23:19.862529 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:19.862498    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc"]
May 21 21:23:19.865796 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:23:19.865772    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56955214_c7d1_4bda_9f1e_2abd74ff1f85.slice/crio-957a311b53993f41de2ffafbcc972037bbfa1737ce9d563bca69113be7ce48a7 WatchSource:0}: Error finding container 957a311b53993f41de2ffafbcc972037bbfa1737ce9d563bca69113be7ce48a7: Status 404 returned error can't find the container with id 957a311b53993f41de2ffafbcc972037bbfa1737ce9d563bca69113be7ce48a7
May 21 21:23:20.342268 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.342233    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-twvxh"]
May 21 21:23:20.346412 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.346396    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-twvxh"
May 21 21:23:20.349306 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.349282    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 21 21:23:20.350319 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.350296    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ss45t\""
May 21 21:23:20.350419 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.350319    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 21 21:23:20.360602 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.360560    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-twvxh"]
May 21 21:23:20.444750 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.444720    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-c4996"]
May 21 21:23:20.448219 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.448196    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-689f899957-lx6ml"]
May 21 21:23:20.448373 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.448353    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c4996"
May 21 21:23:20.451229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.451000    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w6tpj\""
May 21 21:23:20.451229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.451005    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 21 21:23:20.451229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.451090    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 21 21:23:20.451229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.451008    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 21 21:23:20.451229 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.451169    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 21 21:23:20.451524 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.451265    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.454369 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.454351    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 21 21:23:20.454675 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.454618    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 21 21:23:20.454852 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.454838    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 21 21:23:20.454920 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.454843    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tbbwf\""
May 21 21:23:20.460127 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.460107    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 21 21:23:20.461958 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.461937    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c4996"]
May 21 21:23:20.466658 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.466636    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-689f899957-lx6ml"]
May 21 21:23:20.473770 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.473749    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6b67a174-68c4-4ddf-94c1-6c5d6ffd57b1-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-twvxh\" (UID: \"6b67a174-68c4-4ddf-94c1-6c5d6ffd57b1\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-twvxh"
May 21 21:23:20.473872 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.473795    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b67a174-68c4-4ddf-94c1-6c5d6ffd57b1-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-twvxh\" (UID: \"6b67a174-68c4-4ddf-94c1-6c5d6ffd57b1\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-twvxh"
May 21 21:23:20.547853 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.547823    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc" event={"ID":"56955214-c7d1-4bda-9f1e-2abd74ff1f85","Type":"ContainerStarted","Data":"957a311b53993f41de2ffafbcc972037bbfa1737ce9d563bca69113be7ce48a7"}
May 21 21:23:20.574417 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.574385    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf88c648-0ca7-4f80-9195-ae681ff43589-crio-socket\") pod \"insights-runtime-extractor-c4996\" (UID: \"cf88c648-0ca7-4f80-9195-ae681ff43589\") " pod="openshift-insights/insights-runtime-extractor-c4996"
May 21 21:23:20.574556 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.574428    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggtng\" (UniqueName: \"kubernetes.io/projected/cf88c648-0ca7-4f80-9195-ae681ff43589-kube-api-access-ggtng\") pod \"insights-runtime-extractor-c4996\" (UID: \"cf88c648-0ca7-4f80-9195-ae681ff43589\") " pod="openshift-insights/insights-runtime-extractor-c4996"
May 21 21:23:20.574556 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.574454    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c5066d9-fc99-4e63-b377-ae84fb797414-image-registry-private-configuration\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.574556 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.574485    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c5066d9-fc99-4e63-b377-ae84fb797414-registry-certificates\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.574556 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.574514    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c5066d9-fc99-4e63-b377-ae84fb797414-trusted-ca\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.574556 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.574538    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtnk7\" (UniqueName: \"kubernetes.io/projected/4c5066d9-fc99-4e63-b377-ae84fb797414-kube-api-access-gtnk7\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.574841 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.574654    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c5066d9-fc99-4e63-b377-ae84fb797414-registry-tls\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.574841 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.574696    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6b67a174-68c4-4ddf-94c1-6c5d6ffd57b1-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-twvxh\" (UID: \"6b67a174-68c4-4ddf-94c1-6c5d6ffd57b1\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-twvxh"
May 21 21:23:20.574841 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.574726    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf88c648-0ca7-4f80-9195-ae681ff43589-data-volume\") pod \"insights-runtime-extractor-c4996\" (UID: \"cf88c648-0ca7-4f80-9195-ae681ff43589\") " pod="openshift-insights/insights-runtime-extractor-c4996"
May 21 21:23:20.574841 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.574758    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b67a174-68c4-4ddf-94c1-6c5d6ffd57b1-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-twvxh\" (UID: \"6b67a174-68c4-4ddf-94c1-6c5d6ffd57b1\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-twvxh"
May 21 21:23:20.574841 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.574819    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf88c648-0ca7-4f80-9195-ae681ff43589-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4996\" (UID: \"cf88c648-0ca7-4f80-9195-ae681ff43589\") " pod="openshift-insights/insights-runtime-extractor-c4996"
May 21 21:23:20.575056 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.574864    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf88c648-0ca7-4f80-9195-ae681ff43589-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c4996\" (UID: \"cf88c648-0ca7-4f80-9195-ae681ff43589\") " pod="openshift-insights/insights-runtime-extractor-c4996"
May 21 21:23:20.575056 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.574903    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c5066d9-fc99-4e63-b377-ae84fb797414-bound-sa-token\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.575056 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.574927    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c5066d9-fc99-4e63-b377-ae84fb797414-installation-pull-secrets\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.575056 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.574985    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c5066d9-fc99-4e63-b377-ae84fb797414-ca-trust-extracted\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.575316 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.575293    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6b67a174-68c4-4ddf-94c1-6c5d6ffd57b1-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-twvxh\" (UID: \"6b67a174-68c4-4ddf-94c1-6c5d6ffd57b1\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-twvxh"
May 21 21:23:20.577129 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.577110    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b67a174-68c4-4ddf-94c1-6c5d6ffd57b1-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-twvxh\" (UID: \"6b67a174-68c4-4ddf-94c1-6c5d6ffd57b1\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-twvxh"
May 21 21:23:20.655200 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.655134    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-twvxh"
May 21 21:23:20.675806 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.675781    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf88c648-0ca7-4f80-9195-ae681ff43589-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4996\" (UID: \"cf88c648-0ca7-4f80-9195-ae681ff43589\") " pod="openshift-insights/insights-runtime-extractor-c4996"
May 21 21:23:20.675904 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.675814    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf88c648-0ca7-4f80-9195-ae681ff43589-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c4996\" (UID: \"cf88c648-0ca7-4f80-9195-ae681ff43589\") " pod="openshift-insights/insights-runtime-extractor-c4996"
May 21 21:23:20.676016 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.675993    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c5066d9-fc99-4e63-b377-ae84fb797414-bound-sa-token\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.676069 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.676040    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c5066d9-fc99-4e63-b377-ae84fb797414-installation-pull-secrets\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.676227 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.676195    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c5066d9-fc99-4e63-b377-ae84fb797414-ca-trust-extracted\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.676319 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.676250    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf88c648-0ca7-4f80-9195-ae681ff43589-crio-socket\") pod \"insights-runtime-extractor-c4996\" (UID: \"cf88c648-0ca7-4f80-9195-ae681ff43589\") " pod="openshift-insights/insights-runtime-extractor-c4996"
May 21 21:23:20.676319 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.676287    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggtng\" (UniqueName: \"kubernetes.io/projected/cf88c648-0ca7-4f80-9195-ae681ff43589-kube-api-access-ggtng\") pod \"insights-runtime-extractor-c4996\" (UID: \"cf88c648-0ca7-4f80-9195-ae681ff43589\") " pod="openshift-insights/insights-runtime-extractor-c4996"
May 21 21:23:20.676319 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.676293    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf88c648-0ca7-4f80-9195-ae681ff43589-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c4996\" (UID: \"cf88c648-0ca7-4f80-9195-ae681ff43589\") " pod="openshift-insights/insights-runtime-extractor-c4996"
May 21 21:23:20.676484 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.676318    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c5066d9-fc99-4e63-b377-ae84fb797414-image-registry-private-configuration\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.676484 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.676371    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c5066d9-fc99-4e63-b377-ae84fb797414-registry-certificates\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.676484 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.676384    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf88c648-0ca7-4f80-9195-ae681ff43589-crio-socket\") pod \"insights-runtime-extractor-c4996\" (UID: \"cf88c648-0ca7-4f80-9195-ae681ff43589\") " pod="openshift-insights/insights-runtime-extractor-c4996"
May 21 21:23:20.676484 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.676404    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c5066d9-fc99-4e63-b377-ae84fb797414-trusted-ca\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.676484 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.676432    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtnk7\" (UniqueName: \"kubernetes.io/projected/4c5066d9-fc99-4e63-b377-ae84fb797414-kube-api-access-gtnk7\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.676750 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.676492    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c5066d9-fc99-4e63-b377-ae84fb797414-registry-tls\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.676750 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.676523    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf88c648-0ca7-4f80-9195-ae681ff43589-data-volume\") pod \"insights-runtime-extractor-c4996\" (UID: \"cf88c648-0ca7-4f80-9195-ae681ff43589\") " pod="openshift-insights/insights-runtime-extractor-c4996"
May 21 21:23:20.676848 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.676805    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c5066d9-fc99-4e63-b377-ae84fb797414-ca-trust-extracted\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.676848 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.676830    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf88c648-0ca7-4f80-9195-ae681ff43589-data-volume\") pod \"insights-runtime-extractor-c4996\" (UID: \"cf88c648-0ca7-4f80-9195-ae681ff43589\") " pod="openshift-insights/insights-runtime-extractor-c4996"
May 21 21:23:20.677753 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.677714    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c5066d9-fc99-4e63-b377-ae84fb797414-registry-certificates\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.677856 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.677792    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c5066d9-fc99-4e63-b377-ae84fb797414-trusted-ca\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.678829 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.678792    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c5066d9-fc99-4e63-b377-ae84fb797414-installation-pull-secrets\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.678956 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.678847    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf88c648-0ca7-4f80-9195-ae681ff43589-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4996\" (UID: \"cf88c648-0ca7-4f80-9195-ae681ff43589\") " pod="openshift-insights/insights-runtime-extractor-c4996"
May 21 21:23:20.679459 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.679429    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c5066d9-fc99-4e63-b377-ae84fb797414-image-registry-private-configuration\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.680059 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.680038    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c5066d9-fc99-4e63-b377-ae84fb797414-registry-tls\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.685226 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.685184    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c5066d9-fc99-4e63-b377-ae84fb797414-bound-sa-token\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.685815 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.685784    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtnk7\" (UniqueName: \"kubernetes.io/projected/4c5066d9-fc99-4e63-b377-ae84fb797414-kube-api-access-gtnk7\") pod \"image-registry-689f899957-lx6ml\" (UID: \"4c5066d9-fc99-4e63-b377-ae84fb797414\") " pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.686442 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.686422    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggtng\" (UniqueName: \"kubernetes.io/projected/cf88c648-0ca7-4f80-9195-ae681ff43589-kube-api-access-ggtng\") pod \"insights-runtime-extractor-c4996\" (UID: \"cf88c648-0ca7-4f80-9195-ae681ff43589\") " pod="openshift-insights/insights-runtime-extractor-c4996"
May 21 21:23:20.760870 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.760660    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c4996"
May 21 21:23:20.768664 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.768511    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:20.796891 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.796728    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-twvxh"]
May 21 21:23:20.800607 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:23:20.800553    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b67a174_68c4_4ddf_94c1_6c5d6ffd57b1.slice/crio-f5b6b38bb78e77fa660da3eb1ec9df22e8df97b7273e147143bd9bde24638d4e WatchSource:0}: Error finding container f5b6b38bb78e77fa660da3eb1ec9df22e8df97b7273e147143bd9bde24638d4e: Status 404 returned error can't find the container with id f5b6b38bb78e77fa660da3eb1ec9df22e8df97b7273e147143bd9bde24638d4e
May 21 21:23:20.928981 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.928908    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c4996"]
May 21 21:23:20.931961 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:23:20.931932    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf88c648_0ca7_4f80_9195_ae681ff43589.slice/crio-fb3a4a31e715f5d6ffd363fb7b5de85c759cab26eb538827c4340ab417ced14a WatchSource:0}: Error finding container fb3a4a31e715f5d6ffd363fb7b5de85c759cab26eb538827c4340ab417ced14a: Status 404 returned error can't find the container with id fb3a4a31e715f5d6ffd363fb7b5de85c759cab26eb538827c4340ab417ced14a
May 21 21:23:20.953065 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:20.953041    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-689f899957-lx6ml"]
May 21 21:23:20.964643 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:23:20.964611    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c5066d9_fc99_4e63_b377_ae84fb797414.slice/crio-5b7175eb413306407af35f3cc929a0de8dd3c494260dcb7ee18e7a6a5bcec5c3 WatchSource:0}: Error finding container 5b7175eb413306407af35f3cc929a0de8dd3c494260dcb7ee18e7a6a5bcec5c3: Status 404 returned error can't find the container with id 5b7175eb413306407af35f3cc929a0de8dd3c494260dcb7ee18e7a6a5bcec5c3
May 21 21:23:21.553105 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:21.553051    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c4996" event={"ID":"cf88c648-0ca7-4f80-9195-ae681ff43589","Type":"ContainerStarted","Data":"26e36f37d709d4c105732e481007b0ac46e9f72a04eaff23a0745cb53738b199"}
May 21 21:23:21.553304 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:21.553109    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c4996" event={"ID":"cf88c648-0ca7-4f80-9195-ae681ff43589","Type":"ContainerStarted","Data":"fb3a4a31e715f5d6ffd363fb7b5de85c759cab26eb538827c4340ab417ced14a"}
May 21 21:23:21.554692 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:21.554618    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-twvxh" event={"ID":"6b67a174-68c4-4ddf-94c1-6c5d6ffd57b1","Type":"ContainerStarted","Data":"f5b6b38bb78e77fa660da3eb1ec9df22e8df97b7273e147143bd9bde24638d4e"}
May 21 21:23:21.556423 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:21.556394    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-689f899957-lx6ml" event={"ID":"4c5066d9-fc99-4e63-b377-ae84fb797414","Type":"ContainerStarted","Data":"c4e5cdade0eb9b7d159257062c6550fda6b2a736be808dde5fe086f12ba8e2b1"}
May 21 21:23:21.556554 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:21.556428    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-689f899957-lx6ml" event={"ID":"4c5066d9-fc99-4e63-b377-ae84fb797414","Type":"ContainerStarted","Data":"5b7175eb413306407af35f3cc929a0de8dd3c494260dcb7ee18e7a6a5bcec5c3"}
May 21 21:23:21.556634 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:21.556548    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:23.563315 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:23.563269    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c4996" event={"ID":"cf88c648-0ca7-4f80-9195-ae681ff43589","Type":"ContainerStarted","Data":"0190f53f9948bc467ddf01a0c5e05c4a5646945e396ccc5deb45cc91bcbae18a"}
May 21 21:23:23.564813 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:23.564779    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-twvxh" event={"ID":"6b67a174-68c4-4ddf-94c1-6c5d6ffd57b1","Type":"ContainerStarted","Data":"1ab5808abaf1f18a76e7baed0bb46a23c698b8f4d88416786481893c7a008871"}
May 21 21:23:23.566394 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:23.566360    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc" event={"ID":"56955214-c7d1-4bda-9f1e-2abd74ff1f85","Type":"ContainerStarted","Data":"4155ef660800cf8ccdb33b742b7b7e16ed1a6a56025a286b4a99f77d01648af7"}
May 21 21:23:23.580277 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:23.580231    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-twvxh" podStartSLOduration=1.888154318 podStartE2EDuration="3.580216282s" podCreationTimestamp="2026-05-21 21:23:20 +0000 UTC" firstStartedPulling="2026-05-21 21:23:20.803052894 +0000 UTC m=+113.236064372" lastFinishedPulling="2026-05-21 21:23:22.495114861 +0000 UTC m=+114.928126336" observedRunningTime="2026-05-21 21:23:23.579048037 +0000 UTC m=+116.012059533" watchObservedRunningTime="2026-05-21 21:23:23.580216282 +0000 UTC m=+116.013227779"
May 21 21:23:23.580388 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:23.580323    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-689f899957-lx6ml" podStartSLOduration=3.580316066 podStartE2EDuration="3.580316066s" podCreationTimestamp="2026-05-21 21:23:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:23:21.588196535 +0000 UTC m=+114.021208032" watchObservedRunningTime="2026-05-21 21:23:23.580316066 +0000 UTC m=+116.013327564"
May 21 21:23:23.593960 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:23.593897    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8xcxc" podStartSLOduration=33.969351294 podStartE2EDuration="36.593880322s" podCreationTimestamp="2026-05-21 21:22:47 +0000 UTC" firstStartedPulling="2026-05-21 21:23:19.869858883 +0000 UTC m=+112.302870375" lastFinishedPulling="2026-05-21 21:23:22.494387922 +0000 UTC m=+114.927399403" observedRunningTime="2026-05-21 21:23:23.59288293 +0000 UTC m=+116.025894427" watchObservedRunningTime="2026-05-21 21:23:23.593880322 +0000 UTC m=+116.026891819"
May 21 21:23:24.571195 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:24.571157    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c4996" event={"ID":"cf88c648-0ca7-4f80-9195-ae681ff43589","Type":"ContainerStarted","Data":"55d90f0fb361836c8690348ce41838c38fb0989878db6003e4c92f13386f945a"}
May 21 21:23:24.588297 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:24.588244    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-c4996" podStartSLOduration=1.745417832 podStartE2EDuration="4.588230799s" podCreationTimestamp="2026-05-21 21:23:20 +0000 UTC" firstStartedPulling="2026-05-21 21:23:21.006419534 +0000 UTC m=+113.439431011" lastFinishedPulling="2026-05-21 21:23:23.849232503 +0000 UTC m=+116.282243978" observedRunningTime="2026-05-21 21:23:24.587981723 +0000 UTC m=+117.020993220" watchObservedRunningTime="2026-05-21 21:23:24.588230799 +0000 UTC m=+117.021242293"
May 21 21:23:31.489405 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.489368    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-68fw8"]
May 21 21:23:31.495725 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.495702    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.498521 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.498479    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 21 21:23:31.498521 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.498502    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lb4kv\""
May 21 21:23:31.499621 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.499602    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 21 21:23:31.499706 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.499631    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 21 21:23:31.499706 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.499652    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 21 21:23:31.659769 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.659734    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/14585704-8772-492e-8098-098dba235451-root\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.659919 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.659782    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14585704-8772-492e-8098-098dba235451-sys\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.659919 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.659810    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/14585704-8772-492e-8098-098dba235451-node-exporter-tls\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.659919 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.659837    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/14585704-8772-492e-8098-098dba235451-node-exporter-accelerators-collector-config\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.659919 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.659866    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/14585704-8772-492e-8098-098dba235451-node-exporter-textfile\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.660128 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.659970    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcrbh\" (UniqueName: \"kubernetes.io/projected/14585704-8772-492e-8098-098dba235451-kube-api-access-gcrbh\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.660128 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.660009    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14585704-8772-492e-8098-098dba235451-metrics-client-ca\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.660128 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.660060    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14585704-8772-492e-8098-098dba235451-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.660128 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.660106    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/14585704-8772-492e-8098-098dba235451-node-exporter-wtmp\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.760752 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.760655    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/14585704-8772-492e-8098-098dba235451-node-exporter-wtmp\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.760752 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.760715    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/14585704-8772-492e-8098-098dba235451-root\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.760752 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.760753    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14585704-8772-492e-8098-098dba235451-sys\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.760994 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.760770    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/14585704-8772-492e-8098-098dba235451-node-exporter-tls\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.760994 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.760791    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/14585704-8772-492e-8098-098dba235451-node-exporter-accelerators-collector-config\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.760994 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.760822    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/14585704-8772-492e-8098-098dba235451-node-exporter-textfile\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.760994 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.760843    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14585704-8772-492e-8098-098dba235451-sys\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.760994 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.760852    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/14585704-8772-492e-8098-098dba235451-node-exporter-wtmp\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.760994 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.760857    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/14585704-8772-492e-8098-098dba235451-root\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.760994 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.760919    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gcrbh\" (UniqueName: \"kubernetes.io/projected/14585704-8772-492e-8098-098dba235451-kube-api-access-gcrbh\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.760994 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.760950    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14585704-8772-492e-8098-098dba235451-metrics-client-ca\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.760994 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.760983    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14585704-8772-492e-8098-098dba235451-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.761491 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.761467    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/14585704-8772-492e-8098-098dba235451-node-exporter-accelerators-collector-config\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.761491 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.761481    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14585704-8772-492e-8098-098dba235451-metrics-client-ca\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.761581 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.761493    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/14585704-8772-492e-8098-098dba235451-node-exporter-textfile\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.763368 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.763341    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14585704-8772-492e-8098-098dba235451-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.763545 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.763526    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/14585704-8772-492e-8098-098dba235451-node-exporter-tls\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.769021 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.768981    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcrbh\" (UniqueName: \"kubernetes.io/projected/14585704-8772-492e-8098-098dba235451-kube-api-access-gcrbh\") pod \"node-exporter-68fw8\" (UID: \"14585704-8772-492e-8098-098dba235451\") " pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.806862 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:31.806836    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-68fw8"
May 21 21:23:31.816192 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:23:31.816164    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14585704_8772_492e_8098_098dba235451.slice/crio-afdb11f2181747f5df15fb6894bded85d12c067826099954ad45f8fba5aa5dd4 WatchSource:0}: Error finding container afdb11f2181747f5df15fb6894bded85d12c067826099954ad45f8fba5aa5dd4: Status 404 returned error can't find the container with id afdb11f2181747f5df15fb6894bded85d12c067826099954ad45f8fba5aa5dd4
May 21 21:23:32.560001 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.559873    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 21:23:32.565192 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.565171    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.568041 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.568010    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 21 21:23:32.568508 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.568443    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 21 21:23:32.568744 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.568724    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 21 21:23:32.568833 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.568809    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-b29nx\""
May 21 21:23:32.577459 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.575891    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 21 21:23:32.579319 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.579293    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 21 21:23:32.581307 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.579342    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 21 21:23:32.581307 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.579955    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 21 21:23:32.581307 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.580530    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 21 21:23:32.581307 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.580920    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 21 21:23:32.584446 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.584424    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 21:23:32.595178 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.595144    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-68fw8" event={"ID":"14585704-8772-492e-8098-098dba235451","Type":"ContainerStarted","Data":"afdb11f2181747f5df15fb6894bded85d12c067826099954ad45f8fba5aa5dd4"}
May 21 21:23:32.669136 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.669090    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee786cd1-f54c-436e-b674-41ca0fda5bef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.669316 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.669158    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.669316 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.669191    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.669316 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.669268    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee786cd1-f54c-436e-b674-41ca0fda5bef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.669491 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.669387    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.669491 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.669423    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ee786cd1-f54c-436e-b674-41ca0fda5bef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.669491 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.669459    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.669680 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.669494    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee786cd1-f54c-436e-b674-41ca0fda5bef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.669680 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.669519    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee786cd1-f54c-436e-b674-41ca0fda5bef-config-out\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.669680 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.669604    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-config-volume\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.669680 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.669636    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-web-config\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.669680 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.669666    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvctn\" (UniqueName: \"kubernetes.io/projected/ee786cd1-f54c-436e-b674-41ca0fda5bef-kube-api-access-pvctn\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.669920 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.669702    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.770670 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.770634    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-config-volume\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.770670 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.770675    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-web-config\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.770886 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.770696    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pvctn\" (UniqueName: \"kubernetes.io/projected/ee786cd1-f54c-436e-b674-41ca0fda5bef-kube-api-access-pvctn\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.770886 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.770718    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.770886 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.770743    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee786cd1-f54c-436e-b674-41ca0fda5bef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.770886 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.770765    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.770886 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.770784    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.770886 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.770810    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee786cd1-f54c-436e-b674-41ca0fda5bef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.770886 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.770851    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.770886 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.770868    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ee786cd1-f54c-436e-b674-41ca0fda5bef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.771256 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.770895    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.771256 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.770917    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee786cd1-f54c-436e-b674-41ca0fda5bef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.771256 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.770931    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee786cd1-f54c-436e-b674-41ca0fda5bef-config-out\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.772095 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.771851    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ee786cd1-f54c-436e-b674-41ca0fda5bef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.772095 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.771867    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee786cd1-f54c-436e-b674-41ca0fda5bef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.772816 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.772751    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee786cd1-f54c-436e-b674-41ca0fda5bef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.773775 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.773735    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-config-volume\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.774606 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.774065    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.774606 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.774519    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee786cd1-f54c-436e-b674-41ca0fda5bef-config-out\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.774760 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.774645    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.774926 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.774900    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.775544 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.775515    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.775791 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.775769    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-web-config\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.776134 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.776117    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.776227 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.776211    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee786cd1-f54c-436e-b674-41ca0fda5bef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.781306 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.781284    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvctn\" (UniqueName: \"kubernetes.io/projected/ee786cd1-f54c-436e-b674-41ca0fda5bef-kube-api-access-pvctn\") pod \"alertmanager-main-0\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:32.883360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:32.883333    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 21:23:33.033136 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.033090    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 21:23:33.035874 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:23:33.035853    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee786cd1_f54c_436e_b674_41ca0fda5bef.slice/crio-8febffdca4b07ca0c893ff743181a9a1ed200ce6f5c4d9f43d353d3be56c5607 WatchSource:0}: Error finding container 8febffdca4b07ca0c893ff743181a9a1ed200ce6f5c4d9f43d353d3be56c5607: Status 404 returned error can't find the container with id 8febffdca4b07ca0c893ff743181a9a1ed200ce6f5c4d9f43d353d3be56c5607
May 21 21:23:33.530881 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.530846    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-645865f8c5-tns8l"]
May 21 21:23:33.534483 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.534463    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.537047 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.536981    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 21 21:23:33.537239 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.537135    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 21 21:23:33.537239 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.537142    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 21 21:23:33.537360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.537261    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 21 21:23:33.537360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.537288    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 21 21:23:33.537360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.537342    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1ggn6ulrffnm5\""
May 21 21:23:33.537467 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.537368    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7l8h6\""
May 21 21:23:33.544244 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.544221    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-645865f8c5-tns8l"]
May 21 21:23:33.599640 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.599605    2559 generic.go:358] "Generic (PLEG): container finished" podID="14585704-8772-492e-8098-098dba235451" containerID="5ed118d313986f517b541ed528109780d8c5bdcc035fab6d0dbc07c92b4e1fb6" exitCode=0
May 21 21:23:33.600053 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.599711    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-68fw8" event={"ID":"14585704-8772-492e-8098-098dba235451","Type":"ContainerDied","Data":"5ed118d313986f517b541ed528109780d8c5bdcc035fab6d0dbc07c92b4e1fb6"}
May 21 21:23:33.600993 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.600964    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee786cd1-f54c-436e-b674-41ca0fda5bef","Type":"ContainerStarted","Data":"8febffdca4b07ca0c893ff743181a9a1ed200ce6f5c4d9f43d353d3be56c5607"}
May 21 21:23:33.678773 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.678706    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.678773 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.678741    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbngm\" (UniqueName: \"kubernetes.io/projected/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-kube-api-access-pbngm\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.678773 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.678760    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.678943 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.678785    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.678943 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.678839    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-metrics-client-ca\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.678943 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.678888    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-secret-thanos-querier-tls\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.679077 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.678950    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-secret-grpc-tls\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.679077 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.678978    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.779856 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.779814    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-metrics-client-ca\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.779999 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.779918    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-secret-thanos-querier-tls\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.780056 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.780040    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-secret-grpc-tls\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.780130 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.780084    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.780130 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.780119    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.780192 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.780144    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbngm\" (UniqueName: \"kubernetes.io/projected/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-kube-api-access-pbngm\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.780192 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.780173    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.780260 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.780238    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.781508 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.781141    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-metrics-client-ca\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.784938 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.784504    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-secret-thanos-querier-tls\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.784938 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.784884    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.785541 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.785238    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.785541 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.785485    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.786104 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.786053    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.786280 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.786258    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-secret-grpc-tls\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.788782 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.788760    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbngm\" (UniqueName: \"kubernetes.io/projected/a090f7d1-91b5-415e-ae5a-a219a6fb6adb-kube-api-access-pbngm\") pod \"thanos-querier-645865f8c5-tns8l\" (UID: \"a090f7d1-91b5-415e-ae5a-a219a6fb6adb\") " pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.843957 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.843926    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:33.985007 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:33.984968    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-645865f8c5-tns8l"]
May 21 21:23:33.987530 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:23:33.987501    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda090f7d1_91b5_415e_ae5a_a219a6fb6adb.slice/crio-4d23b87d1d7c17375ba8983121576080a29eac452de3d33e669b7f81b82e56e9 WatchSource:0}: Error finding container 4d23b87d1d7c17375ba8983121576080a29eac452de3d33e669b7f81b82e56e9: Status 404 returned error can't find the container with id 4d23b87d1d7c17375ba8983121576080a29eac452de3d33e669b7f81b82e56e9
May 21 21:23:34.611817 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:34.611782    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-68fw8" event={"ID":"14585704-8772-492e-8098-098dba235451","Type":"ContainerStarted","Data":"098a079fa80ae6bd01eac34f61c5267d2c027e462ec106fae627c2a47df0d2fa"}
May 21 21:23:34.611817 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:34.611819    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-68fw8" event={"ID":"14585704-8772-492e-8098-098dba235451","Type":"ContainerStarted","Data":"14bd7be3463bdb61a4cffa01e7ad5fb390175f2658ec893a23d69c73e727e3bb"}
May 21 21:23:34.613184 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:34.613155    2559 generic.go:358] "Generic (PLEG): container finished" podID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerID="585d35527aee6525465c6cac5148b475313d976d686d47d9989997efc353be23" exitCode=0
May 21 21:23:34.613301 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:34.613217    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee786cd1-f54c-436e-b674-41ca0fda5bef","Type":"ContainerDied","Data":"585d35527aee6525465c6cac5148b475313d976d686d47d9989997efc353be23"}
May 21 21:23:34.614443 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:34.614423    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l" event={"ID":"a090f7d1-91b5-415e-ae5a-a219a6fb6adb","Type":"ContainerStarted","Data":"4d23b87d1d7c17375ba8983121576080a29eac452de3d33e669b7f81b82e56e9"}
May 21 21:23:34.638862 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:34.638812    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-68fw8" podStartSLOduration=2.669606626 podStartE2EDuration="3.638796718s" podCreationTimestamp="2026-05-21 21:23:31 +0000 UTC" firstStartedPulling="2026-05-21 21:23:31.81788145 +0000 UTC m=+124.250892925" lastFinishedPulling="2026-05-21 21:23:32.787071545 +0000 UTC m=+125.220083017" observedRunningTime="2026-05-21 21:23:34.636291535 +0000 UTC m=+127.069303035" watchObservedRunningTime="2026-05-21 21:23:34.638796718 +0000 UTC m=+127.071808214"
May 21 21:23:36.909713 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:36.909683    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs\") pod \"network-metrics-daemon-kj49t\" (UID: \"7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd\") " pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:23:36.912127 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:36.912107    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd-metrics-certs\") pod \"network-metrics-daemon-kj49t\" (UID: \"7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd\") " pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:23:37.079631 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:37.079526    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jqv7p\""
May 21 21:23:37.087828 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:37.087810    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj49t"
May 21 21:23:37.210297 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:37.210262    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kj49t"]
May 21 21:23:37.213134 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:23:37.213101    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cfa6b5d_c8d3_4388_85a1_5c9105cc54fd.slice/crio-a320d6875a999723b8f4bc7f48f2fcc923b3baf92d7a61f8d4a7cf63bf7ae122 WatchSource:0}: Error finding container a320d6875a999723b8f4bc7f48f2fcc923b3baf92d7a61f8d4a7cf63bf7ae122: Status 404 returned error can't find the container with id a320d6875a999723b8f4bc7f48f2fcc923b3baf92d7a61f8d4a7cf63bf7ae122
May 21 21:23:37.627734 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:37.627698    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee786cd1-f54c-436e-b674-41ca0fda5bef","Type":"ContainerStarted","Data":"68401e3d7e709fcf9a371e780cc0c8f3ca971e704e94b70ccecb823e0ef21951"}
May 21 21:23:37.627734 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:37.627736    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee786cd1-f54c-436e-b674-41ca0fda5bef","Type":"ContainerStarted","Data":"cb0727380642cfa73d53b09ec36c0a7188e66ee79de827bcec32a56aaf469023"}
May 21 21:23:37.627956 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:37.627749    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee786cd1-f54c-436e-b674-41ca0fda5bef","Type":"ContainerStarted","Data":"468034f0f3131187ec1f007c6a666483553e7a44f26bf991edb4d11b1975d1f4"}
May 21 21:23:37.627956 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:37.627761    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee786cd1-f54c-436e-b674-41ca0fda5bef","Type":"ContainerStarted","Data":"623a8ac5b5e33a0d44a14f3da2f286ab68dd46211d5a1125de2a82c901465b0d"}
May 21 21:23:37.627956 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:37.627771    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee786cd1-f54c-436e-b674-41ca0fda5bef","Type":"ContainerStarted","Data":"bb727f749965b6a53a5f7b6b6920fcb4ea94747fb6806bf41b97c5dfe47b8bb7"}
May 21 21:23:37.628903 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:37.628869    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kj49t" event={"ID":"7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd","Type":"ContainerStarted","Data":"a320d6875a999723b8f4bc7f48f2fcc923b3baf92d7a61f8d4a7cf63bf7ae122"}
May 21 21:23:37.635472 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:37.635365    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l" event={"ID":"a090f7d1-91b5-415e-ae5a-a219a6fb6adb","Type":"ContainerStarted","Data":"cd229feb5015f7678b78030d611f48306406be6ec008b4bf7075f32d75996723"}
May 21 21:23:37.635472 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:37.635400    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l" event={"ID":"a090f7d1-91b5-415e-ae5a-a219a6fb6adb","Type":"ContainerStarted","Data":"62e0b9a8b5adc4e70cc8128cfebeef9e0fa75d8b1769bcc556d5f01390d04dc4"}
May 21 21:23:37.635472 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:37.635411    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l" event={"ID":"a090f7d1-91b5-415e-ae5a-a219a6fb6adb","Type":"ContainerStarted","Data":"795f402c68c68293d4b06fd5c0923d028a4b0b21146230eb51ce69b4ccafcc3f"}
May 21 21:23:38.640535 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:38.640495    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l" event={"ID":"a090f7d1-91b5-415e-ae5a-a219a6fb6adb","Type":"ContainerStarted","Data":"ae7350b2826870bbd29889132b2141c6197f8e4a4534100395afa699385e96be"}
May 21 21:23:38.640535 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:38.640539    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l" event={"ID":"a090f7d1-91b5-415e-ae5a-a219a6fb6adb","Type":"ContainerStarted","Data":"c8cd9d3bf76638acd2d1539151718d5a66ca7af12c0e75681f24f43d17bec1a2"}
May 21 21:23:38.641043 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:38.640553    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l" event={"ID":"a090f7d1-91b5-415e-ae5a-a219a6fb6adb","Type":"ContainerStarted","Data":"ebc4745230b5f24e03b6846945371702bde0b81e58cb457c2ec7290adb982e18"}
May 21 21:23:38.641043 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:38.640658    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:23:38.643395 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:38.643372    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee786cd1-f54c-436e-b674-41ca0fda5bef","Type":"ContainerStarted","Data":"89800b6201f4e558989fc4a803e5951a33668062d877e3ab819be4770ec660d8"}
May 21 21:23:38.644983 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:38.644958    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kj49t" event={"ID":"7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd","Type":"ContainerStarted","Data":"a9b85528efa4ee50e8571acd8b9fbdb598fd3ddfc2deb0c8a2a16ee3e4bcf204"}
May 21 21:23:38.645093 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:38.644987    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kj49t" event={"ID":"7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd","Type":"ContainerStarted","Data":"decfccc31169c9602e517cceea6b0e6062370d544830b82d532582148af2d340"}
May 21 21:23:38.663062 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:38.662954    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l" podStartSLOduration=1.957385587 podStartE2EDuration="5.662940944s" podCreationTimestamp="2026-05-21 21:23:33 +0000 UTC" firstStartedPulling="2026-05-21 21:23:33.989713316 +0000 UTC m=+126.422724793" lastFinishedPulling="2026-05-21 21:23:37.695268665 +0000 UTC m=+130.128280150" observedRunningTime="2026-05-21 21:23:38.660351329 +0000 UTC m=+131.093362823" watchObservedRunningTime="2026-05-21 21:23:38.662940944 +0000 UTC m=+131.095952440"
May 21 21:23:38.686768 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:38.686733    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.027090217 podStartE2EDuration="6.686721072s" podCreationTimestamp="2026-05-21 21:23:32 +0000 UTC" firstStartedPulling="2026-05-21 21:23:33.0378488 +0000 UTC m=+125.470860276" lastFinishedPulling="2026-05-21 21:23:37.697479644 +0000 UTC m=+130.130491131" observedRunningTime="2026-05-21 21:23:38.685228402 +0000 UTC m=+131.118239897" watchObservedRunningTime="2026-05-21 21:23:38.686721072 +0000 UTC m=+131.119732567"
May 21 21:23:38.703051 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:38.703005    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kj49t" podStartSLOduration=129.730772639 podStartE2EDuration="2m10.702992336s" podCreationTimestamp="2026-05-21 21:21:28 +0000 UTC" firstStartedPulling="2026-05-21 21:23:37.214975692 +0000 UTC m=+129.647987165" lastFinishedPulling="2026-05-21 21:23:38.187195365 +0000 UTC m=+130.620206862" observedRunningTime="2026-05-21 21:23:38.702416915 +0000 UTC m=+131.135428417" watchObservedRunningTime="2026-05-21 21:23:38.702992336 +0000 UTC m=+131.136003832"
May 21 21:23:42.563779 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:42.563750    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-689f899957-lx6ml"
May 21 21:23:42.947744 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:42.947664    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-9nqr7"]
May 21 21:23:42.951302 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:42.951287    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-9nqr7"
May 21 21:23:42.953872 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:42.953848    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gwvz6\""
May 21 21:23:42.953872 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:42.953867    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 21 21:23:42.954030 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:42.953872    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 21 21:23:42.958388 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:42.958364    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlqhk\" (UniqueName: \"kubernetes.io/projected/7ccccd1d-a4de-4db7-a58e-021d0397f81e-kube-api-access-jlqhk\") pod \"downloads-57bd96b888-9nqr7\" (UID: \"7ccccd1d-a4de-4db7-a58e-021d0397f81e\") " pod="openshift-console/downloads-57bd96b888-9nqr7"
May 21 21:23:42.962033 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:42.962008    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-9nqr7"]
May 21 21:23:43.058741 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:43.058713    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jlqhk\" (UniqueName: \"kubernetes.io/projected/7ccccd1d-a4de-4db7-a58e-021d0397f81e-kube-api-access-jlqhk\") pod \"downloads-57bd96b888-9nqr7\" (UID: \"7ccccd1d-a4de-4db7-a58e-021d0397f81e\") " pod="openshift-console/downloads-57bd96b888-9nqr7"
May 21 21:23:43.066785 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:43.066758    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlqhk\" (UniqueName: \"kubernetes.io/projected/7ccccd1d-a4de-4db7-a58e-021d0397f81e-kube-api-access-jlqhk\") pod \"downloads-57bd96b888-9nqr7\" (UID: \"7ccccd1d-a4de-4db7-a58e-021d0397f81e\") " pod="openshift-console/downloads-57bd96b888-9nqr7"
May 21 21:23:43.262517 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:43.262427    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-9nqr7"
May 21 21:23:43.384676 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:43.384646    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-9nqr7"]
May 21 21:23:43.387103 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:23:43.387071    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ccccd1d_a4de_4db7_a58e_021d0397f81e.slice/crio-9873f2c5cd279dc28bb9953582da57aa1b1141a759287c6254c8b3a8980f8b63 WatchSource:0}: Error finding container 9873f2c5cd279dc28bb9953582da57aa1b1141a759287c6254c8b3a8980f8b63: Status 404 returned error can't find the container with id 9873f2c5cd279dc28bb9953582da57aa1b1141a759287c6254c8b3a8980f8b63
May 21 21:23:43.659914 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:43.659876    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-9nqr7" event={"ID":"7ccccd1d-a4de-4db7-a58e-021d0397f81e","Type":"ContainerStarted","Data":"9873f2c5cd279dc28bb9953582da57aa1b1141a759287c6254c8b3a8980f8b63"}
May 21 21:23:44.656058 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:23:44.656028    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-645865f8c5-tns8l"
May 21 21:24:00.649659 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.649612    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-fc7cf6cf4-2jg4b"]
May 21 21:24:00.654644 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.654616    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.657489 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.657464    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 21 21:24:00.657645 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.657519    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 21 21:24:00.657645 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.657526    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 21 21:24:00.658600 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.658568    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 21 21:24:00.658708 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.658631    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 21 21:24:00.658907 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.658888    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g9zpv\""
May 21 21:24:00.669495 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.669471    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc7cf6cf4-2jg4b"]
May 21 21:24:00.670687 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.670660    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 21 21:24:00.715512 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.715477    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-trusted-ca-bundle\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.715708 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.715531    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-oauth-serving-cert\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.715708 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.715562    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20ba4adc-02ee-4e94-bda8-452e1727b6a5-console-oauth-config\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.715708 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.715644    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20ba4adc-02ee-4e94-bda8-452e1727b6a5-console-serving-cert\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.715845 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.715703    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-service-ca\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.715845 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.715750    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc267\" (UniqueName: \"kubernetes.io/projected/20ba4adc-02ee-4e94-bda8-452e1727b6a5-kube-api-access-jc267\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.715936 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.715840    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-console-config\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.816271 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.816237    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-console-config\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.816438 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.816298    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-trusted-ca-bundle\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.816438 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.816330    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-oauth-serving-cert\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.816438 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.816358    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20ba4adc-02ee-4e94-bda8-452e1727b6a5-console-oauth-config\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.816438 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.816423    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20ba4adc-02ee-4e94-bda8-452e1727b6a5-console-serving-cert\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.816677 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.816446    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-service-ca\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.816677 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.816474    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jc267\" (UniqueName: \"kubernetes.io/projected/20ba4adc-02ee-4e94-bda8-452e1727b6a5-kube-api-access-jc267\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.817057 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.817026    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-console-config\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.817492 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.817447    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-oauth-serving-cert\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.817773 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.817750    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-service-ca\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.817889 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.817846    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-trusted-ca-bundle\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.819247 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.819221    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20ba4adc-02ee-4e94-bda8-452e1727b6a5-console-serving-cert\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.819364 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.819296    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20ba4adc-02ee-4e94-bda8-452e1727b6a5-console-oauth-config\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.826265 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.826223    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc267\" (UniqueName: \"kubernetes.io/projected/20ba4adc-02ee-4e94-bda8-452e1727b6a5-kube-api-access-jc267\") pod \"console-fc7cf6cf4-2jg4b\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") " pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:00.971422 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:00.971397    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:01.122652 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:01.122615    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc7cf6cf4-2jg4b"]
May 21 21:24:01.124798 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:24:01.124772    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ba4adc_02ee_4e94_bda8_452e1727b6a5.slice/crio-6d2c0d350a051ff0d68a6d4c71ab41fdb48e9366ee97345b659fedcaba213a0a WatchSource:0}: Error finding container 6d2c0d350a051ff0d68a6d4c71ab41fdb48e9366ee97345b659fedcaba213a0a: Status 404 returned error can't find the container with id 6d2c0d350a051ff0d68a6d4c71ab41fdb48e9366ee97345b659fedcaba213a0a
May 21 21:24:01.720127 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:01.720085    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-9nqr7" event={"ID":"7ccccd1d-a4de-4db7-a58e-021d0397f81e","Type":"ContainerStarted","Data":"6718e06a443f16e8914b186764311857653b52cd7b15338a93a60f67c1141429"}
May 21 21:24:01.720964 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:01.720932    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-9nqr7"
May 21 21:24:01.722707 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:01.722676    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc7cf6cf4-2jg4b" event={"ID":"20ba4adc-02ee-4e94-bda8-452e1727b6a5","Type":"ContainerStarted","Data":"6d2c0d350a051ff0d68a6d4c71ab41fdb48e9366ee97345b659fedcaba213a0a"}
May 21 21:24:01.732502 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:01.732479    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-9nqr7"
May 21 21:24:01.738933 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:01.738649    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-9nqr7" podStartSLOduration=2.210177616 podStartE2EDuration="19.738577525s" podCreationTimestamp="2026-05-21 21:23:42 +0000 UTC" firstStartedPulling="2026-05-21 21:23:43.389024493 +0000 UTC m=+135.822035969" lastFinishedPulling="2026-05-21 21:24:00.917424395 +0000 UTC m=+153.350435878" observedRunningTime="2026-05-21 21:24:01.737615252 +0000 UTC m=+154.170626747" watchObservedRunningTime="2026-05-21 21:24:01.738577525 +0000 UTC m=+154.171589022"
May 21 21:24:05.740957 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:05.740898    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc7cf6cf4-2jg4b" event={"ID":"20ba4adc-02ee-4e94-bda8-452e1727b6a5","Type":"ContainerStarted","Data":"8fbf50a0eba38e7aa1e432edbf5a649c6a423fe6565623c5658a526a94ac2296"}
May 21 21:24:05.763674 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:05.763626    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-fc7cf6cf4-2jg4b" podStartSLOduration=2.106507664 podStartE2EDuration="5.763609911s" podCreationTimestamp="2026-05-21 21:24:00 +0000 UTC" firstStartedPulling="2026-05-21 21:24:01.127097824 +0000 UTC m=+153.560109298" lastFinishedPulling="2026-05-21 21:24:04.78420006 +0000 UTC m=+157.217211545" observedRunningTime="2026-05-21 21:24:05.76279783 +0000 UTC m=+158.195809327" watchObservedRunningTime="2026-05-21 21:24:05.763609911 +0000 UTC m=+158.196621404"
May 21 21:24:10.972212 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:10.972124    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:10.972212 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:10.972161    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:10.976986 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:10.976962    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:11.765198 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:11.765170    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:24:16.777338 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:16.777300    2559 generic.go:358] "Generic (PLEG): container finished" podID="982cde8e-e1f2-4908-82ab-981e64a2cac9" containerID="6f41f4f20671d9c5e7c71d0cd2402270655b70c25dd0bdc43b14441c9c5331a7" exitCode=0
May 21 21:24:16.777933 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:16.777378    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-d4m5b" event={"ID":"982cde8e-e1f2-4908-82ab-981e64a2cac9","Type":"ContainerDied","Data":"6f41f4f20671d9c5e7c71d0cd2402270655b70c25dd0bdc43b14441c9c5331a7"}
May 21 21:24:16.777933 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:16.777795    2559 scope.go:117] "RemoveContainer" containerID="6f41f4f20671d9c5e7c71d0cd2402270655b70c25dd0bdc43b14441c9c5331a7"
May 21 21:24:17.781921 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:17.781891    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-d4m5b" event={"ID":"982cde8e-e1f2-4908-82ab-981e64a2cac9","Type":"ContainerStarted","Data":"f4acd17991c856ca24a336820c31e781686697ea217d234be8a08ef104023bad"}
May 21 21:24:25.805403 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:25.805368    2559 generic.go:358] "Generic (PLEG): container finished" podID="4e696e0a-7b15-4b92-bd3a-4bd085747ecf" containerID="a562164c5fbe484a4861897eef666c8e0b01686c4ae4e9601dd3289d16d81243" exitCode=0
May 21 21:24:25.805829 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:25.805442    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-pvsqr" event={"ID":"4e696e0a-7b15-4b92-bd3a-4bd085747ecf","Type":"ContainerDied","Data":"a562164c5fbe484a4861897eef666c8e0b01686c4ae4e9601dd3289d16d81243"}
May 21 21:24:25.805829 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:25.805759    2559 scope.go:117] "RemoveContainer" containerID="a562164c5fbe484a4861897eef666c8e0b01686c4ae4e9601dd3289d16d81243"
May 21 21:24:26.809388 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:26.809353    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-pvsqr" event={"ID":"4e696e0a-7b15-4b92-bd3a-4bd085747ecf","Type":"ContainerStarted","Data":"f6f627ab83f0c2f072fc1efb4d847ed8f5d5b081823a2945c0002c96d33cd1b6"}
May 21 21:24:52.282321 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:52.282275    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 21:24:52.282892 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:52.282781    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="alertmanager" containerID="cri-o://bb727f749965b6a53a5f7b6b6920fcb4ea94747fb6806bf41b97c5dfe47b8bb7" gracePeriod=120
May 21 21:24:52.282892 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:52.282849    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="kube-rbac-proxy-web" containerID="cri-o://468034f0f3131187ec1f007c6a666483553e7a44f26bf991edb4d11b1975d1f4" gracePeriod=120
May 21 21:24:52.282892 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:52.282851    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="kube-rbac-proxy" containerID="cri-o://cb0727380642cfa73d53b09ec36c0a7188e66ee79de827bcec32a56aaf469023" gracePeriod=120
May 21 21:24:52.283043 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:52.282840    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="kube-rbac-proxy-metric" containerID="cri-o://68401e3d7e709fcf9a371e780cc0c8f3ca971e704e94b70ccecb823e0ef21951" gracePeriod=120
May 21 21:24:52.283043 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:52.282853    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="config-reloader" containerID="cri-o://623a8ac5b5e33a0d44a14f3da2f286ab68dd46211d5a1125de2a82c901465b0d" gracePeriod=120
May 21 21:24:52.283043 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:52.282784    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="prom-label-proxy" containerID="cri-o://89800b6201f4e558989fc4a803e5951a33668062d877e3ab819be4770ec660d8" gracePeriod=120
May 21 21:24:52.885752 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:52.885716    2559 generic.go:358] "Generic (PLEG): container finished" podID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerID="89800b6201f4e558989fc4a803e5951a33668062d877e3ab819be4770ec660d8" exitCode=0
May 21 21:24:52.885752 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:52.885743    2559 generic.go:358] "Generic (PLEG): container finished" podID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerID="68401e3d7e709fcf9a371e780cc0c8f3ca971e704e94b70ccecb823e0ef21951" exitCode=0
May 21 21:24:52.885752 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:52.885749    2559 generic.go:358] "Generic (PLEG): container finished" podID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerID="cb0727380642cfa73d53b09ec36c0a7188e66ee79de827bcec32a56aaf469023" exitCode=0
May 21 21:24:52.885752 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:52.885755    2559 generic.go:358] "Generic (PLEG): container finished" podID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerID="623a8ac5b5e33a0d44a14f3da2f286ab68dd46211d5a1125de2a82c901465b0d" exitCode=0
May 21 21:24:52.885752 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:52.885762    2559 generic.go:358] "Generic (PLEG): container finished" podID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerID="bb727f749965b6a53a5f7b6b6920fcb4ea94747fb6806bf41b97c5dfe47b8bb7" exitCode=0
May 21 21:24:52.886038 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:52.885795    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee786cd1-f54c-436e-b674-41ca0fda5bef","Type":"ContainerDied","Data":"89800b6201f4e558989fc4a803e5951a33668062d877e3ab819be4770ec660d8"}
May 21 21:24:52.886038 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:52.885832    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee786cd1-f54c-436e-b674-41ca0fda5bef","Type":"ContainerDied","Data":"68401e3d7e709fcf9a371e780cc0c8f3ca971e704e94b70ccecb823e0ef21951"}
May 21 21:24:52.886038 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:52.885845    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee786cd1-f54c-436e-b674-41ca0fda5bef","Type":"ContainerDied","Data":"cb0727380642cfa73d53b09ec36c0a7188e66ee79de827bcec32a56aaf469023"}
May 21 21:24:52.886038 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:52.885854    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee786cd1-f54c-436e-b674-41ca0fda5bef","Type":"ContainerDied","Data":"623a8ac5b5e33a0d44a14f3da2f286ab68dd46211d5a1125de2a82c901465b0d"}
May 21 21:24:52.886038 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:52.885863    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee786cd1-f54c-436e-b674-41ca0fda5bef","Type":"ContainerDied","Data":"bb727f749965b6a53a5f7b6b6920fcb4ea94747fb6806bf41b97c5dfe47b8bb7"}
May 21 21:24:53.533768 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.533748    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:53.549429 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.549407    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-kube-rbac-proxy-web\") pod \"ee786cd1-f54c-436e-b674-41ca0fda5bef\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") "
May 21 21:24:53.549562 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.549443    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-main-tls\") pod \"ee786cd1-f54c-436e-b674-41ca0fda5bef\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") "
May 21 21:24:53.549562 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.549461    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ee786cd1-f54c-436e-b674-41ca0fda5bef-alertmanager-main-db\") pod \"ee786cd1-f54c-436e-b674-41ca0fda5bef\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") "
May 21 21:24:53.549562 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.549482    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ee786cd1-f54c-436e-b674-41ca0fda5bef\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") "
May 21 21:24:53.549562 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.549506    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee786cd1-f54c-436e-b674-41ca0fda5bef-alertmanager-trusted-ca-bundle\") pod \"ee786cd1-f54c-436e-b674-41ca0fda5bef\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") "
May 21 21:24:53.549562 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.549540    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee786cd1-f54c-436e-b674-41ca0fda5bef-config-out\") pod \"ee786cd1-f54c-436e-b674-41ca0fda5bef\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") "
May 21 21:24:53.549833 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.549610    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee786cd1-f54c-436e-b674-41ca0fda5bef-tls-assets\") pod \"ee786cd1-f54c-436e-b674-41ca0fda5bef\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") "
May 21 21:24:53.549833 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.549639    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvctn\" (UniqueName: \"kubernetes.io/projected/ee786cd1-f54c-436e-b674-41ca0fda5bef-kube-api-access-pvctn\") pod \"ee786cd1-f54c-436e-b674-41ca0fda5bef\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") "
May 21 21:24:53.549833 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.549678    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee786cd1-f54c-436e-b674-41ca0fda5bef-metrics-client-ca\") pod \"ee786cd1-f54c-436e-b674-41ca0fda5bef\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") "
May 21 21:24:53.549833 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.549712    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-config-volume\") pod \"ee786cd1-f54c-436e-b674-41ca0fda5bef\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") "
May 21 21:24:53.549833 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.549755    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-cluster-tls-config\") pod \"ee786cd1-f54c-436e-b674-41ca0fda5bef\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") "
May 21 21:24:53.549833 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.549783    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-web-config\") pod \"ee786cd1-f54c-436e-b674-41ca0fda5bef\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") "
May 21 21:24:53.549833 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.549808    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-kube-rbac-proxy\") pod \"ee786cd1-f54c-436e-b674-41ca0fda5bef\" (UID: \"ee786cd1-f54c-436e-b674-41ca0fda5bef\") "
May 21 21:24:53.549833 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.549814    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee786cd1-f54c-436e-b674-41ca0fda5bef-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ee786cd1-f54c-436e-b674-41ca0fda5bef" (UID: "ee786cd1-f54c-436e-b674-41ca0fda5bef"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:24:53.550209 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.549917    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee786cd1-f54c-436e-b674-41ca0fda5bef-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ee786cd1-f54c-436e-b674-41ca0fda5bef" (UID: "ee786cd1-f54c-436e-b674-41ca0fda5bef"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 21:24:53.550209 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.550087    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee786cd1-f54c-436e-b674-41ca0fda5bef-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:24:53.550209 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.550110    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ee786cd1-f54c-436e-b674-41ca0fda5bef-alertmanager-main-db\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:24:53.551302 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.551274    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee786cd1-f54c-436e-b674-41ca0fda5bef-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ee786cd1-f54c-436e-b674-41ca0fda5bef" (UID: "ee786cd1-f54c-436e-b674-41ca0fda5bef"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 21:24:53.552306 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.552279    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ee786cd1-f54c-436e-b674-41ca0fda5bef" (UID: "ee786cd1-f54c-436e-b674-41ca0fda5bef"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 21:24:53.552982 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.552942    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-config-volume" (OuterVolumeSpecName: "config-volume") pod "ee786cd1-f54c-436e-b674-41ca0fda5bef" (UID: "ee786cd1-f54c-436e-b674-41ca0fda5bef"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 21:24:53.553095 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.553004    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee786cd1-f54c-436e-b674-41ca0fda5bef-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ee786cd1-f54c-436e-b674-41ca0fda5bef" (UID: "ee786cd1-f54c-436e-b674-41ca0fda5bef"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:24:53.553163 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.553106    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ee786cd1-f54c-436e-b674-41ca0fda5bef" (UID: "ee786cd1-f54c-436e-b674-41ca0fda5bef"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 21:24:53.553423 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.553397    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ee786cd1-f54c-436e-b674-41ca0fda5bef" (UID: "ee786cd1-f54c-436e-b674-41ca0fda5bef"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 21:24:53.553520 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.553455    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee786cd1-f54c-436e-b674-41ca0fda5bef-kube-api-access-pvctn" (OuterVolumeSpecName: "kube-api-access-pvctn") pod "ee786cd1-f54c-436e-b674-41ca0fda5bef" (UID: "ee786cd1-f54c-436e-b674-41ca0fda5bef"). InnerVolumeSpecName "kube-api-access-pvctn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:24:53.553606 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.553521    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee786cd1-f54c-436e-b674-41ca0fda5bef-config-out" (OuterVolumeSpecName: "config-out") pod "ee786cd1-f54c-436e-b674-41ca0fda5bef" (UID: "ee786cd1-f54c-436e-b674-41ca0fda5bef"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:24:53.553606 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.553531    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ee786cd1-f54c-436e-b674-41ca0fda5bef" (UID: "ee786cd1-f54c-436e-b674-41ca0fda5bef"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 21:24:53.556935 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.556755    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ee786cd1-f54c-436e-b674-41ca0fda5bef" (UID: "ee786cd1-f54c-436e-b674-41ca0fda5bef"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 21:24:53.563481 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.563458    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-web-config" (OuterVolumeSpecName: "web-config") pod "ee786cd1-f54c-436e-b674-41ca0fda5bef" (UID: "ee786cd1-f54c-436e-b674-41ca0fda5bef"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 21:24:53.650836 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.650759    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee786cd1-f54c-436e-b674-41ca0fda5bef-tls-assets\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:24:53.650836 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.650793    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvctn\" (UniqueName: \"kubernetes.io/projected/ee786cd1-f54c-436e-b674-41ca0fda5bef-kube-api-access-pvctn\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:24:53.650836 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.650803    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee786cd1-f54c-436e-b674-41ca0fda5bef-metrics-client-ca\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:24:53.650836 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.650813    2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-config-volume\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:24:53.650836 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.650821    2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-cluster-tls-config\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:24:53.650836 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.650829    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-web-config\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:24:53.650836 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.650839    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:24:53.651165 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.650849    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:24:53.651165 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.650858    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-main-tls\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:24:53.651165 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.650867    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ee786cd1-f54c-436e-b674-41ca0fda5bef-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:24:53.651165 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.650877    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee786cd1-f54c-436e-b674-41ca0fda5bef-config-out\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:24:53.890684 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.890653    2559 generic.go:358] "Generic (PLEG): container finished" podID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerID="468034f0f3131187ec1f007c6a666483553e7a44f26bf991edb4d11b1975d1f4" exitCode=0
May 21 21:24:53.890841 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.890727    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee786cd1-f54c-436e-b674-41ca0fda5bef","Type":"ContainerDied","Data":"468034f0f3131187ec1f007c6a666483553e7a44f26bf991edb4d11b1975d1f4"}
May 21 21:24:53.890841 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.890754    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ee786cd1-f54c-436e-b674-41ca0fda5bef","Type":"ContainerDied","Data":"8febffdca4b07ca0c893ff743181a9a1ed200ce6f5c4d9f43d353d3be56c5607"}
May 21 21:24:53.890841 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.890763    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:53.890942 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.890770    2559 scope.go:117] "RemoveContainer" containerID="89800b6201f4e558989fc4a803e5951a33668062d877e3ab819be4770ec660d8"
May 21 21:24:53.898392 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.898320    2559 scope.go:117] "RemoveContainer" containerID="68401e3d7e709fcf9a371e780cc0c8f3ca971e704e94b70ccecb823e0ef21951"
May 21 21:24:53.905002 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.904981    2559 scope.go:117] "RemoveContainer" containerID="cb0727380642cfa73d53b09ec36c0a7188e66ee79de827bcec32a56aaf469023"
May 21 21:24:53.911073 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.911056    2559 scope.go:117] "RemoveContainer" containerID="468034f0f3131187ec1f007c6a666483553e7a44f26bf991edb4d11b1975d1f4"
May 21 21:24:53.916979 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.916963    2559 scope.go:117] "RemoveContainer" containerID="623a8ac5b5e33a0d44a14f3da2f286ab68dd46211d5a1125de2a82c901465b0d"
May 21 21:24:53.923890 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.923846    2559 scope.go:117] "RemoveContainer" containerID="bb727f749965b6a53a5f7b6b6920fcb4ea94747fb6806bf41b97c5dfe47b8bb7"
May 21 21:24:53.925460 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.925425    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 21:24:53.931160 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.931145    2559 scope.go:117] "RemoveContainer" containerID="585d35527aee6525465c6cac5148b475313d976d686d47d9989997efc353be23"
May 21 21:24:53.936572 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.936552    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 21:24:53.937681 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.937662    2559 scope.go:117] "RemoveContainer" containerID="89800b6201f4e558989fc4a803e5951a33668062d877e3ab819be4770ec660d8"
May 21 21:24:53.937930 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:24:53.937911    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89800b6201f4e558989fc4a803e5951a33668062d877e3ab819be4770ec660d8\": container with ID starting with 89800b6201f4e558989fc4a803e5951a33668062d877e3ab819be4770ec660d8 not found: ID does not exist" containerID="89800b6201f4e558989fc4a803e5951a33668062d877e3ab819be4770ec660d8"
May 21 21:24:53.937989 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.937937    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89800b6201f4e558989fc4a803e5951a33668062d877e3ab819be4770ec660d8"} err="failed to get container status \"89800b6201f4e558989fc4a803e5951a33668062d877e3ab819be4770ec660d8\": rpc error: code = NotFound desc = could not find container \"89800b6201f4e558989fc4a803e5951a33668062d877e3ab819be4770ec660d8\": container with ID starting with 89800b6201f4e558989fc4a803e5951a33668062d877e3ab819be4770ec660d8 not found: ID does not exist"
May 21 21:24:53.937989 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.937976    2559 scope.go:117] "RemoveContainer" containerID="68401e3d7e709fcf9a371e780cc0c8f3ca971e704e94b70ccecb823e0ef21951"
May 21 21:24:53.938207 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:24:53.938192    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68401e3d7e709fcf9a371e780cc0c8f3ca971e704e94b70ccecb823e0ef21951\": container with ID starting with 68401e3d7e709fcf9a371e780cc0c8f3ca971e704e94b70ccecb823e0ef21951 not found: ID does not exist" containerID="68401e3d7e709fcf9a371e780cc0c8f3ca971e704e94b70ccecb823e0ef21951"
May 21 21:24:53.938267 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.938211    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68401e3d7e709fcf9a371e780cc0c8f3ca971e704e94b70ccecb823e0ef21951"} err="failed to get container status \"68401e3d7e709fcf9a371e780cc0c8f3ca971e704e94b70ccecb823e0ef21951\": rpc error: code = NotFound desc = could not find container \"68401e3d7e709fcf9a371e780cc0c8f3ca971e704e94b70ccecb823e0ef21951\": container with ID starting with 68401e3d7e709fcf9a371e780cc0c8f3ca971e704e94b70ccecb823e0ef21951 not found: ID does not exist"
May 21 21:24:53.938267 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.938224    2559 scope.go:117] "RemoveContainer" containerID="cb0727380642cfa73d53b09ec36c0a7188e66ee79de827bcec32a56aaf469023"
May 21 21:24:53.938473 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:24:53.938456    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb0727380642cfa73d53b09ec36c0a7188e66ee79de827bcec32a56aaf469023\": container with ID starting with cb0727380642cfa73d53b09ec36c0a7188e66ee79de827bcec32a56aaf469023 not found: ID does not exist" containerID="cb0727380642cfa73d53b09ec36c0a7188e66ee79de827bcec32a56aaf469023"
May 21 21:24:53.938519 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.938478    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0727380642cfa73d53b09ec36c0a7188e66ee79de827bcec32a56aaf469023"} err="failed to get container status \"cb0727380642cfa73d53b09ec36c0a7188e66ee79de827bcec32a56aaf469023\": rpc error: code = NotFound desc = could not find container \"cb0727380642cfa73d53b09ec36c0a7188e66ee79de827bcec32a56aaf469023\": container with ID starting with cb0727380642cfa73d53b09ec36c0a7188e66ee79de827bcec32a56aaf469023 not found: ID does not exist"
May 21 21:24:53.938519 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.938501    2559 scope.go:117] "RemoveContainer" containerID="468034f0f3131187ec1f007c6a666483553e7a44f26bf991edb4d11b1975d1f4"
May 21 21:24:53.938758 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:24:53.938743    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"468034f0f3131187ec1f007c6a666483553e7a44f26bf991edb4d11b1975d1f4\": container with ID starting with 468034f0f3131187ec1f007c6a666483553e7a44f26bf991edb4d11b1975d1f4 not found: ID does not exist" containerID="468034f0f3131187ec1f007c6a666483553e7a44f26bf991edb4d11b1975d1f4"
May 21 21:24:53.938831 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.938761    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"468034f0f3131187ec1f007c6a666483553e7a44f26bf991edb4d11b1975d1f4"} err="failed to get container status \"468034f0f3131187ec1f007c6a666483553e7a44f26bf991edb4d11b1975d1f4\": rpc error: code = NotFound desc = could not find container \"468034f0f3131187ec1f007c6a666483553e7a44f26bf991edb4d11b1975d1f4\": container with ID starting with 468034f0f3131187ec1f007c6a666483553e7a44f26bf991edb4d11b1975d1f4 not found: ID does not exist"
May 21 21:24:53.938831 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.938773    2559 scope.go:117] "RemoveContainer" containerID="623a8ac5b5e33a0d44a14f3da2f286ab68dd46211d5a1125de2a82c901465b0d"
May 21 21:24:53.938997 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:24:53.938981    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"623a8ac5b5e33a0d44a14f3da2f286ab68dd46211d5a1125de2a82c901465b0d\": container with ID starting with 623a8ac5b5e33a0d44a14f3da2f286ab68dd46211d5a1125de2a82c901465b0d not found: ID does not exist" containerID="623a8ac5b5e33a0d44a14f3da2f286ab68dd46211d5a1125de2a82c901465b0d"
May 21 21:24:53.939034 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.939005    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"623a8ac5b5e33a0d44a14f3da2f286ab68dd46211d5a1125de2a82c901465b0d"} err="failed to get container status \"623a8ac5b5e33a0d44a14f3da2f286ab68dd46211d5a1125de2a82c901465b0d\": rpc error: code = NotFound desc = could not find container \"623a8ac5b5e33a0d44a14f3da2f286ab68dd46211d5a1125de2a82c901465b0d\": container with ID starting with 623a8ac5b5e33a0d44a14f3da2f286ab68dd46211d5a1125de2a82c901465b0d not found: ID does not exist"
May 21 21:24:53.939034 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.939020    2559 scope.go:117] "RemoveContainer" containerID="bb727f749965b6a53a5f7b6b6920fcb4ea94747fb6806bf41b97c5dfe47b8bb7"
May 21 21:24:53.939241 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:24:53.939224    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb727f749965b6a53a5f7b6b6920fcb4ea94747fb6806bf41b97c5dfe47b8bb7\": container with ID starting with bb727f749965b6a53a5f7b6b6920fcb4ea94747fb6806bf41b97c5dfe47b8bb7 not found: ID does not exist" containerID="bb727f749965b6a53a5f7b6b6920fcb4ea94747fb6806bf41b97c5dfe47b8bb7"
May 21 21:24:53.939306 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.939247    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb727f749965b6a53a5f7b6b6920fcb4ea94747fb6806bf41b97c5dfe47b8bb7"} err="failed to get container status \"bb727f749965b6a53a5f7b6b6920fcb4ea94747fb6806bf41b97c5dfe47b8bb7\": rpc error: code = NotFound desc = could not find container \"bb727f749965b6a53a5f7b6b6920fcb4ea94747fb6806bf41b97c5dfe47b8bb7\": container with ID starting with bb727f749965b6a53a5f7b6b6920fcb4ea94747fb6806bf41b97c5dfe47b8bb7 not found: ID does not exist"
May 21 21:24:53.939306 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.939262    2559 scope.go:117] "RemoveContainer" containerID="585d35527aee6525465c6cac5148b475313d976d686d47d9989997efc353be23"
May 21 21:24:53.939470 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:24:53.939451    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"585d35527aee6525465c6cac5148b475313d976d686d47d9989997efc353be23\": container with ID starting with 585d35527aee6525465c6cac5148b475313d976d686d47d9989997efc353be23 not found: ID does not exist" containerID="585d35527aee6525465c6cac5148b475313d976d686d47d9989997efc353be23"
May 21 21:24:53.939511 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.939475    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"585d35527aee6525465c6cac5148b475313d976d686d47d9989997efc353be23"} err="failed to get container status \"585d35527aee6525465c6cac5148b475313d976d686d47d9989997efc353be23\": rpc error: code = NotFound desc = could not find container \"585d35527aee6525465c6cac5148b475313d976d686d47d9989997efc353be23\": container with ID starting with 585d35527aee6525465c6cac5148b475313d976d686d47d9989997efc353be23 not found: ID does not exist"
May 21 21:24:53.991837 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.991809    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 21:24:53.992124 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.992111    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="prom-label-proxy"
May 21 21:24:53.992169 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.992127    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="prom-label-proxy"
May 21 21:24:53.992169 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.992136    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="kube-rbac-proxy-web"
May 21 21:24:53.992169 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.992142    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="kube-rbac-proxy-web"
May 21 21:24:53.992169 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.992149    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="kube-rbac-proxy"
May 21 21:24:53.992169 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.992155    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="kube-rbac-proxy"
May 21 21:24:53.992169 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.992167    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="init-config-reloader"
May 21 21:24:53.992360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.992173    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="init-config-reloader"
May 21 21:24:53.992360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.992180    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="config-reloader"
May 21 21:24:53.992360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.992198    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="config-reloader"
May 21 21:24:53.992360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.992205    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="alertmanager"
May 21 21:24:53.992360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.992211    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="alertmanager"
May 21 21:24:53.992360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.992216    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="kube-rbac-proxy-metric"
May 21 21:24:53.992360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.992222    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="kube-rbac-proxy-metric"
May 21 21:24:53.992360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.992272    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="config-reloader"
May 21 21:24:53.992360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.992280    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="prom-label-proxy"
May 21 21:24:53.992360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.992285    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="alertmanager"
May 21 21:24:53.992360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.992294    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="kube-rbac-proxy"
May 21 21:24:53.992360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.992300    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="kube-rbac-proxy-web"
May 21 21:24:53.992360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.992307    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" containerName="kube-rbac-proxy-metric"
May 21 21:24:53.995509 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:53.995494    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.001529 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.001505    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 21 21:24:54.001874 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.001815    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 21 21:24:54.001874 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.001835    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 21 21:24:54.001874 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.001853    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 21 21:24:54.002430 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.002412    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 21 21:24:54.002697 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.002673    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 21 21:24:54.002697 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.002681    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-b29nx\""
May 21 21:24:54.002697 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.002694    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 21 21:24:54.006845 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.006828    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 21 21:24:54.011118 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.011103    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 21 21:24:54.041569 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.041546    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 21:24:54.054264 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.054236    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-config-volume\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.054359 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.054284    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.054359 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.054307    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.054359 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.054342    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b0ca7db-e160-4c29-91b4-315a84f1d476-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.054460 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.054371    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b0ca7db-e160-4c29-91b4-315a84f1d476-config-out\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.054460 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.054387    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5b0ca7db-e160-4c29-91b4-315a84f1d476-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.054520 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.054467    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-web-config\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.054520 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.054510    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.054581 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.054555    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b0ca7db-e160-4c29-91b4-315a84f1d476-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.054631 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.054578    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt9zv\" (UniqueName: \"kubernetes.io/projected/5b0ca7db-e160-4c29-91b4-315a84f1d476-kube-api-access-vt9zv\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.054671 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.054646    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b0ca7db-e160-4c29-91b4-315a84f1d476-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.054671 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.054665    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.054738 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.054681    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.155910 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.155826    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b0ca7db-e160-4c29-91b4-315a84f1d476-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.155910 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.155859    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vt9zv\" (UniqueName: \"kubernetes.io/projected/5b0ca7db-e160-4c29-91b4-315a84f1d476-kube-api-access-vt9zv\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.155910 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.155879    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b0ca7db-e160-4c29-91b4-315a84f1d476-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.156173 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.155991    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.156173 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.156026    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.156173 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.156054    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-config-volume\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.156173 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.156076    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.156173 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.156104    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.156173 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.156124    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b0ca7db-e160-4c29-91b4-315a84f1d476-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.156173 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.156151    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b0ca7db-e160-4c29-91b4-315a84f1d476-config-out\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.156502 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.156192    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5b0ca7db-e160-4c29-91b4-315a84f1d476-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.156502 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.156256    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-web-config\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.156502 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.156296    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.157004 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.156973    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b0ca7db-e160-4c29-91b4-315a84f1d476-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.157851 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.157829    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b0ca7db-e160-4c29-91b4-315a84f1d476-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.158924 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.158893    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b0ca7db-e160-4c29-91b4-315a84f1d476-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.158924 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.158909    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b0ca7db-e160-4c29-91b4-315a84f1d476-config-out\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.159077 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.159010    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-config-volume\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.159077 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.159063    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.159216 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.159196    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.159282 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.159199    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5b0ca7db-e160-4c29-91b4-315a84f1d476-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.159282 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.159225    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.159900 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.159880    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.160245 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.160230    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.160780 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.160765    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b0ca7db-e160-4c29-91b4-315a84f1d476-web-config\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.166489 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.166465    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee786cd1-f54c-436e-b674-41ca0fda5bef" path="/var/lib/kubelet/pods/ee786cd1-f54c-436e-b674-41ca0fda5bef/volumes"
May 21 21:24:54.166583 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.166516    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt9zv\" (UniqueName: \"kubernetes.io/projected/5b0ca7db-e160-4c29-91b4-315a84f1d476-kube-api-access-vt9zv\") pod \"alertmanager-main-0\" (UID: \"5b0ca7db-e160-4c29-91b4-315a84f1d476\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.305022 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.304986    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 21:24:54.470901 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.470876    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 21:24:54.472568 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:24:54.472543    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b0ca7db_e160_4c29_91b4_315a84f1d476.slice/crio-c6eafb3b69b5232421d6e39af7e3b5595edfae17f55af58a18ea00210ce1e5dd WatchSource:0}: Error finding container c6eafb3b69b5232421d6e39af7e3b5595edfae17f55af58a18ea00210ce1e5dd: Status 404 returned error can't find the container with id c6eafb3b69b5232421d6e39af7e3b5595edfae17f55af58a18ea00210ce1e5dd
May 21 21:24:54.898543 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.898510    2559 generic.go:358] "Generic (PLEG): container finished" podID="5b0ca7db-e160-4c29-91b4-315a84f1d476" containerID="dc7046332881614511b1df405a3dbd5877f1d1dc306862125f0c63bb88b4bb50" exitCode=0
May 21 21:24:54.898943 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.898548    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b0ca7db-e160-4c29-91b4-315a84f1d476","Type":"ContainerDied","Data":"dc7046332881614511b1df405a3dbd5877f1d1dc306862125f0c63bb88b4bb50"}
May 21 21:24:54.898943 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:54.898568    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b0ca7db-e160-4c29-91b4-315a84f1d476","Type":"ContainerStarted","Data":"c6eafb3b69b5232421d6e39af7e3b5595edfae17f55af58a18ea00210ce1e5dd"}
May 21 21:24:55.904505 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:55.904469    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b0ca7db-e160-4c29-91b4-315a84f1d476","Type":"ContainerStarted","Data":"dad7d893fc3f404f020448afb94308621b06d89dac836e3d42b310656ad625cf"}
May 21 21:24:55.904505 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:55.904509    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b0ca7db-e160-4c29-91b4-315a84f1d476","Type":"ContainerStarted","Data":"b5ac529d761faff768ccc9302fcbc9b2a9e3321c7aa5c162caa56b154b3289f4"}
May 21 21:24:55.904993 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:55.904522    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b0ca7db-e160-4c29-91b4-315a84f1d476","Type":"ContainerStarted","Data":"1602ace9551d5e43c8bcae066cd52762c3fdb17c48f1c47f43c41f7c888b7cbe"}
May 21 21:24:55.904993 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:55.904534    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b0ca7db-e160-4c29-91b4-315a84f1d476","Type":"ContainerStarted","Data":"724f33f9582b9dac28bda61026f06b9cb45ed0477c551aaea4893aeda865e5fa"}
May 21 21:24:55.904993 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:55.904544    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b0ca7db-e160-4c29-91b4-315a84f1d476","Type":"ContainerStarted","Data":"c2ea20668d4cef40c1a353d30618868251f404e80cc0196da18b316916e2924a"}
May 21 21:24:55.904993 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:55.904555    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b0ca7db-e160-4c29-91b4-315a84f1d476","Type":"ContainerStarted","Data":"02b6f03dc03fc2315941e8eb6b6f1c9d1949bf15b6a7a9d72db53ebf7fd34d4f"}
May 21 21:24:55.961737 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:24:55.961685    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.961664174 podStartE2EDuration="2.961664174s" podCreationTimestamp="2026-05-21 21:24:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:24:55.959153399 +0000 UTC m=+208.392164893" watchObservedRunningTime="2026-05-21 21:24:55.961664174 +0000 UTC m=+208.394675670"
May 21 21:25:25.398290 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:25:25.398256    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-h7cgl"]
May 21 21:25:25.400476 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:25:25.400460    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7cgl"
May 21 21:25:25.404769 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:25:25.404746    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 21:25:25.423538 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:25:25.423512    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h7cgl"]
May 21 21:25:25.524991 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:25:25.524958    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4285aeb8-6c9f-42ea-b53b-036cd8edb18d-dbus\") pod \"global-pull-secret-syncer-h7cgl\" (UID: \"4285aeb8-6c9f-42ea-b53b-036cd8edb18d\") " pod="kube-system/global-pull-secret-syncer-h7cgl"
May 21 21:25:25.524991 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:25:25.524994    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4285aeb8-6c9f-42ea-b53b-036cd8edb18d-kubelet-config\") pod \"global-pull-secret-syncer-h7cgl\" (UID: \"4285aeb8-6c9f-42ea-b53b-036cd8edb18d\") " pod="kube-system/global-pull-secret-syncer-h7cgl"
May 21 21:25:25.525232 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:25:25.525127    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4285aeb8-6c9f-42ea-b53b-036cd8edb18d-original-pull-secret\") pod \"global-pull-secret-syncer-h7cgl\" (UID: \"4285aeb8-6c9f-42ea-b53b-036cd8edb18d\") " pod="kube-system/global-pull-secret-syncer-h7cgl"
May 21 21:25:25.625955 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:25:25.625928    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4285aeb8-6c9f-42ea-b53b-036cd8edb18d-original-pull-secret\") pod \"global-pull-secret-syncer-h7cgl\" (UID: \"4285aeb8-6c9f-42ea-b53b-036cd8edb18d\") " pod="kube-system/global-pull-secret-syncer-h7cgl"
May 21 21:25:25.626135 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:25:25.625970    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4285aeb8-6c9f-42ea-b53b-036cd8edb18d-dbus\") pod \"global-pull-secret-syncer-h7cgl\" (UID: \"4285aeb8-6c9f-42ea-b53b-036cd8edb18d\") " pod="kube-system/global-pull-secret-syncer-h7cgl"
May 21 21:25:25.626135 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:25:25.625992    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4285aeb8-6c9f-42ea-b53b-036cd8edb18d-kubelet-config\") pod \"global-pull-secret-syncer-h7cgl\" (UID: \"4285aeb8-6c9f-42ea-b53b-036cd8edb18d\") " pod="kube-system/global-pull-secret-syncer-h7cgl"
May 21 21:25:25.626135 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:25:25.626102    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4285aeb8-6c9f-42ea-b53b-036cd8edb18d-kubelet-config\") pod \"global-pull-secret-syncer-h7cgl\" (UID: \"4285aeb8-6c9f-42ea-b53b-036cd8edb18d\") " pod="kube-system/global-pull-secret-syncer-h7cgl"
May 21 21:25:25.626290 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:25:25.626129    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4285aeb8-6c9f-42ea-b53b-036cd8edb18d-dbus\") pod \"global-pull-secret-syncer-h7cgl\" (UID: \"4285aeb8-6c9f-42ea-b53b-036cd8edb18d\") " pod="kube-system/global-pull-secret-syncer-h7cgl"
May 21 21:25:25.628314 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:25:25.628292    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4285aeb8-6c9f-42ea-b53b-036cd8edb18d-original-pull-secret\") pod \"global-pull-secret-syncer-h7cgl\" (UID: \"4285aeb8-6c9f-42ea-b53b-036cd8edb18d\") " pod="kube-system/global-pull-secret-syncer-h7cgl"
May 21 21:25:25.710262 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:25:25.710191    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7cgl"
May 21 21:25:25.837042 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:25:25.837009    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h7cgl"]
May 21 21:25:25.840086 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:25:25.840058    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4285aeb8_6c9f_42ea_b53b_036cd8edb18d.slice/crio-f7740557b99a0cc014bcf69f5b8a3ff95389d98be1ec184d29b066ea5e3e55bd WatchSource:0}: Error finding container f7740557b99a0cc014bcf69f5b8a3ff95389d98be1ec184d29b066ea5e3e55bd: Status 404 returned error can't find the container with id f7740557b99a0cc014bcf69f5b8a3ff95389d98be1ec184d29b066ea5e3e55bd
May 21 21:25:25.996207 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:25:25.996129    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h7cgl" event={"ID":"4285aeb8-6c9f-42ea-b53b-036cd8edb18d","Type":"ContainerStarted","Data":"f7740557b99a0cc014bcf69f5b8a3ff95389d98be1ec184d29b066ea5e3e55bd"}
May 21 21:25:30.010598 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:25:30.010504    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h7cgl" event={"ID":"4285aeb8-6c9f-42ea-b53b-036cd8edb18d","Type":"ContainerStarted","Data":"6c79a788ad0e020c37102735d1d3fd9421f221671183f0af57564d7c0aaa3acd"}
May 21 21:25:30.032564 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:25:30.032519    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-h7cgl" podStartSLOduration=1.231248364 podStartE2EDuration="5.032504436s" podCreationTimestamp="2026-05-21 21:25:25 +0000 UTC" firstStartedPulling="2026-05-21 21:25:25.841703836 +0000 UTC m=+238.274715312" lastFinishedPulling="2026-05-21 21:25:29.642959909 +0000 UTC m=+242.075971384" observedRunningTime="2026-05-21 21:25:30.031306133 +0000 UTC m=+242.464317639" watchObservedRunningTime="2026-05-21 21:25:30.032504436 +0000 UTC m=+242.465515932"
May 21 21:25:36.678613 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:25:36.678566    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fc7cf6cf4-2jg4b"]
May 21 21:26:01.697548 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:01.697492    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-fc7cf6cf4-2jg4b" podUID="20ba4adc-02ee-4e94-bda8-452e1727b6a5" containerName="console" containerID="cri-o://8fbf50a0eba38e7aa1e432edbf5a649c6a423fe6565623c5658a526a94ac2296" gracePeriod=15
May 21 21:26:01.762116 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:01.762078    2559 patch_prober.go:28] interesting pod/console-fc7cf6cf4-2jg4b container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body=
May 21 21:26:01.762291 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:01.762158    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-fc7cf6cf4-2jg4b" podUID="20ba4adc-02ee-4e94-bda8-452e1727b6a5" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused"
May 21 21:26:01.936090 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:01.936064    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-fc7cf6cf4-2jg4b_20ba4adc-02ee-4e94-bda8-452e1727b6a5/console/0.log"
May 21 21:26:01.936224 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:01.936123    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:26:02.032868 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.032775    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20ba4adc-02ee-4e94-bda8-452e1727b6a5-console-serving-cert\") pod \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") "
May 21 21:26:02.032868 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.032817    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jc267\" (UniqueName: \"kubernetes.io/projected/20ba4adc-02ee-4e94-bda8-452e1727b6a5-kube-api-access-jc267\") pod \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") "
May 21 21:26:02.032868 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.032851    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-oauth-serving-cert\") pod \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") "
May 21 21:26:02.033131 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.032875    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-trusted-ca-bundle\") pod \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") "
May 21 21:26:02.033131 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.032916    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20ba4adc-02ee-4e94-bda8-452e1727b6a5-console-oauth-config\") pod \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") "
May 21 21:26:02.033131 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.032951    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-service-ca\") pod \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") "
May 21 21:26:02.033131 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.033001    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-console-config\") pod \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\" (UID: \"20ba4adc-02ee-4e94-bda8-452e1727b6a5\") "
May 21 21:26:02.033367 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.033332    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "20ba4adc-02ee-4e94-bda8-452e1727b6a5" (UID: "20ba4adc-02ee-4e94-bda8-452e1727b6a5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 21:26:02.033512 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.033387    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "20ba4adc-02ee-4e94-bda8-452e1727b6a5" (UID: "20ba4adc-02ee-4e94-bda8-452e1727b6a5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 21:26:02.033616 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.033488    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-service-ca" (OuterVolumeSpecName: "service-ca") pod "20ba4adc-02ee-4e94-bda8-452e1727b6a5" (UID: "20ba4adc-02ee-4e94-bda8-452e1727b6a5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 21:26:02.033616 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.033574    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-console-config" (OuterVolumeSpecName: "console-config") pod "20ba4adc-02ee-4e94-bda8-452e1727b6a5" (UID: "20ba4adc-02ee-4e94-bda8-452e1727b6a5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 21:26:02.035296 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.035274    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20ba4adc-02ee-4e94-bda8-452e1727b6a5-kube-api-access-jc267" (OuterVolumeSpecName: "kube-api-access-jc267") pod "20ba4adc-02ee-4e94-bda8-452e1727b6a5" (UID: "20ba4adc-02ee-4e94-bda8-452e1727b6a5"). InnerVolumeSpecName "kube-api-access-jc267". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:26:02.035533 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.035513    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20ba4adc-02ee-4e94-bda8-452e1727b6a5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "20ba4adc-02ee-4e94-bda8-452e1727b6a5" (UID: "20ba4adc-02ee-4e94-bda8-452e1727b6a5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 21:26:02.035661 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.035616    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20ba4adc-02ee-4e94-bda8-452e1727b6a5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "20ba4adc-02ee-4e94-bda8-452e1727b6a5" (UID: "20ba4adc-02ee-4e94-bda8-452e1727b6a5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 21:26:02.105785 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.105759    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-fc7cf6cf4-2jg4b_20ba4adc-02ee-4e94-bda8-452e1727b6a5/console/0.log"
May 21 21:26:02.105975 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.105797    2559 generic.go:358] "Generic (PLEG): container finished" podID="20ba4adc-02ee-4e94-bda8-452e1727b6a5" containerID="8fbf50a0eba38e7aa1e432edbf5a649c6a423fe6565623c5658a526a94ac2296" exitCode=2
May 21 21:26:02.105975 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.105830    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc7cf6cf4-2jg4b" event={"ID":"20ba4adc-02ee-4e94-bda8-452e1727b6a5","Type":"ContainerDied","Data":"8fbf50a0eba38e7aa1e432edbf5a649c6a423fe6565623c5658a526a94ac2296"}
May 21 21:26:02.105975 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.105852    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc7cf6cf4-2jg4b" event={"ID":"20ba4adc-02ee-4e94-bda8-452e1727b6a5","Type":"ContainerDied","Data":"6d2c0d350a051ff0d68a6d4c71ab41fdb48e9366ee97345b659fedcaba213a0a"}
May 21 21:26:02.105975 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.105867    2559 scope.go:117] "RemoveContainer" containerID="8fbf50a0eba38e7aa1e432edbf5a649c6a423fe6565623c5658a526a94ac2296"
May 21 21:26:02.105975 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.105878    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc7cf6cf4-2jg4b"
May 21 21:26:02.114213 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.114194    2559 scope.go:117] "RemoveContainer" containerID="8fbf50a0eba38e7aa1e432edbf5a649c6a423fe6565623c5658a526a94ac2296"
May 21 21:26:02.114499 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:26:02.114478    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fbf50a0eba38e7aa1e432edbf5a649c6a423fe6565623c5658a526a94ac2296\": container with ID starting with 8fbf50a0eba38e7aa1e432edbf5a649c6a423fe6565623c5658a526a94ac2296 not found: ID does not exist" containerID="8fbf50a0eba38e7aa1e432edbf5a649c6a423fe6565623c5658a526a94ac2296"
May 21 21:26:02.114554 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.114515    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fbf50a0eba38e7aa1e432edbf5a649c6a423fe6565623c5658a526a94ac2296"} err="failed to get container status \"8fbf50a0eba38e7aa1e432edbf5a649c6a423fe6565623c5658a526a94ac2296\": rpc error: code = NotFound desc = could not find container \"8fbf50a0eba38e7aa1e432edbf5a649c6a423fe6565623c5658a526a94ac2296\": container with ID starting with 8fbf50a0eba38e7aa1e432edbf5a649c6a423fe6565623c5658a526a94ac2296 not found: ID does not exist"
May 21 21:26:02.133956 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.133932    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20ba4adc-02ee-4e94-bda8-452e1727b6a5-console-oauth-config\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:26:02.133956 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.133956    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-service-ca\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:26:02.134118 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.133968    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-console-config\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:26:02.134118 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.133981    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20ba4adc-02ee-4e94-bda8-452e1727b6a5-console-serving-cert\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:26:02.134118 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.133994    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jc267\" (UniqueName: \"kubernetes.io/projected/20ba4adc-02ee-4e94-bda8-452e1727b6a5-kube-api-access-jc267\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:26:02.134118 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.134008    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-oauth-serving-cert\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:26:02.134118 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.134022    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20ba4adc-02ee-4e94-bda8-452e1727b6a5-trusted-ca-bundle\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:26:02.138202 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.138179    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fc7cf6cf4-2jg4b"]
May 21 21:26:02.149842 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.149821    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fc7cf6cf4-2jg4b"]
May 21 21:26:02.170999 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:02.170972    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20ba4adc-02ee-4e94-bda8-452e1727b6a5" path="/var/lib/kubelet/pods/20ba4adc-02ee-4e94-bda8-452e1727b6a5/volumes"
May 21 21:26:11.572647 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:11.572612    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-phpfl"]
May 21 21:26:11.573097 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:11.572921    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20ba4adc-02ee-4e94-bda8-452e1727b6a5" containerName="console"
May 21 21:26:11.573097 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:11.572932    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="20ba4adc-02ee-4e94-bda8-452e1727b6a5" containerName="console"
May 21 21:26:11.573097 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:11.572985    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="20ba4adc-02ee-4e94-bda8-452e1727b6a5" containerName="console"
May 21 21:26:11.574923 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:11.574908    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-phpfl"
May 21 21:26:11.578446 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:11.578414    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 21 21:26:11.578446 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:11.578429    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-tq8fr\""
May 21 21:26:11.579609 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:11.579573    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 21 21:26:11.605651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:11.605624    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-phpfl"]
May 21 21:26:11.715388 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:11.715357    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9acff0e5-5f50-4ebc-9752-f3334f6e1ee9-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-phpfl\" (UID: \"9acff0e5-5f50-4ebc-9752-f3334f6e1ee9\") " pod="cert-manager/cert-manager-webhook-587ccfb98-phpfl"
May 21 21:26:11.715538 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:11.715417    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wtr7\" (UniqueName: \"kubernetes.io/projected/9acff0e5-5f50-4ebc-9752-f3334f6e1ee9-kube-api-access-9wtr7\") pod \"cert-manager-webhook-587ccfb98-phpfl\" (UID: \"9acff0e5-5f50-4ebc-9752-f3334f6e1ee9\") " pod="cert-manager/cert-manager-webhook-587ccfb98-phpfl"
May 21 21:26:11.816805 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:11.816744    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9acff0e5-5f50-4ebc-9752-f3334f6e1ee9-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-phpfl\" (UID: \"9acff0e5-5f50-4ebc-9752-f3334f6e1ee9\") " pod="cert-manager/cert-manager-webhook-587ccfb98-phpfl"
May 21 21:26:11.816961 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:11.816869    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9wtr7\" (UniqueName: \"kubernetes.io/projected/9acff0e5-5f50-4ebc-9752-f3334f6e1ee9-kube-api-access-9wtr7\") pod \"cert-manager-webhook-587ccfb98-phpfl\" (UID: \"9acff0e5-5f50-4ebc-9752-f3334f6e1ee9\") " pod="cert-manager/cert-manager-webhook-587ccfb98-phpfl"
May 21 21:26:11.873165 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:11.873095    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9acff0e5-5f50-4ebc-9752-f3334f6e1ee9-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-phpfl\" (UID: \"9acff0e5-5f50-4ebc-9752-f3334f6e1ee9\") " pod="cert-manager/cert-manager-webhook-587ccfb98-phpfl"
May 21 21:26:11.873282 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:11.873213    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wtr7\" (UniqueName: \"kubernetes.io/projected/9acff0e5-5f50-4ebc-9752-f3334f6e1ee9-kube-api-access-9wtr7\") pod \"cert-manager-webhook-587ccfb98-phpfl\" (UID: \"9acff0e5-5f50-4ebc-9752-f3334f6e1ee9\") " pod="cert-manager/cert-manager-webhook-587ccfb98-phpfl"
May 21 21:26:11.895946 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:11.895920    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-phpfl"
May 21 21:26:12.072493 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:26:12.072455    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9acff0e5_5f50_4ebc_9752_f3334f6e1ee9.slice/crio-91f1631020c3bfcbb8df35b4cc49a011942a9066abc4f52e552cd9da4b543770 WatchSource:0}: Error finding container 91f1631020c3bfcbb8df35b4cc49a011942a9066abc4f52e552cd9da4b543770: Status 404 returned error can't find the container with id 91f1631020c3bfcbb8df35b4cc49a011942a9066abc4f52e552cd9da4b543770
May 21 21:26:12.085533 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:12.085507    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-phpfl"]
May 21 21:26:12.134320 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:12.134252    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-phpfl" event={"ID":"9acff0e5-5f50-4ebc-9752-f3334f6e1ee9","Type":"ContainerStarted","Data":"91f1631020c3bfcbb8df35b4cc49a011942a9066abc4f52e552cd9da4b543770"}
May 21 21:26:16.148760 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:16.148723    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-phpfl" event={"ID":"9acff0e5-5f50-4ebc-9752-f3334f6e1ee9","Type":"ContainerStarted","Data":"1dc6b5e0bb9f1895c249b4059299dab2e2cc05278378348e08b89409246f6cf7"}
May 21 21:26:16.149139 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:16.148832    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-phpfl"
May 21 21:26:16.184758 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:16.184707    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-phpfl" podStartSLOduration=2.079372015 podStartE2EDuration="5.184695533s" podCreationTimestamp="2026-05-21 21:26:11 +0000 UTC" firstStartedPulling="2026-05-21 21:26:12.074247105 +0000 UTC m=+284.507258579" lastFinishedPulling="2026-05-21 21:26:15.179570624 +0000 UTC m=+287.612582097" observedRunningTime="2026-05-21 21:26:16.183431648 +0000 UTC m=+288.616443140" watchObservedRunningTime="2026-05-21 21:26:16.184695533 +0000 UTC m=+288.617707027"
May 21 21:26:21.139995 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:21.139952    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-6lzqt"]
May 21 21:26:21.143650 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:21.143626    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-6lzqt"
May 21 21:26:21.154093 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:21.154075    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ln2dk\""
May 21 21:26:21.184418 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:21.184389    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-6lzqt"]
May 21 21:26:21.295292 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:21.295268    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/192b418e-1a65-4af0-9240-52d4629bbc10-bound-sa-token\") pod \"cert-manager-79c8d999ff-6lzqt\" (UID: \"192b418e-1a65-4af0-9240-52d4629bbc10\") " pod="cert-manager/cert-manager-79c8d999ff-6lzqt"
May 21 21:26:21.295439 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:21.295315    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8t7d\" (UniqueName: \"kubernetes.io/projected/192b418e-1a65-4af0-9240-52d4629bbc10-kube-api-access-j8t7d\") pod \"cert-manager-79c8d999ff-6lzqt\" (UID: \"192b418e-1a65-4af0-9240-52d4629bbc10\") " pod="cert-manager/cert-manager-79c8d999ff-6lzqt"
May 21 21:26:21.396296 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:21.396213    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/192b418e-1a65-4af0-9240-52d4629bbc10-bound-sa-token\") pod \"cert-manager-79c8d999ff-6lzqt\" (UID: \"192b418e-1a65-4af0-9240-52d4629bbc10\") " pod="cert-manager/cert-manager-79c8d999ff-6lzqt"
May 21 21:26:21.396296 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:21.396264    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j8t7d\" (UniqueName: \"kubernetes.io/projected/192b418e-1a65-4af0-9240-52d4629bbc10-kube-api-access-j8t7d\") pod \"cert-manager-79c8d999ff-6lzqt\" (UID: \"192b418e-1a65-4af0-9240-52d4629bbc10\") " pod="cert-manager/cert-manager-79c8d999ff-6lzqt"
May 21 21:26:21.412392 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:21.412356    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/192b418e-1a65-4af0-9240-52d4629bbc10-bound-sa-token\") pod \"cert-manager-79c8d999ff-6lzqt\" (UID: \"192b418e-1a65-4af0-9240-52d4629bbc10\") " pod="cert-manager/cert-manager-79c8d999ff-6lzqt"
May 21 21:26:21.412392 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:21.412389    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8t7d\" (UniqueName: \"kubernetes.io/projected/192b418e-1a65-4af0-9240-52d4629bbc10-kube-api-access-j8t7d\") pod \"cert-manager-79c8d999ff-6lzqt\" (UID: \"192b418e-1a65-4af0-9240-52d4629bbc10\") " pod="cert-manager/cert-manager-79c8d999ff-6lzqt"
May 21 21:26:21.452199 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:21.452176    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-6lzqt"
May 21 21:26:21.593545 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:21.593514    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-6lzqt"]
May 21 21:26:21.596510 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:26:21.596470    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod192b418e_1a65_4af0_9240_52d4629bbc10.slice/crio-9c1ab4691ba2a6efbcea0cdc8cc3097ca19e0b2d684773da936ebc9cc5a7755b WatchSource:0}: Error finding container 9c1ab4691ba2a6efbcea0cdc8cc3097ca19e0b2d684773da936ebc9cc5a7755b: Status 404 returned error can't find the container with id 9c1ab4691ba2a6efbcea0cdc8cc3097ca19e0b2d684773da936ebc9cc5a7755b
May 21 21:26:22.154935 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:22.154010    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-phpfl"
May 21 21:26:22.167295 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:22.167257    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-6lzqt" event={"ID":"192b418e-1a65-4af0-9240-52d4629bbc10","Type":"ContainerStarted","Data":"30ee606f30d981066f8db362c424df1df5f181a750c6f468dab036be2e345812"}
May 21 21:26:22.167295 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:22.167286    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-6lzqt" event={"ID":"192b418e-1a65-4af0-9240-52d4629bbc10","Type":"ContainerStarted","Data":"9c1ab4691ba2a6efbcea0cdc8cc3097ca19e0b2d684773da936ebc9cc5a7755b"}
May 21 21:26:22.208662 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:22.208619    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-6lzqt" podStartSLOduration=1.208581741 podStartE2EDuration="1.208581741s" podCreationTimestamp="2026-05-21 21:26:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:26:22.207935937 +0000 UTC m=+294.640947446" watchObservedRunningTime="2026-05-21 21:26:22.208581741 +0000 UTC m=+294.641593236"
May 21 21:26:28.055922 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:28.055903    2559 kubelet.go:1628] "Image garbage collection succeeded"
May 21 21:26:48.298919 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:48.298883    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79646d69f8-xtrvd"]
May 21 21:26:48.302644 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:48.302629    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-xtrvd"
May 21 21:26:48.309385 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:48.309361    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 21 21:26:48.309510 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:48.309407    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 21 21:26:48.309817 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:48.309801    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 21 21:26:48.309911 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:48.309896    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 21 21:26:48.309954 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:48.309907    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2wqfn\""
May 21 21:26:48.325604 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:48.324814    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79646d69f8-xtrvd"]
May 21 21:26:48.403809 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:48.403776    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jtlk\" (UniqueName: \"kubernetes.io/projected/cb5739e3-e675-4742-998a-7328d2b119bf-kube-api-access-7jtlk\") pod \"opendatahub-operator-controller-manager-79646d69f8-xtrvd\" (UID: \"cb5739e3-e675-4742-998a-7328d2b119bf\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-xtrvd"
May 21 21:26:48.403809 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:48.403815    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb5739e3-e675-4742-998a-7328d2b119bf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79646d69f8-xtrvd\" (UID: \"cb5739e3-e675-4742-998a-7328d2b119bf\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-xtrvd"
May 21 21:26:48.404011 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:48.403840    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb5739e3-e675-4742-998a-7328d2b119bf-webhook-cert\") pod \"opendatahub-operator-controller-manager-79646d69f8-xtrvd\" (UID: \"cb5739e3-e675-4742-998a-7328d2b119bf\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-xtrvd"
May 21 21:26:48.504885 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:48.504843    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7jtlk\" (UniqueName: \"kubernetes.io/projected/cb5739e3-e675-4742-998a-7328d2b119bf-kube-api-access-7jtlk\") pod \"opendatahub-operator-controller-manager-79646d69f8-xtrvd\" (UID: \"cb5739e3-e675-4742-998a-7328d2b119bf\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-xtrvd"
May 21 21:26:48.505081 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:48.504892    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb5739e3-e675-4742-998a-7328d2b119bf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79646d69f8-xtrvd\" (UID: \"cb5739e3-e675-4742-998a-7328d2b119bf\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-xtrvd"
May 21 21:26:48.505081 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:48.504919    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb5739e3-e675-4742-998a-7328d2b119bf-webhook-cert\") pod \"opendatahub-operator-controller-manager-79646d69f8-xtrvd\" (UID: \"cb5739e3-e675-4742-998a-7328d2b119bf\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-xtrvd"
May 21 21:26:48.507375 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:48.507352    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb5739e3-e675-4742-998a-7328d2b119bf-webhook-cert\") pod \"opendatahub-operator-controller-manager-79646d69f8-xtrvd\" (UID: \"cb5739e3-e675-4742-998a-7328d2b119bf\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-xtrvd"
May 21 21:26:48.507470 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:48.507391    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb5739e3-e675-4742-998a-7328d2b119bf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79646d69f8-xtrvd\" (UID: \"cb5739e3-e675-4742-998a-7328d2b119bf\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-xtrvd"
May 21 21:26:48.525242 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:48.525215    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jtlk\" (UniqueName: \"kubernetes.io/projected/cb5739e3-e675-4742-998a-7328d2b119bf-kube-api-access-7jtlk\") pod \"opendatahub-operator-controller-manager-79646d69f8-xtrvd\" (UID: \"cb5739e3-e675-4742-998a-7328d2b119bf\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-xtrvd"
May 21 21:26:48.613042 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:48.612991    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-xtrvd"
May 21 21:26:48.802563 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:26:48.802536    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb5739e3_e675_4742_998a_7328d2b119bf.slice/crio-ac33586def5396788743392d973a798c662f966bd304c183394bf0ff41f4a4c4 WatchSource:0}: Error finding container ac33586def5396788743392d973a798c662f966bd304c183394bf0ff41f4a4c4: Status 404 returned error can't find the container with id ac33586def5396788743392d973a798c662f966bd304c183394bf0ff41f4a4c4
May 21 21:26:48.804203 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:48.804183    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 21:26:48.827217 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:48.827190    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79646d69f8-xtrvd"]
May 21 21:26:49.240206 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:49.240168    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-xtrvd" event={"ID":"cb5739e3-e675-4742-998a-7328d2b119bf","Type":"ContainerStarted","Data":"ac33586def5396788743392d973a798c662f966bd304c183394bf0ff41f4a4c4"}
May 21 21:26:52.253517 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.253484    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-xtrvd" event={"ID":"cb5739e3-e675-4742-998a-7328d2b119bf","Type":"ContainerStarted","Data":"9c1586191cd4c46239ecb6f5cb877fc56b02e4986d2ea92d8afd030241132264"}
May 21 21:26:52.253932 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.253614    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-xtrvd"
May 21 21:26:52.349003 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.348954    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-xtrvd" podStartSLOduration=1.798730264 podStartE2EDuration="4.34893234s" podCreationTimestamp="2026-05-21 21:26:48 +0000 UTC" firstStartedPulling="2026-05-21 21:26:48.804347235 +0000 UTC m=+321.237358708" lastFinishedPulling="2026-05-21 21:26:51.354549299 +0000 UTC m=+323.787560784" observedRunningTime="2026-05-21 21:26:52.347682994 +0000 UTC m=+324.780694488" watchObservedRunningTime="2026-05-21 21:26:52.34893234 +0000 UTC m=+324.781943835"
May 21 21:26:52.692066 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.692025    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm"]
May 21 21:26:52.695599 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.695565    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm"
May 21 21:26:52.704790 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.704770    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 21 21:26:52.740932 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.740906    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h7zd\" (UniqueName: \"kubernetes.io/projected/763aec9d-c6f3-46d1-af53-8f3ab126b50f-kube-api-access-9h7zd\") pod \"lws-controller-manager-5c58594cc-pp9wm\" (UID: \"763aec9d-c6f3-46d1-af53-8f3ab126b50f\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm"
May 21 21:26:52.741050 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.740974    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/763aec9d-c6f3-46d1-af53-8f3ab126b50f-cert\") pod \"lws-controller-manager-5c58594cc-pp9wm\" (UID: \"763aec9d-c6f3-46d1-af53-8f3ab126b50f\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm"
May 21 21:26:52.741050 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.740996    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/763aec9d-c6f3-46d1-af53-8f3ab126b50f-manager-config\") pod \"lws-controller-manager-5c58594cc-pp9wm\" (UID: \"763aec9d-c6f3-46d1-af53-8f3ab126b50f\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm"
May 21 21:26:52.741120 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.741051    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/763aec9d-c6f3-46d1-af53-8f3ab126b50f-metrics-cert\") pod \"lws-controller-manager-5c58594cc-pp9wm\" (UID: \"763aec9d-c6f3-46d1-af53-8f3ab126b50f\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm"
May 21 21:26:52.754220 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.754193    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 21 21:26:52.754426 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.754408    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 21 21:26:52.754496 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.754410    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fwvrx\""
May 21 21:26:52.754496 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.754409    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 21 21:26:52.754621 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.754533    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 21 21:26:52.758677 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.758646    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm"]
May 21 21:26:52.841839 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.841809    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/763aec9d-c6f3-46d1-af53-8f3ab126b50f-metrics-cert\") pod \"lws-controller-manager-5c58594cc-pp9wm\" (UID: \"763aec9d-c6f3-46d1-af53-8f3ab126b50f\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm"
May 21 21:26:52.841996 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.841854    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9h7zd\" (UniqueName: \"kubernetes.io/projected/763aec9d-c6f3-46d1-af53-8f3ab126b50f-kube-api-access-9h7zd\") pod \"lws-controller-manager-5c58594cc-pp9wm\" (UID: \"763aec9d-c6f3-46d1-af53-8f3ab126b50f\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm"
May 21 21:26:52.841996 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.841909    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/763aec9d-c6f3-46d1-af53-8f3ab126b50f-cert\") pod \"lws-controller-manager-5c58594cc-pp9wm\" (UID: \"763aec9d-c6f3-46d1-af53-8f3ab126b50f\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm"
May 21 21:26:52.841996 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.841935    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/763aec9d-c6f3-46d1-af53-8f3ab126b50f-manager-config\") pod \"lws-controller-manager-5c58594cc-pp9wm\" (UID: \"763aec9d-c6f3-46d1-af53-8f3ab126b50f\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm"
May 21 21:26:52.842534 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.842511    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/763aec9d-c6f3-46d1-af53-8f3ab126b50f-manager-config\") pod \"lws-controller-manager-5c58594cc-pp9wm\" (UID: \"763aec9d-c6f3-46d1-af53-8f3ab126b50f\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm"
May 21 21:26:52.844263 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.844245    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/763aec9d-c6f3-46d1-af53-8f3ab126b50f-cert\") pod \"lws-controller-manager-5c58594cc-pp9wm\" (UID: \"763aec9d-c6f3-46d1-af53-8f3ab126b50f\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm"
May 21 21:26:52.844355 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.844289    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/763aec9d-c6f3-46d1-af53-8f3ab126b50f-metrics-cert\") pod \"lws-controller-manager-5c58594cc-pp9wm\" (UID: \"763aec9d-c6f3-46d1-af53-8f3ab126b50f\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm"
May 21 21:26:52.885360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:52.885334    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h7zd\" (UniqueName: \"kubernetes.io/projected/763aec9d-c6f3-46d1-af53-8f3ab126b50f-kube-api-access-9h7zd\") pod \"lws-controller-manager-5c58594cc-pp9wm\" (UID: \"763aec9d-c6f3-46d1-af53-8f3ab126b50f\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm"
May 21 21:26:53.005232 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:53.005152    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm"
May 21 21:26:53.153823 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:53.153794    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm"]
May 21 21:26:53.159122 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:26:53.159090    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod763aec9d_c6f3_46d1_af53_8f3ab126b50f.slice/crio-1b3eccf45cafc06f661d87d3f6b5e3c43db1e9d40d77223b3eb54fcd0cfb09d6 WatchSource:0}: Error finding container 1b3eccf45cafc06f661d87d3f6b5e3c43db1e9d40d77223b3eb54fcd0cfb09d6: Status 404 returned error can't find the container with id 1b3eccf45cafc06f661d87d3f6b5e3c43db1e9d40d77223b3eb54fcd0cfb09d6
May 21 21:26:53.258268 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:53.258181    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm" event={"ID":"763aec9d-c6f3-46d1-af53-8f3ab126b50f","Type":"ContainerStarted","Data":"1b3eccf45cafc06f661d87d3f6b5e3c43db1e9d40d77223b3eb54fcd0cfb09d6"}
May 21 21:26:56.270217 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:56.270182    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm" event={"ID":"763aec9d-c6f3-46d1-af53-8f3ab126b50f","Type":"ContainerStarted","Data":"30c55877102b92dc71fecbc3868d7f57c7e396937860b5b0384b80d227a8d364"}
May 21 21:26:56.270656 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:56.270392    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm"
May 21 21:26:56.300691 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:26:56.300639    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm" podStartSLOduration=1.874282969 podStartE2EDuration="4.300623361s" podCreationTimestamp="2026-05-21 21:26:52 +0000 UTC" firstStartedPulling="2026-05-21 21:26:53.160863377 +0000 UTC m=+325.593874850" lastFinishedPulling="2026-05-21 21:26:55.587203766 +0000 UTC m=+328.020215242" observedRunningTime="2026-05-21 21:26:56.300532428 +0000 UTC m=+328.733543924" watchObservedRunningTime="2026-05-21 21:26:56.300623361 +0000 UTC m=+328.733634856"
May 21 21:27:03.261232 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:03.261201    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-xtrvd"
May 21 21:27:07.275390 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:07.275317    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c58594cc-pp9wm"
May 21 21:27:41.398404 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.398374    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"]
May 21 21:27:41.400643 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.400626    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.404661 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.404639    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 21 21:27:41.404782 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.404674    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 21 21:27:41.405165 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.405148    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-nhpkc\""
May 21 21:27:41.405769 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.405750    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 21 21:27:41.430419 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.430392    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"]
May 21 21:27:41.441670 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.441645    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/155d2de4-b654-4274-8ab3-bff34f3e1a8e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.441771 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.441720    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/155d2de4-b654-4274-8ab3-bff34f3e1a8e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.441771 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.441763    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/155d2de4-b654-4274-8ab3-bff34f3e1a8e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.441848 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.441820    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/155d2de4-b654-4274-8ab3-bff34f3e1a8e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.441883 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.441850    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/155d2de4-b654-4274-8ab3-bff34f3e1a8e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.441883 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.441870    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr2j7\" (UniqueName: \"kubernetes.io/projected/155d2de4-b654-4274-8ab3-bff34f3e1a8e-kube-api-access-dr2j7\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.441943 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.441910    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/155d2de4-b654-4274-8ab3-bff34f3e1a8e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.441982 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.441973    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/155d2de4-b654-4274-8ab3-bff34f3e1a8e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.442014 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.441996    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/155d2de4-b654-4274-8ab3-bff34f3e1a8e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.543078 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.543043    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/155d2de4-b654-4274-8ab3-bff34f3e1a8e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.543237 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.543087    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/155d2de4-b654-4274-8ab3-bff34f3e1a8e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.543237 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.543109    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/155d2de4-b654-4274-8ab3-bff34f3e1a8e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.543237 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.543218    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dr2j7\" (UniqueName: \"kubernetes.io/projected/155d2de4-b654-4274-8ab3-bff34f3e1a8e-kube-api-access-dr2j7\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.543359 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.543278    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/155d2de4-b654-4274-8ab3-bff34f3e1a8e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.543359 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.543339    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/155d2de4-b654-4274-8ab3-bff34f3e1a8e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.543460 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.543372    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/155d2de4-b654-4274-8ab3-bff34f3e1a8e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.543460 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.543423    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/155d2de4-b654-4274-8ab3-bff34f3e1a8e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.543559 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.543478    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/155d2de4-b654-4274-8ab3-bff34f3e1a8e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.543559 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.543548    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/155d2de4-b654-4274-8ab3-bff34f3e1a8e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.543701 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.543630    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/155d2de4-b654-4274-8ab3-bff34f3e1a8e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.543883 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.543862    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/155d2de4-b654-4274-8ab3-bff34f3e1a8e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.543964 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.543887    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/155d2de4-b654-4274-8ab3-bff34f3e1a8e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.544019 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.544006    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/155d2de4-b654-4274-8ab3-bff34f3e1a8e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.545697 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.545676    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/155d2de4-b654-4274-8ab3-bff34f3e1a8e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.546168 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.546149    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/155d2de4-b654-4274-8ab3-bff34f3e1a8e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.559231 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.559200    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr2j7\" (UniqueName: \"kubernetes.io/projected/155d2de4-b654-4274-8ab3-bff34f3e1a8e-kube-api-access-dr2j7\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.559886 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.559870    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/155d2de4-b654-4274-8ab3-bff34f3e1a8e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5\" (UID: \"155d2de4-b654-4274-8ab3-bff34f3e1a8e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.711533 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.711450    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:41.858894 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:41.857618    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"]
May 21 21:27:41.860400 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:27:41.860375    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod155d2de4_b654_4274_8ab3_bff34f3e1a8e.slice/crio-40b4e8734398b6184dd403031643dcabb1b59d1f8a8a806337f36e6dc114a3ba WatchSource:0}: Error finding container 40b4e8734398b6184dd403031643dcabb1b59d1f8a8a806337f36e6dc114a3ba: Status 404 returned error can't find the container with id 40b4e8734398b6184dd403031643dcabb1b59d1f8a8a806337f36e6dc114a3ba
May 21 21:27:42.420912 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:42.420870    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5" event={"ID":"155d2de4-b654-4274-8ab3-bff34f3e1a8e","Type":"ContainerStarted","Data":"40b4e8734398b6184dd403031643dcabb1b59d1f8a8a806337f36e6dc114a3ba"}
May 21 21:27:44.350023 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:44.349983    2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
May 21 21:27:44.350379 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:44.350079    2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
May 21 21:27:44.350379 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:44.350121    2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
May 21 21:27:44.428652 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:44.428621    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5" event={"ID":"155d2de4-b654-4274-8ab3-bff34f3e1a8e","Type":"ContainerStarted","Data":"c32977de04e5213c250732b4368ef429c9d6f569741ad5a71a0967c9f6891087"}
May 21 21:27:44.506032 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:44.505972    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5" podStartSLOduration=1.018411488 podStartE2EDuration="3.505954536s" podCreationTimestamp="2026-05-21 21:27:41 +0000 UTC" firstStartedPulling="2026-05-21 21:27:41.86219417 +0000 UTC m=+374.295205644" lastFinishedPulling="2026-05-21 21:27:44.349737219 +0000 UTC m=+376.782748692" observedRunningTime="2026-05-21 21:27:44.504935526 +0000 UTC m=+376.937947021" watchObservedRunningTime="2026-05-21 21:27:44.505954536 +0000 UTC m=+376.938966344"
May 21 21:27:44.711942 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:44.711866    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:45.716789 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:45.716759    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:46.435525 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:46.435494    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:27:46.436358 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:27:46.436337    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5"
May 21 21:28:06.902209 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:06.902173    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v6hm5"]
May 21 21:28:06.905654 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:06.905638    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v6hm5"
May 21 21:28:06.909232 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:06.909210    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 21:28:06.909352 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:06.909210    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 21:28:06.910080 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:06.910064    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-vqd96\""
May 21 21:28:06.931190 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:06.931144    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v6hm5"]
May 21 21:28:07.057800 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:07.057767    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xhzf\" (UniqueName: \"kubernetes.io/projected/3b644932-7b5d-4dfe-8025-9d537b405033-kube-api-access-7xhzf\") pod \"kuadrant-operator-catalog-v6hm5\" (UID: \"3b644932-7b5d-4dfe-8025-9d537b405033\") " pod="kuadrant-system/kuadrant-operator-catalog-v6hm5"
May 21 21:28:07.158911 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:07.158823    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xhzf\" (UniqueName: \"kubernetes.io/projected/3b644932-7b5d-4dfe-8025-9d537b405033-kube-api-access-7xhzf\") pod \"kuadrant-operator-catalog-v6hm5\" (UID: \"3b644932-7b5d-4dfe-8025-9d537b405033\") " pod="kuadrant-system/kuadrant-operator-catalog-v6hm5"
May 21 21:28:07.169139 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:07.169109    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xhzf\" (UniqueName: \"kubernetes.io/projected/3b644932-7b5d-4dfe-8025-9d537b405033-kube-api-access-7xhzf\") pod \"kuadrant-operator-catalog-v6hm5\" (UID: \"3b644932-7b5d-4dfe-8025-9d537b405033\") " pod="kuadrant-system/kuadrant-operator-catalog-v6hm5"
May 21 21:28:07.204141 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:07.204106    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v6hm5"]
May 21 21:28:07.204358 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:07.204346    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v6hm5"
May 21 21:28:07.330629 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:07.330487    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v6hm5"]
May 21 21:28:07.332998 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:28:07.332967    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b644932_7b5d_4dfe_8025_9d537b405033.slice/crio-b770fbc87d4582ec302a3da51c53afd37ff1ae76e91c4df56271db7f5676ff11 WatchSource:0}: Error finding container b770fbc87d4582ec302a3da51c53afd37ff1ae76e91c4df56271db7f5676ff11: Status 404 returned error can't find the container with id b770fbc87d4582ec302a3da51c53afd37ff1ae76e91c4df56271db7f5676ff11
May 21 21:28:07.416373 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:07.416296    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wmfxw"]
May 21 21:28:07.420852 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:07.420835    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wmfxw"
May 21 21:28:07.427146 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:07.427116    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wmfxw"]
May 21 21:28:07.508155 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:07.508122    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v6hm5" event={"ID":"3b644932-7b5d-4dfe-8025-9d537b405033","Type":"ContainerStarted","Data":"b770fbc87d4582ec302a3da51c53afd37ff1ae76e91c4df56271db7f5676ff11"}
May 21 21:28:07.560953 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:07.560921    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z2ds\" (UniqueName: \"kubernetes.io/projected/20801671-9cc5-40fe-bbef-80df1710c3a6-kube-api-access-5z2ds\") pod \"kuadrant-operator-catalog-wmfxw\" (UID: \"20801671-9cc5-40fe-bbef-80df1710c3a6\") " pod="kuadrant-system/kuadrant-operator-catalog-wmfxw"
May 21 21:28:07.662316 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:07.662282    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5z2ds\" (UniqueName: \"kubernetes.io/projected/20801671-9cc5-40fe-bbef-80df1710c3a6-kube-api-access-5z2ds\") pod \"kuadrant-operator-catalog-wmfxw\" (UID: \"20801671-9cc5-40fe-bbef-80df1710c3a6\") " pod="kuadrant-system/kuadrant-operator-catalog-wmfxw"
May 21 21:28:07.671058 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:07.671004    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z2ds\" (UniqueName: \"kubernetes.io/projected/20801671-9cc5-40fe-bbef-80df1710c3a6-kube-api-access-5z2ds\") pod \"kuadrant-operator-catalog-wmfxw\" (UID: \"20801671-9cc5-40fe-bbef-80df1710c3a6\") " pod="kuadrant-system/kuadrant-operator-catalog-wmfxw"
May 21 21:28:07.731134 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:07.731106    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wmfxw"
May 21 21:28:07.857274 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:07.857187    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wmfxw"]
May 21 21:28:07.865779 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:28:07.865755    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20801671_9cc5_40fe_bbef_80df1710c3a6.slice/crio-2d301f4d0debfea81e9b76fc45397c0479bc0187e8b0fe2bdaae04b9f76000bc WatchSource:0}: Error finding container 2d301f4d0debfea81e9b76fc45397c0479bc0187e8b0fe2bdaae04b9f76000bc: Status 404 returned error can't find the container with id 2d301f4d0debfea81e9b76fc45397c0479bc0187e8b0fe2bdaae04b9f76000bc
May 21 21:28:08.512921 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:08.512880    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wmfxw" event={"ID":"20801671-9cc5-40fe-bbef-80df1710c3a6","Type":"ContainerStarted","Data":"2d301f4d0debfea81e9b76fc45397c0479bc0187e8b0fe2bdaae04b9f76000bc"}
May 21 21:28:09.518415 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:09.518376    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wmfxw" event={"ID":"20801671-9cc5-40fe-bbef-80df1710c3a6","Type":"ContainerStarted","Data":"50a07b7bce27a0f618a11a3048846615684c1664bf36bfeb82b0788dc17370ff"}
May 21 21:28:09.519943 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:09.519900    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v6hm5" event={"ID":"3b644932-7b5d-4dfe-8025-9d537b405033","Type":"ContainerStarted","Data":"5a8756abaf253ba23b59ddadad0827cf41c2dbf813d030a6a721636476af0825"}
May 21 21:28:09.520066 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:09.519997    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-v6hm5" podUID="3b644932-7b5d-4dfe-8025-9d537b405033" containerName="registry-server" containerID="cri-o://5a8756abaf253ba23b59ddadad0827cf41c2dbf813d030a6a721636476af0825" gracePeriod=2
May 21 21:28:09.538995 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:09.538949    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wmfxw" podStartSLOduration=1.085487124 podStartE2EDuration="2.538934302s" podCreationTimestamp="2026-05-21 21:28:07 +0000 UTC" firstStartedPulling="2026-05-21 21:28:07.867054672 +0000 UTC m=+400.300066145" lastFinishedPulling="2026-05-21 21:28:09.320501847 +0000 UTC m=+401.753513323" observedRunningTime="2026-05-21 21:28:09.538013417 +0000 UTC m=+401.971024914" watchObservedRunningTime="2026-05-21 21:28:09.538934302 +0000 UTC m=+401.971945796"
May 21 21:28:09.563889 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:09.563816    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-v6hm5" podStartSLOduration=1.580246905 podStartE2EDuration="3.563802974s" podCreationTimestamp="2026-05-21 21:28:06 +0000 UTC" firstStartedPulling="2026-05-21 21:28:07.33433491 +0000 UTC m=+399.767346384" lastFinishedPulling="2026-05-21 21:28:09.317890977 +0000 UTC m=+401.750902453" observedRunningTime="2026-05-21 21:28:09.561088919 +0000 UTC m=+401.994100413" watchObservedRunningTime="2026-05-21 21:28:09.563802974 +0000 UTC m=+401.996814469"
May 21 21:28:09.769632 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:09.769609    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-v6hm5_3b644932-7b5d-4dfe-8025-9d537b405033/registry-server/0.log"
May 21 21:28:09.769736 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:09.769666    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v6hm5"
May 21 21:28:09.880734 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:09.880652    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xhzf\" (UniqueName: \"kubernetes.io/projected/3b644932-7b5d-4dfe-8025-9d537b405033-kube-api-access-7xhzf\") pod \"3b644932-7b5d-4dfe-8025-9d537b405033\" (UID: \"3b644932-7b5d-4dfe-8025-9d537b405033\") "
May 21 21:28:09.882794 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:09.882771    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b644932-7b5d-4dfe-8025-9d537b405033-kube-api-access-7xhzf" (OuterVolumeSpecName: "kube-api-access-7xhzf") pod "3b644932-7b5d-4dfe-8025-9d537b405033" (UID: "3b644932-7b5d-4dfe-8025-9d537b405033"). InnerVolumeSpecName "kube-api-access-7xhzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:28:09.981689 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:09.981663    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xhzf\" (UniqueName: \"kubernetes.io/projected/3b644932-7b5d-4dfe-8025-9d537b405033-kube-api-access-7xhzf\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:28:10.524051 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:10.523975    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-v6hm5_3b644932-7b5d-4dfe-8025-9d537b405033/registry-server/0.log"
May 21 21:28:10.524051 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:10.524014    2559 generic.go:358] "Generic (PLEG): container finished" podID="3b644932-7b5d-4dfe-8025-9d537b405033" containerID="5a8756abaf253ba23b59ddadad0827cf41c2dbf813d030a6a721636476af0825" exitCode=1
May 21 21:28:10.524454 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:10.524076    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v6hm5"
May 21 21:28:10.524454 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:10.524107    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v6hm5" event={"ID":"3b644932-7b5d-4dfe-8025-9d537b405033","Type":"ContainerDied","Data":"5a8756abaf253ba23b59ddadad0827cf41c2dbf813d030a6a721636476af0825"}
May 21 21:28:10.524454 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:10.524148    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v6hm5" event={"ID":"3b644932-7b5d-4dfe-8025-9d537b405033","Type":"ContainerDied","Data":"b770fbc87d4582ec302a3da51c53afd37ff1ae76e91c4df56271db7f5676ff11"}
May 21 21:28:10.524454 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:10.524165    2559 scope.go:117] "RemoveContainer" containerID="5a8756abaf253ba23b59ddadad0827cf41c2dbf813d030a6a721636476af0825"
May 21 21:28:10.532426 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:10.532412    2559 scope.go:117] "RemoveContainer" containerID="5a8756abaf253ba23b59ddadad0827cf41c2dbf813d030a6a721636476af0825"
May 21 21:28:10.532666 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:28:10.532649    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a8756abaf253ba23b59ddadad0827cf41c2dbf813d030a6a721636476af0825\": container with ID starting with 5a8756abaf253ba23b59ddadad0827cf41c2dbf813d030a6a721636476af0825 not found: ID does not exist" containerID="5a8756abaf253ba23b59ddadad0827cf41c2dbf813d030a6a721636476af0825"
May 21 21:28:10.532721 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:10.532671    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a8756abaf253ba23b59ddadad0827cf41c2dbf813d030a6a721636476af0825"} err="failed to get container status \"5a8756abaf253ba23b59ddadad0827cf41c2dbf813d030a6a721636476af0825\": rpc error: code = NotFound desc = could not find container \"5a8756abaf253ba23b59ddadad0827cf41c2dbf813d030a6a721636476af0825\": container with ID starting with 5a8756abaf253ba23b59ddadad0827cf41c2dbf813d030a6a721636476af0825 not found: ID does not exist"
May 21 21:28:10.540662 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:10.540641    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v6hm5"]
May 21 21:28:10.546480 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:10.546462    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v6hm5"]
May 21 21:28:12.166649 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:12.166612    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b644932-7b5d-4dfe-8025-9d537b405033" path="/var/lib/kubelet/pods/3b644932-7b5d-4dfe-8025-9d537b405033/volumes"
May 21 21:28:17.731668 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:17.731634    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-wmfxw"
May 21 21:28:17.731668 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:17.731675    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-wmfxw"
May 21 21:28:17.753144 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:17.753114    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-wmfxw"
May 21 21:28:18.570938 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:18.570911    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-wmfxw"
May 21 21:28:37.381291 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:37.381209    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg"]
May 21 21:28:37.381655 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:37.381622    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b644932-7b5d-4dfe-8025-9d537b405033" containerName="registry-server"
May 21 21:28:37.381655 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:37.381639    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b644932-7b5d-4dfe-8025-9d537b405033" containerName="registry-server"
May 21 21:28:37.381735 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:37.381702    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b644932-7b5d-4dfe-8025-9d537b405033" containerName="registry-server"
May 21 21:28:37.390708 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:37.390688    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg"
May 21 21:28:37.399740 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:37.399716    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg"]
May 21 21:28:37.400359 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:37.400342    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-w6v2c\""
May 21 21:28:37.414369 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:37.414345    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn7nm\" (UniqueName: \"kubernetes.io/projected/349fd428-54ef-4824-a77b-d88bd57486e4-kube-api-access-jn7nm\") pod \"limitador-operator-controller-manager-85c4996f8c-p2psg\" (UID: \"349fd428-54ef-4824-a77b-d88bd57486e4\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg"
May 21 21:28:37.515302 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:37.515271    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jn7nm\" (UniqueName: \"kubernetes.io/projected/349fd428-54ef-4824-a77b-d88bd57486e4-kube-api-access-jn7nm\") pod \"limitador-operator-controller-manager-85c4996f8c-p2psg\" (UID: \"349fd428-54ef-4824-a77b-d88bd57486e4\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg"
May 21 21:28:37.544498 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:37.544469    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn7nm\" (UniqueName: \"kubernetes.io/projected/349fd428-54ef-4824-a77b-d88bd57486e4-kube-api-access-jn7nm\") pod \"limitador-operator-controller-manager-85c4996f8c-p2psg\" (UID: \"349fd428-54ef-4824-a77b-d88bd57486e4\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg"
May 21 21:28:37.701497 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:37.701412    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg"
May 21 21:28:37.839791 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:37.839766    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg"]
May 21 21:28:37.841550 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:28:37.841525    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod349fd428_54ef_4824_a77b_d88bd57486e4.slice/crio-d48617b7db85494cdaff9dc140ba0d6f4cc4c6ff5ae5cb1fabc38d44a99a6841 WatchSource:0}: Error finding container d48617b7db85494cdaff9dc140ba0d6f4cc4c6ff5ae5cb1fabc38d44a99a6841: Status 404 returned error can't find the container with id d48617b7db85494cdaff9dc140ba0d6f4cc4c6ff5ae5cb1fabc38d44a99a6841
May 21 21:28:38.619861 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:38.619820    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg" event={"ID":"349fd428-54ef-4824-a77b-d88bd57486e4","Type":"ContainerStarted","Data":"d48617b7db85494cdaff9dc140ba0d6f4cc4c6ff5ae5cb1fabc38d44a99a6841"}
May 21 21:28:40.627389 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:40.627354    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg" event={"ID":"349fd428-54ef-4824-a77b-d88bd57486e4","Type":"ContainerStarted","Data":"05baa5e42e69309ce55e6d35e589e0f2ef7099229173ceeab37a6e73861aa33c"}
May 21 21:28:40.627785 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:40.627442    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg"
May 21 21:28:40.650828 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:40.650786    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg" podStartSLOduration=1.867295047 podStartE2EDuration="3.650774257s" podCreationTimestamp="2026-05-21 21:28:37 +0000 UTC" firstStartedPulling="2026-05-21 21:28:37.843562146 +0000 UTC m=+430.276573619" lastFinishedPulling="2026-05-21 21:28:39.627041356 +0000 UTC m=+432.060052829" observedRunningTime="2026-05-21 21:28:40.649424408 +0000 UTC m=+433.082435915" watchObservedRunningTime="2026-05-21 21:28:40.650774257 +0000 UTC m=+433.083785801"
May 21 21:28:43.471277 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:43.471240    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-hf7tr"]
May 21 21:28:43.474497 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:43.474479    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hf7tr"
May 21 21:28:43.477566 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:43.477533    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 21 21:28:43.477741 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:43.477723    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-hjtbh\""
May 21 21:28:43.493859 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:43.493834    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-hf7tr"]
May 21 21:28:43.567757 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:43.567731    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5ttc\" (UniqueName: \"kubernetes.io/projected/83b44eca-83ad-4641-b4e7-df584f6ab18e-kube-api-access-v5ttc\") pod \"dns-operator-controller-manager-648d5c98bc-hf7tr\" (UID: \"83b44eca-83ad-4641-b4e7-df584f6ab18e\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hf7tr"
May 21 21:28:43.668309 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:43.668283    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v5ttc\" (UniqueName: \"kubernetes.io/projected/83b44eca-83ad-4641-b4e7-df584f6ab18e-kube-api-access-v5ttc\") pod \"dns-operator-controller-manager-648d5c98bc-hf7tr\" (UID: \"83b44eca-83ad-4641-b4e7-df584f6ab18e\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hf7tr"
May 21 21:28:43.677861 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:43.677825    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5ttc\" (UniqueName: \"kubernetes.io/projected/83b44eca-83ad-4641-b4e7-df584f6ab18e-kube-api-access-v5ttc\") pod \"dns-operator-controller-manager-648d5c98bc-hf7tr\" (UID: \"83b44eca-83ad-4641-b4e7-df584f6ab18e\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hf7tr"
May 21 21:28:43.784773 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:43.784682    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hf7tr"
May 21 21:28:43.916517 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:43.916494    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-hf7tr"]
May 21 21:28:43.918819 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:28:43.918787    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b44eca_83ad_4641_b4e7_df584f6ab18e.slice/crio-4460ac3bcb2d45a802bf379c9a8c97c80cc280e6fb0dfcfb48e52d9efbb9e10a WatchSource:0}: Error finding container 4460ac3bcb2d45a802bf379c9a8c97c80cc280e6fb0dfcfb48e52d9efbb9e10a: Status 404 returned error can't find the container with id 4460ac3bcb2d45a802bf379c9a8c97c80cc280e6fb0dfcfb48e52d9efbb9e10a
May 21 21:28:44.641765 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:44.641729    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hf7tr" event={"ID":"83b44eca-83ad-4641-b4e7-df584f6ab18e","Type":"ContainerStarted","Data":"4460ac3bcb2d45a802bf379c9a8c97c80cc280e6fb0dfcfb48e52d9efbb9e10a"}
May 21 21:28:46.649784 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:46.649701    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hf7tr" event={"ID":"83b44eca-83ad-4641-b4e7-df584f6ab18e","Type":"ContainerStarted","Data":"082ca44abb106e78a9f34761c4cc2eb8a43b1eca6947629282d72f62c80ab473"}
May 21 21:28:46.650130 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:46.649852    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hf7tr"
May 21 21:28:46.667998 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:46.667952    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hf7tr" podStartSLOduration=1.291104775 podStartE2EDuration="3.667938027s" podCreationTimestamp="2026-05-21 21:28:43 +0000 UTC" firstStartedPulling="2026-05-21 21:28:43.920770145 +0000 UTC m=+436.353781619" lastFinishedPulling="2026-05-21 21:28:46.297603394 +0000 UTC m=+438.730614871" observedRunningTime="2026-05-21 21:28:46.666354771 +0000 UTC m=+439.099366266" watchObservedRunningTime="2026-05-21 21:28:46.667938027 +0000 UTC m=+439.100949527"
May 21 21:28:49.626947 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:49.626912    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4mcm"]
May 21 21:28:49.630375 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:49.630353    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4mcm"
May 21 21:28:49.633047 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:49.633020    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wprb5\""
May 21 21:28:49.633367 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:49.633349    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
May 21 21:28:49.633746 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:49.633721    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
May 21 21:28:49.640089 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:49.640066    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4mcm"]
May 21 21:28:49.720497 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:49.720465    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/81811d59-4b17-4b88-8c1f-df0c4d2aa6ad-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-m4mcm\" (UID: \"81811d59-4b17-4b88-8c1f-df0c4d2aa6ad\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4mcm"
May 21 21:28:49.720663 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:49.720525    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxv96\" (UniqueName: \"kubernetes.io/projected/81811d59-4b17-4b88-8c1f-df0c4d2aa6ad-kube-api-access-nxv96\") pod \"kuadrant-console-plugin-6cb54b5c86-m4mcm\" (UID: \"81811d59-4b17-4b88-8c1f-df0c4d2aa6ad\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4mcm"
May 21 21:28:49.720709 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:49.720647    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/81811d59-4b17-4b88-8c1f-df0c4d2aa6ad-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-m4mcm\" (UID: \"81811d59-4b17-4b88-8c1f-df0c4d2aa6ad\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4mcm"
May 21 21:28:49.821125 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:49.821093    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/81811d59-4b17-4b88-8c1f-df0c4d2aa6ad-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-m4mcm\" (UID: \"81811d59-4b17-4b88-8c1f-df0c4d2aa6ad\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4mcm"
May 21 21:28:49.821279 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:49.821144    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nxv96\" (UniqueName: \"kubernetes.io/projected/81811d59-4b17-4b88-8c1f-df0c4d2aa6ad-kube-api-access-nxv96\") pod \"kuadrant-console-plugin-6cb54b5c86-m4mcm\" (UID: \"81811d59-4b17-4b88-8c1f-df0c4d2aa6ad\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4mcm"
May 21 21:28:49.821279 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:49.821176    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/81811d59-4b17-4b88-8c1f-df0c4d2aa6ad-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-m4mcm\" (UID: \"81811d59-4b17-4b88-8c1f-df0c4d2aa6ad\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4mcm"
May 21 21:28:49.821769 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:49.821750    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/81811d59-4b17-4b88-8c1f-df0c4d2aa6ad-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-m4mcm\" (UID: \"81811d59-4b17-4b88-8c1f-df0c4d2aa6ad\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4mcm"
May 21 21:28:49.823494 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:49.823475    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/81811d59-4b17-4b88-8c1f-df0c4d2aa6ad-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-m4mcm\" (UID: \"81811d59-4b17-4b88-8c1f-df0c4d2aa6ad\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4mcm"
May 21 21:28:49.831820 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:49.831797    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxv96\" (UniqueName: \"kubernetes.io/projected/81811d59-4b17-4b88-8c1f-df0c4d2aa6ad-kube-api-access-nxv96\") pod \"kuadrant-console-plugin-6cb54b5c86-m4mcm\" (UID: \"81811d59-4b17-4b88-8c1f-df0c4d2aa6ad\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4mcm"
May 21 21:28:49.940415 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:49.940352    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4mcm"
May 21 21:28:50.061360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:50.061335    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4mcm"]
May 21 21:28:50.063639 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:28:50.063605    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81811d59_4b17_4b88_8c1f_df0c4d2aa6ad.slice/crio-b31f248d76033742ac125b0cf603f860e0e53b023d4cf3465e916ecfb28e4a0d WatchSource:0}: Error finding container b31f248d76033742ac125b0cf603f860e0e53b023d4cf3465e916ecfb28e4a0d: Status 404 returned error can't find the container with id b31f248d76033742ac125b0cf603f860e0e53b023d4cf3465e916ecfb28e4a0d
May 21 21:28:50.666196 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:50.666159    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4mcm" event={"ID":"81811d59-4b17-4b88-8c1f-df0c4d2aa6ad","Type":"ContainerStarted","Data":"b31f248d76033742ac125b0cf603f860e0e53b023d4cf3465e916ecfb28e4a0d"}
May 21 21:28:51.633732 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:51.633700    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg"
May 21 21:28:57.657235 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:57.657195    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hf7tr"
May 21 21:28:59.569542 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:59.569508    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s"]
May 21 21:28:59.581263 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:59.581236    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s"
May 21 21:28:59.584283 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:59.584258    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lzdrl\""
May 21 21:28:59.585965 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:59.585926    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s"]
May 21 21:28:59.677333 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:59.677289    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s"]
May 21 21:28:59.677606 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:28:59.677562    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-m8nc8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s" podUID="c4bae026-3ffd-473c-bf85-6f303fdf5a50"
May 21 21:28:59.701829 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:59.701789    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s"
May 21 21:28:59.707294 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:59.707271    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s"
May 21 21:28:59.712812 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:59.712789    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4bae026-3ffd-473c-bf85-6f303fdf5a50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s\" (UID: \"c4bae026-3ffd-473c-bf85-6f303fdf5a50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s"
May 21 21:28:59.712927 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:59.712856    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8nc8\" (UniqueName: \"kubernetes.io/projected/c4bae026-3ffd-473c-bf85-6f303fdf5a50-kube-api-access-m8nc8\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s\" (UID: \"c4bae026-3ffd-473c-bf85-6f303fdf5a50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s"
May 21 21:28:59.814206 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:59.814166    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m8nc8\" (UniqueName: \"kubernetes.io/projected/c4bae026-3ffd-473c-bf85-6f303fdf5a50-kube-api-access-m8nc8\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s\" (UID: \"c4bae026-3ffd-473c-bf85-6f303fdf5a50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s"
May 21 21:28:59.814366 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:59.814259    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4bae026-3ffd-473c-bf85-6f303fdf5a50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s\" (UID: \"c4bae026-3ffd-473c-bf85-6f303fdf5a50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s"
May 21 21:28:59.814677 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:59.814653    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4bae026-3ffd-473c-bf85-6f303fdf5a50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s\" (UID: \"c4bae026-3ffd-473c-bf85-6f303fdf5a50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s"
May 21 21:28:59.826691 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:59.826631    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8nc8\" (UniqueName: \"kubernetes.io/projected/c4bae026-3ffd-473c-bf85-6f303fdf5a50-kube-api-access-m8nc8\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s\" (UID: \"c4bae026-3ffd-473c-bf85-6f303fdf5a50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s"
May 21 21:28:59.915032 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:59.915000    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4bae026-3ffd-473c-bf85-6f303fdf5a50-extensions-socket-volume\") pod \"c4bae026-3ffd-473c-bf85-6f303fdf5a50\" (UID: \"c4bae026-3ffd-473c-bf85-6f303fdf5a50\") "
May 21 21:28:59.915218 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:59.915072    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8nc8\" (UniqueName: \"kubernetes.io/projected/c4bae026-3ffd-473c-bf85-6f303fdf5a50-kube-api-access-m8nc8\") pod \"c4bae026-3ffd-473c-bf85-6f303fdf5a50\" (UID: \"c4bae026-3ffd-473c-bf85-6f303fdf5a50\") "
May 21 21:28:59.915305 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:59.915282    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4bae026-3ffd-473c-bf85-6f303fdf5a50-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c4bae026-3ffd-473c-bf85-6f303fdf5a50" (UID: "c4bae026-3ffd-473c-bf85-6f303fdf5a50"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:28:59.915389 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:59.915372    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4bae026-3ffd-473c-bf85-6f303fdf5a50-extensions-socket-volume\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:28:59.917301 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:28:59.917265    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4bae026-3ffd-473c-bf85-6f303fdf5a50-kube-api-access-m8nc8" (OuterVolumeSpecName: "kube-api-access-m8nc8") pod "c4bae026-3ffd-473c-bf85-6f303fdf5a50" (UID: "c4bae026-3ffd-473c-bf85-6f303fdf5a50"). InnerVolumeSpecName "kube-api-access-m8nc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:29:00.016296 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.016255    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8nc8\" (UniqueName: \"kubernetes.io/projected/c4bae026-3ffd-473c-bf85-6f303fdf5a50-kube-api-access-m8nc8\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:29:00.199757 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.199712    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s"]
May 21 21:29:00.204639 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.204402    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s"]
May 21 21:29:00.241959 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.241915    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg"]
May 21 21:29:00.242828 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.242572    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg" podUID="349fd428-54ef-4824-a77b-d88bd57486e4" containerName="manager" containerID="cri-o://05baa5e42e69309ce55e6d35e589e0f2ef7099229173ceeab37a6e73861aa33c" gracePeriod=2
May 21 21:29:00.245433 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.245095    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg"]
May 21 21:29:00.245542 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.245448    2559 status_manager.go:895] "Failed to get status for pod" podUID="349fd428-54ef-4824-a77b-d88bd57486e4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg" err="pods \"limitador-operator-controller-manager-85c4996f8c-p2psg\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object"
May 21 21:29:00.252456 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.252355    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm"]
May 21 21:29:00.252843 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.252826    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="349fd428-54ef-4824-a77b-d88bd57486e4" containerName="manager"
May 21 21:29:00.252940 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.252846    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="349fd428-54ef-4824-a77b-d88bd57486e4" containerName="manager"
May 21 21:29:00.252999 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.252966    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="349fd428-54ef-4824-a77b-d88bd57486e4" containerName="manager"
May 21 21:29:00.261254 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.261231    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm"
May 21 21:29:00.264040 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.263811    2559 status_manager.go:895] "Failed to get status for pod" podUID="349fd428-54ef-4824-a77b-d88bd57486e4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg" err="pods \"limitador-operator-controller-manager-85c4996f8c-p2psg\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object"
May 21 21:29:00.269431 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.269278    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm"]
May 21 21:29:00.271404 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.271383    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xn7mb"]
May 21 21:29:00.275157 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.275139    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xn7mb"
May 21 21:29:00.283954 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.283929    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xn7mb"]
May 21 21:29:00.286709 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.286682    2559 status_manager.go:895] "Failed to get status for pod" podUID="349fd428-54ef-4824-a77b-d88bd57486e4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg" err="pods \"limitador-operator-controller-manager-85c4996f8c-p2psg\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object"
May 21 21:29:00.420340 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.420303    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcrhs\" (UniqueName: \"kubernetes.io/projected/c41d294b-a734-4b2e-a235-93dc56ff3ba3-kube-api-access-fcrhs\") pod \"kuadrant-operator-controller-manager-84b657d985-2pmdm\" (UID: \"c41d294b-a734-4b2e-a235-93dc56ff3ba3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm"
May 21 21:29:00.420497 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.420355    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c41d294b-a734-4b2e-a235-93dc56ff3ba3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-2pmdm\" (UID: \"c41d294b-a734-4b2e-a235-93dc56ff3ba3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm"
May 21 21:29:00.420497 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.420409    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tzww\" (UniqueName: \"kubernetes.io/projected/1d2b719c-bd99-4d46-ad3b-57931b31458a-kube-api-access-5tzww\") pod \"limitador-operator-controller-manager-85c4996f8c-xn7mb\" (UID: \"1d2b719c-bd99-4d46-ad3b-57931b31458a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xn7mb"
May 21 21:29:00.521342 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.521058    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcrhs\" (UniqueName: \"kubernetes.io/projected/c41d294b-a734-4b2e-a235-93dc56ff3ba3-kube-api-access-fcrhs\") pod \"kuadrant-operator-controller-manager-84b657d985-2pmdm\" (UID: \"c41d294b-a734-4b2e-a235-93dc56ff3ba3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm"
May 21 21:29:00.521342 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.521141    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c41d294b-a734-4b2e-a235-93dc56ff3ba3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-2pmdm\" (UID: \"c41d294b-a734-4b2e-a235-93dc56ff3ba3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm"
May 21 21:29:00.521342 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.521183    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5tzww\" (UniqueName: \"kubernetes.io/projected/1d2b719c-bd99-4d46-ad3b-57931b31458a-kube-api-access-5tzww\") pod \"limitador-operator-controller-manager-85c4996f8c-xn7mb\" (UID: \"1d2b719c-bd99-4d46-ad3b-57931b31458a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xn7mb"
May 21 21:29:00.521822 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.521793    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c41d294b-a734-4b2e-a235-93dc56ff3ba3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-2pmdm\" (UID: \"c41d294b-a734-4b2e-a235-93dc56ff3ba3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm"
May 21 21:29:00.534769 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.534741    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcrhs\" (UniqueName: \"kubernetes.io/projected/c41d294b-a734-4b2e-a235-93dc56ff3ba3-kube-api-access-fcrhs\") pod \"kuadrant-operator-controller-manager-84b657d985-2pmdm\" (UID: \"c41d294b-a734-4b2e-a235-93dc56ff3ba3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm"
May 21 21:29:00.534889 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.534824    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tzww\" (UniqueName: \"kubernetes.io/projected/1d2b719c-bd99-4d46-ad3b-57931b31458a-kube-api-access-5tzww\") pod \"limitador-operator-controller-manager-85c4996f8c-xn7mb\" (UID: \"1d2b719c-bd99-4d46-ad3b-57931b31458a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xn7mb"
May 21 21:29:00.615222 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.615171    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm"
May 21 21:29:00.622476 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.622449    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xn7mb"
May 21 21:29:00.705961 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.705928    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s"
May 21 21:29:00.708801 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.708767    2559 status_manager.go:895] "Failed to get status for pod" podUID="349fd428-54ef-4824-a77b-d88bd57486e4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg" err="pods \"limitador-operator-controller-manager-85c4996f8c-p2psg\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object"
May 21 21:29:00.710883 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.710849    2559 status_manager.go:895] "Failed to get status for pod" podUID="c4bae026-3ffd-473c-bf85-6f303fdf5a50" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object"
May 21 21:29:00.713202 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.713177    2559 status_manager.go:895] "Failed to get status for pod" podUID="349fd428-54ef-4824-a77b-d88bd57486e4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg" err="pods \"limitador-operator-controller-manager-85c4996f8c-p2psg\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object"
May 21 21:29:00.715443 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:00.715393    2559 status_manager.go:895] "Failed to get status for pod" podUID="c4bae026-3ffd-473c-bf85-6f303fdf5a50" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-r8v5s\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object"
May 21 21:29:02.168548 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:02.168505    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4bae026-3ffd-473c-bf85-6f303fdf5a50" path="/var/lib/kubelet/pods/c4bae026-3ffd-473c-bf85-6f303fdf5a50/volumes"
May 21 21:29:02.632047 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:02.631977    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg" podUID="349fd428-54ef-4824-a77b-d88bd57486e4" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.29:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
May 21 21:29:12.152242 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:12.152125    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xn7mb"]
May 21 21:29:12.154074 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:29:12.154047    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2b719c_bd99_4d46_ad3b_57931b31458a.slice/crio-f59153b039e0e16da77068b63f04910c84d0435cd646dac26fd71015e16a0e2b WatchSource:0}: Error finding container f59153b039e0e16da77068b63f04910c84d0435cd646dac26fd71015e16a0e2b: Status 404 returned error can't find the container with id f59153b039e0e16da77068b63f04910c84d0435cd646dac26fd71015e16a0e2b
May 21 21:29:12.156288 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:12.156265    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg"
May 21 21:29:12.158824 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:12.158796    2559 status_manager.go:895] "Failed to get status for pod" podUID="349fd428-54ef-4824-a77b-d88bd57486e4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg" err="pods \"limitador-operator-controller-manager-85c4996f8c-p2psg\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object"
May 21 21:29:12.185302 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:12.185274    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm"]
May 21 21:29:12.191652 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:29:12.191627    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc41d294b_a734_4b2e_a235_93dc56ff3ba3.slice/crio-47fb978cd2f506466614c342bb7af2fb57e072f5b04df51fcf38c3a1805d060a WatchSource:0}: Error finding container 47fb978cd2f506466614c342bb7af2fb57e072f5b04df51fcf38c3a1805d060a: Status 404 returned error can't find the container with id 47fb978cd2f506466614c342bb7af2fb57e072f5b04df51fcf38c3a1805d060a
May 21 21:29:12.330291 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:12.330256    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jn7nm\" (UniqueName: \"kubernetes.io/projected/349fd428-54ef-4824-a77b-d88bd57486e4-kube-api-access-jn7nm\") pod \"349fd428-54ef-4824-a77b-d88bd57486e4\" (UID: \"349fd428-54ef-4824-a77b-d88bd57486e4\") "
May 21 21:29:12.332257 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:12.332228    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/349fd428-54ef-4824-a77b-d88bd57486e4-kube-api-access-jn7nm" (OuterVolumeSpecName: "kube-api-access-jn7nm") pod "349fd428-54ef-4824-a77b-d88bd57486e4" (UID: "349fd428-54ef-4824-a77b-d88bd57486e4"). InnerVolumeSpecName "kube-api-access-jn7nm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:29:12.431144 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:12.431110    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jn7nm\" (UniqueName: \"kubernetes.io/projected/349fd428-54ef-4824-a77b-d88bd57486e4-kube-api-access-jn7nm\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:29:12.760440 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:12.760342    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4mcm" event={"ID":"81811d59-4b17-4b88-8c1f-df0c4d2aa6ad","Type":"ContainerStarted","Data":"c71d93edd32cf9df20bdc8c38af064876afb9a1c12eedabcea23a830e5f1eeff"}
May 21 21:29:12.761813 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:12.761781    2559 generic.go:358] "Generic (PLEG): container finished" podID="349fd428-54ef-4824-a77b-d88bd57486e4" containerID="05baa5e42e69309ce55e6d35e589e0f2ef7099229173ceeab37a6e73861aa33c" exitCode=0
May 21 21:29:12.761968 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:12.761827    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg"
May 21 21:29:12.761968 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:12.761881    2559 scope.go:117] "RemoveContainer" containerID="05baa5e42e69309ce55e6d35e589e0f2ef7099229173ceeab37a6e73861aa33c"
May 21 21:29:12.763443 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:12.763393    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm" event={"ID":"c41d294b-a734-4b2e-a235-93dc56ff3ba3","Type":"ContainerStarted","Data":"47fb978cd2f506466614c342bb7af2fb57e072f5b04df51fcf38c3a1805d060a"}
May 21 21:29:12.765278 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:12.765220    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xn7mb" event={"ID":"1d2b719c-bd99-4d46-ad3b-57931b31458a","Type":"ContainerStarted","Data":"0b0cc6e0b71bae398eeb0594b3db6ef5670e67dcfde4bc61efb20bbf17182328"}
May 21 21:29:12.765278 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:12.765246    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xn7mb" event={"ID":"1d2b719c-bd99-4d46-ad3b-57931b31458a","Type":"ContainerStarted","Data":"f59153b039e0e16da77068b63f04910c84d0435cd646dac26fd71015e16a0e2b"}
May 21 21:29:12.765459 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:12.765404    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xn7mb"
May 21 21:29:12.772559 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:12.772539    2559 scope.go:117] "RemoveContainer" containerID="05baa5e42e69309ce55e6d35e589e0f2ef7099229173ceeab37a6e73861aa33c"
May 21 21:29:12.772843 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:29:12.772820    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05baa5e42e69309ce55e6d35e589e0f2ef7099229173ceeab37a6e73861aa33c\": container with ID starting with 05baa5e42e69309ce55e6d35e589e0f2ef7099229173ceeab37a6e73861aa33c not found: ID does not exist" containerID="05baa5e42e69309ce55e6d35e589e0f2ef7099229173ceeab37a6e73861aa33c"
May 21 21:29:12.772934 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:12.772854    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05baa5e42e69309ce55e6d35e589e0f2ef7099229173ceeab37a6e73861aa33c"} err="failed to get container status \"05baa5e42e69309ce55e6d35e589e0f2ef7099229173ceeab37a6e73861aa33c\": rpc error: code = NotFound desc = could not find container \"05baa5e42e69309ce55e6d35e589e0f2ef7099229173ceeab37a6e73861aa33c\": container with ID starting with 05baa5e42e69309ce55e6d35e589e0f2ef7099229173ceeab37a6e73861aa33c not found: ID does not exist"
May 21 21:29:12.784934 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:12.784906    2559 status_manager.go:895] "Failed to get status for pod" podUID="349fd428-54ef-4824-a77b-d88bd57486e4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-p2psg" err="pods \"limitador-operator-controller-manager-85c4996f8c-p2psg\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object"
May 21 21:29:12.785065 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:12.784963    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-m4mcm" podStartSLOduration=1.742998891 podStartE2EDuration="23.784948215s" podCreationTimestamp="2026-05-21 21:28:49 +0000 UTC" firstStartedPulling="2026-05-21 21:28:50.065089717 +0000 UTC m=+442.498101206" lastFinishedPulling="2026-05-21 21:29:12.107039043 +0000 UTC m=+464.540050530" observedRunningTime="2026-05-21 21:29:12.781920987 +0000 UTC m=+465.214932482" watchObservedRunningTime="2026-05-21 21:29:12.784948215 +0000 UTC m=+465.217959689"
May 21 21:29:12.816727 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:12.816678    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xn7mb" podStartSLOduration=12.816665185 podStartE2EDuration="12.816665185s" podCreationTimestamp="2026-05-21 21:29:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:29:12.813667139 +0000 UTC m=+465.246678633" watchObservedRunningTime="2026-05-21 21:29:12.816665185 +0000 UTC m=+465.249676723"
May 21 21:29:14.167346 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:14.167312    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="349fd428-54ef-4824-a77b-d88bd57486e4" path="/var/lib/kubelet/pods/349fd428-54ef-4824-a77b-d88bd57486e4/volumes"
May 21 21:29:16.786298 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:16.786261    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm" event={"ID":"c41d294b-a734-4b2e-a235-93dc56ff3ba3","Type":"ContainerStarted","Data":"7152f5a2f336b592a8804758d4dd87d0e47c39c091460c05c40434a360d677a0"}
May 21 21:29:16.786711 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:16.786372    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm"
May 21 21:29:16.814550 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:16.814495    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm" podStartSLOduration=12.938540902 podStartE2EDuration="16.81448216s" podCreationTimestamp="2026-05-21 21:29:00 +0000 UTC" firstStartedPulling="2026-05-21 21:29:12.194110398 +0000 UTC m=+464.627121871" lastFinishedPulling="2026-05-21 21:29:16.070051657 +0000 UTC m=+468.503063129" observedRunningTime="2026-05-21 21:29:16.812033751 +0000 UTC m=+469.245045246" watchObservedRunningTime="2026-05-21 21:29:16.81448216 +0000 UTC m=+469.247493718"
May 21 21:29:23.776307 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:23.776277    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xn7mb"
May 21 21:29:27.792175 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:27.792146    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm"
May 21 21:29:40.588800 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:40.588767    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm"]
May 21 21:29:40.589232 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:40.589018    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm" podUID="c41d294b-a734-4b2e-a235-93dc56ff3ba3" containerName="manager" containerID="cri-o://7152f5a2f336b592a8804758d4dd87d0e47c39c091460c05c40434a360d677a0" gracePeriod=10
May 21 21:29:41.351455 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:41.351433    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm"
May 21 21:29:41.466826 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:41.466797    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c41d294b-a734-4b2e-a235-93dc56ff3ba3-extensions-socket-volume\") pod \"c41d294b-a734-4b2e-a235-93dc56ff3ba3\" (UID: \"c41d294b-a734-4b2e-a235-93dc56ff3ba3\") "
May 21 21:29:41.466997 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:41.466899    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcrhs\" (UniqueName: \"kubernetes.io/projected/c41d294b-a734-4b2e-a235-93dc56ff3ba3-kube-api-access-fcrhs\") pod \"c41d294b-a734-4b2e-a235-93dc56ff3ba3\" (UID: \"c41d294b-a734-4b2e-a235-93dc56ff3ba3\") "
May 21 21:29:41.467277 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:41.467246    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c41d294b-a734-4b2e-a235-93dc56ff3ba3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c41d294b-a734-4b2e-a235-93dc56ff3ba3" (UID: "c41d294b-a734-4b2e-a235-93dc56ff3ba3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:29:41.468959 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:41.468925    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c41d294b-a734-4b2e-a235-93dc56ff3ba3-kube-api-access-fcrhs" (OuterVolumeSpecName: "kube-api-access-fcrhs") pod "c41d294b-a734-4b2e-a235-93dc56ff3ba3" (UID: "c41d294b-a734-4b2e-a235-93dc56ff3ba3"). InnerVolumeSpecName "kube-api-access-fcrhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:29:41.567863 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:41.567836    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c41d294b-a734-4b2e-a235-93dc56ff3ba3-extensions-socket-volume\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:29:41.567863 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:41.567860    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcrhs\" (UniqueName: \"kubernetes.io/projected/c41d294b-a734-4b2e-a235-93dc56ff3ba3-kube-api-access-fcrhs\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:29:41.870938 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:41.870906    2559 generic.go:358] "Generic (PLEG): container finished" podID="c41d294b-a734-4b2e-a235-93dc56ff3ba3" containerID="7152f5a2f336b592a8804758d4dd87d0e47c39c091460c05c40434a360d677a0" exitCode=0
May 21 21:29:41.871353 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:41.870969    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm"
May 21 21:29:41.871353 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:41.870987    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm" event={"ID":"c41d294b-a734-4b2e-a235-93dc56ff3ba3","Type":"ContainerDied","Data":"7152f5a2f336b592a8804758d4dd87d0e47c39c091460c05c40434a360d677a0"}
May 21 21:29:41.871353 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:41.871021    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm" event={"ID":"c41d294b-a734-4b2e-a235-93dc56ff3ba3","Type":"ContainerDied","Data":"47fb978cd2f506466614c342bb7af2fb57e072f5b04df51fcf38c3a1805d060a"}
May 21 21:29:41.871353 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:41.871037    2559 scope.go:117] "RemoveContainer" containerID="7152f5a2f336b592a8804758d4dd87d0e47c39c091460c05c40434a360d677a0"
May 21 21:29:41.879395 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:41.879376    2559 scope.go:117] "RemoveContainer" containerID="7152f5a2f336b592a8804758d4dd87d0e47c39c091460c05c40434a360d677a0"
May 21 21:29:41.879677 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:29:41.879655    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7152f5a2f336b592a8804758d4dd87d0e47c39c091460c05c40434a360d677a0\": container with ID starting with 7152f5a2f336b592a8804758d4dd87d0e47c39c091460c05c40434a360d677a0 not found: ID does not exist" containerID="7152f5a2f336b592a8804758d4dd87d0e47c39c091460c05c40434a360d677a0"
May 21 21:29:41.879793 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:41.879684    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7152f5a2f336b592a8804758d4dd87d0e47c39c091460c05c40434a360d677a0"} err="failed to get container status \"7152f5a2f336b592a8804758d4dd87d0e47c39c091460c05c40434a360d677a0\": rpc error: code = NotFound desc = could not find container \"7152f5a2f336b592a8804758d4dd87d0e47c39c091460c05c40434a360d677a0\": container with ID starting with 7152f5a2f336b592a8804758d4dd87d0e47c39c091460c05c40434a360d677a0 not found: ID does not exist"
May 21 21:29:41.916701 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:41.916660    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm"]
May 21 21:29:41.921283 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:41.921263    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2pmdm"]
May 21 21:29:42.167311 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:42.167234    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c41d294b-a734-4b2e-a235-93dc56ff3ba3" path="/var/lib/kubelet/pods/c41d294b-a734-4b2e-a235-93dc56ff3ba3/volumes"
May 21 21:29:44.244465 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.244433    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"]
May 21 21:29:44.244870 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.244822    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c41d294b-a734-4b2e-a235-93dc56ff3ba3" containerName="manager"
May 21 21:29:44.244870 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.244836    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c41d294b-a734-4b2e-a235-93dc56ff3ba3" containerName="manager"
May 21 21:29:44.244956 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.244895    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="c41d294b-a734-4b2e-a235-93dc56ff3ba3" containerName="manager"
May 21 21:29:44.290635 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.290566    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"]
May 21 21:29:44.290803 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.290744    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.295980 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.295949    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jr6hq\""
May 21 21:29:44.389714 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.389680    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.389876 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.389721    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8zfk\" (UniqueName: \"kubernetes.io/projected/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-kube-api-access-t8zfk\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.389876 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.389747    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.389876 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.389766    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.389876 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.389789    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.389876 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.389806    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.389876 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.389839    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.389876 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.389855    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.389876 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.389876    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.490662 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.490632    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.490829 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.490673    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8zfk\" (UniqueName: \"kubernetes.io/projected/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-kube-api-access-t8zfk\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.490829 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.490696    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.490829 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.490714    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.490829 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.490737    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.490829 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.490755    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.490829 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.490789    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.490829 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.490813    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.491190 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.490845    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.491322 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.491291    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.491322 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.491318    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.491467 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.491353    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.491467 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.491391    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.491652 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.491625    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.493220 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.493193    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.493307 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.493255    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.500159 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.500089    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.500738 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.500715    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8zfk\" (UniqueName: \"kubernetes.io/projected/e02c4ef8-59b1-4d27-9850-d3c4b0c070ba-kube-api-access-t8zfk\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ht8d5\" (UID: \"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.607841 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.607810    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:44.757410 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.757328    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"]
May 21 21:29:44.761419 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:29:44.761392    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02c4ef8_59b1_4d27_9850_d3c4b0c070ba.slice/crio-ff3d4a3662fb25af908f8992429dc92829c6bdf078fe96d58ad1e8e7ae14e1df WatchSource:0}: Error finding container ff3d4a3662fb25af908f8992429dc92829c6bdf078fe96d58ad1e8e7ae14e1df: Status 404 returned error can't find the container with id ff3d4a3662fb25af908f8992429dc92829c6bdf078fe96d58ad1e8e7ae14e1df
May 21 21:29:44.765109 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.764431    2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
May 21 21:29:44.765109 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.764514    2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
May 21 21:29:44.765109 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.764550    2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
May 21 21:29:44.883076 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.883042    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5" event={"ID":"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba","Type":"ContainerStarted","Data":"5fc679f49e429fd24bd95bcf1255d4b5ee78ac4ad737440b3d0936766b813abf"}
May 21 21:29:44.883314 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.883082    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5" event={"ID":"e02c4ef8-59b1-4d27-9850-d3c4b0c070ba","Type":"ContainerStarted","Data":"ff3d4a3662fb25af908f8992429dc92829c6bdf078fe96d58ad1e8e7ae14e1df"}
May 21 21:29:44.907756 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:44.907710    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5" podStartSLOduration=0.907696351 podStartE2EDuration="907.696351ms" podCreationTimestamp="2026-05-21 21:29:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:29:44.905963497 +0000 UTC m=+497.338974991" watchObservedRunningTime="2026-05-21 21:29:44.907696351 +0000 UTC m=+497.340707846"
May 21 21:29:45.608821 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:45.608785    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:45.613575 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:45.613553    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:45.886704 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:45.886625    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:45.887490 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:45.887470    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ht8d5"
May 21 21:29:49.634537 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:49.634502    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:29:49.661301 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:49.661270    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:29:49.661475 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:49.661384    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-s2x2z"
May 21 21:29:49.664289 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:49.664269    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 21 21:29:49.665969 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:49.665947    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:29:49.735246 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:49.735216    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e640c9bc-7604-4ea2-a674-cde5d30234f7-config-file\") pod \"limitador-limitador-78c99df468-s2x2z\" (UID: \"e640c9bc-7604-4ea2-a674-cde5d30234f7\") " pod="kuadrant-system/limitador-limitador-78c99df468-s2x2z"
May 21 21:29:49.735407 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:49.735280    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccxtc\" (UniqueName: \"kubernetes.io/projected/e640c9bc-7604-4ea2-a674-cde5d30234f7-kube-api-access-ccxtc\") pod \"limitador-limitador-78c99df468-s2x2z\" (UID: \"e640c9bc-7604-4ea2-a674-cde5d30234f7\") " pod="kuadrant-system/limitador-limitador-78c99df468-s2x2z"
May 21 21:29:49.836071 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:49.836037    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ccxtc\" (UniqueName: \"kubernetes.io/projected/e640c9bc-7604-4ea2-a674-cde5d30234f7-kube-api-access-ccxtc\") pod \"limitador-limitador-78c99df468-s2x2z\" (UID: \"e640c9bc-7604-4ea2-a674-cde5d30234f7\") " pod="kuadrant-system/limitador-limitador-78c99df468-s2x2z"
May 21 21:29:49.836222 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:49.836095    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e640c9bc-7604-4ea2-a674-cde5d30234f7-config-file\") pod \"limitador-limitador-78c99df468-s2x2z\" (UID: \"e640c9bc-7604-4ea2-a674-cde5d30234f7\") " pod="kuadrant-system/limitador-limitador-78c99df468-s2x2z"
May 21 21:29:49.836674 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:49.836657    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e640c9bc-7604-4ea2-a674-cde5d30234f7-config-file\") pod \"limitador-limitador-78c99df468-s2x2z\" (UID: \"e640c9bc-7604-4ea2-a674-cde5d30234f7\") " pod="kuadrant-system/limitador-limitador-78c99df468-s2x2z"
May 21 21:29:49.844660 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:49.844635    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccxtc\" (UniqueName: \"kubernetes.io/projected/e640c9bc-7604-4ea2-a674-cde5d30234f7-kube-api-access-ccxtc\") pod \"limitador-limitador-78c99df468-s2x2z\" (UID: \"e640c9bc-7604-4ea2-a674-cde5d30234f7\") " pod="kuadrant-system/limitador-limitador-78c99df468-s2x2z"
May 21 21:29:49.972892 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:49.972813    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-s2x2z"
May 21 21:29:50.101153 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:50.101128    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:29:50.104128 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:29:50.104098    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode640c9bc_7604_4ea2_a674_cde5d30234f7.slice/crio-1265642ca1ec0998c1452d0915777dd58cd4b4da548b958994f177cb981cc2cb WatchSource:0}: Error finding container 1265642ca1ec0998c1452d0915777dd58cd4b4da548b958994f177cb981cc2cb: Status 404 returned error can't find the container with id 1265642ca1ec0998c1452d0915777dd58cd4b4da548b958994f177cb981cc2cb
May 21 21:29:50.123827 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:50.123800    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-hldph"]
May 21 21:29:50.155343 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:50.155317    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-hldph"]
May 21 21:29:50.155455 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:50.155430    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-hldph"
May 21 21:29:50.158779 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:50.158758    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rsqsc\""
May 21 21:29:50.239408 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:50.239328    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxbpd\" (UniqueName: \"kubernetes.io/projected/77aadd78-b777-4086-906c-02db79588b83-kube-api-access-hxbpd\") pod \"authorino-7498df8756-hldph\" (UID: \"77aadd78-b777-4086-906c-02db79588b83\") " pod="kuadrant-system/authorino-7498df8756-hldph"
May 21 21:29:50.340452 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:50.340419    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hxbpd\" (UniqueName: \"kubernetes.io/projected/77aadd78-b777-4086-906c-02db79588b83-kube-api-access-hxbpd\") pod \"authorino-7498df8756-hldph\" (UID: \"77aadd78-b777-4086-906c-02db79588b83\") " pod="kuadrant-system/authorino-7498df8756-hldph"
May 21 21:29:50.349959 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:50.349934    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxbpd\" (UniqueName: \"kubernetes.io/projected/77aadd78-b777-4086-906c-02db79588b83-kube-api-access-hxbpd\") pod \"authorino-7498df8756-hldph\" (UID: \"77aadd78-b777-4086-906c-02db79588b83\") " pod="kuadrant-system/authorino-7498df8756-hldph"
May 21 21:29:50.465070 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:50.465035    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-hldph"
May 21 21:29:50.607053 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:50.607026    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-hldph"]
May 21 21:29:50.610066 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:29:50.610035    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77aadd78_b777_4086_906c_02db79588b83.slice/crio-8fbdb9af9fc9c7f50119211a0a3465e20f318b18d0bd7d0a6d9c01b7e2b00383 WatchSource:0}: Error finding container 8fbdb9af9fc9c7f50119211a0a3465e20f318b18d0bd7d0a6d9c01b7e2b00383: Status 404 returned error can't find the container with id 8fbdb9af9fc9c7f50119211a0a3465e20f318b18d0bd7d0a6d9c01b7e2b00383
May 21 21:29:50.904455 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:50.904414    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-s2x2z" event={"ID":"e640c9bc-7604-4ea2-a674-cde5d30234f7","Type":"ContainerStarted","Data":"1265642ca1ec0998c1452d0915777dd58cd4b4da548b958994f177cb981cc2cb"}
May 21 21:29:50.905863 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:50.905827    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-hldph" event={"ID":"77aadd78-b777-4086-906c-02db79588b83","Type":"ContainerStarted","Data":"8fbdb9af9fc9c7f50119211a0a3465e20f318b18d0bd7d0a6d9c01b7e2b00383"}
May 21 21:29:54.924312 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:54.924272    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-hldph" event={"ID":"77aadd78-b777-4086-906c-02db79588b83","Type":"ContainerStarted","Data":"5dfeaacbad44402c16a945f75b59b7d0efcd6a519be82bd091f15933b1fc328a"}
May 21 21:29:54.925651 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:54.925629    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-s2x2z" event={"ID":"e640c9bc-7604-4ea2-a674-cde5d30234f7","Type":"ContainerStarted","Data":"556810fd62db9dabf5392820044ca609b57531ce332b834ce02a84beeec83f7f"}
May 21 21:29:54.925820 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:54.925803    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-s2x2z"
May 21 21:29:54.940513 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:54.940467    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-hldph" podStartSLOduration=1.196464872 podStartE2EDuration="4.940455972s" podCreationTimestamp="2026-05-21 21:29:50 +0000 UTC" firstStartedPulling="2026-05-21 21:29:50.612166163 +0000 UTC m=+503.045177647" lastFinishedPulling="2026-05-21 21:29:54.356157273 +0000 UTC m=+506.789168747" observedRunningTime="2026-05-21 21:29:54.94025692 +0000 UTC m=+507.373268414" watchObservedRunningTime="2026-05-21 21:29:54.940455972 +0000 UTC m=+507.373467467"
May 21 21:29:54.958329 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:29:54.958275    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-s2x2z" podStartSLOduration=1.709896855 podStartE2EDuration="5.95826075s" podCreationTimestamp="2026-05-21 21:29:49 +0000 UTC" firstStartedPulling="2026-05-21 21:29:50.106236117 +0000 UTC m=+502.539247593" lastFinishedPulling="2026-05-21 21:29:54.354599999 +0000 UTC m=+506.787611488" observedRunningTime="2026-05-21 21:29:54.957386048 +0000 UTC m=+507.390397544" watchObservedRunningTime="2026-05-21 21:29:54.95826075 +0000 UTC m=+507.391272247"
May 21 21:30:05.931271 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:30:05.931239    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-s2x2z"
May 21 21:30:24.740505 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:30:24.740419    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-hldph"]
May 21 21:30:24.741103 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:30:24.740699    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-hldph" podUID="77aadd78-b777-4086-906c-02db79588b83" containerName="authorino" containerID="cri-o://5dfeaacbad44402c16a945f75b59b7d0efcd6a519be82bd091f15933b1fc328a" gracePeriod=30
May 21 21:30:24.987499 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:30:24.987477    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-hldph"
May 21 21:30:25.040141 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:30:25.040112    2559 generic.go:358] "Generic (PLEG): container finished" podID="77aadd78-b777-4086-906c-02db79588b83" containerID="5dfeaacbad44402c16a945f75b59b7d0efcd6a519be82bd091f15933b1fc328a" exitCode=0
May 21 21:30:25.040314 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:30:25.040158    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-hldph"
May 21 21:30:25.040314 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:30:25.040196    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-hldph" event={"ID":"77aadd78-b777-4086-906c-02db79588b83","Type":"ContainerDied","Data":"5dfeaacbad44402c16a945f75b59b7d0efcd6a519be82bd091f15933b1fc328a"}
May 21 21:30:25.040314 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:30:25.040233    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-hldph" event={"ID":"77aadd78-b777-4086-906c-02db79588b83","Type":"ContainerDied","Data":"8fbdb9af9fc9c7f50119211a0a3465e20f318b18d0bd7d0a6d9c01b7e2b00383"}
May 21 21:30:25.040314 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:30:25.040250    2559 scope.go:117] "RemoveContainer" containerID="5dfeaacbad44402c16a945f75b59b7d0efcd6a519be82bd091f15933b1fc328a"
May 21 21:30:25.048282 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:30:25.048266    2559 scope.go:117] "RemoveContainer" containerID="5dfeaacbad44402c16a945f75b59b7d0efcd6a519be82bd091f15933b1fc328a"
May 21 21:30:25.048509 ip-10-0-129-28 kubenswrapper[2559]: E0521 21:30:25.048492    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dfeaacbad44402c16a945f75b59b7d0efcd6a519be82bd091f15933b1fc328a\": container with ID starting with 5dfeaacbad44402c16a945f75b59b7d0efcd6a519be82bd091f15933b1fc328a not found: ID does not exist" containerID="5dfeaacbad44402c16a945f75b59b7d0efcd6a519be82bd091f15933b1fc328a"
May 21 21:30:25.048551 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:30:25.048516    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dfeaacbad44402c16a945f75b59b7d0efcd6a519be82bd091f15933b1fc328a"} err="failed to get container status \"5dfeaacbad44402c16a945f75b59b7d0efcd6a519be82bd091f15933b1fc328a\": rpc error: code = NotFound desc = could not find container \"5dfeaacbad44402c16a945f75b59b7d0efcd6a519be82bd091f15933b1fc328a\": container with ID starting with 5dfeaacbad44402c16a945f75b59b7d0efcd6a519be82bd091f15933b1fc328a not found: ID does not exist"
May 21 21:30:25.050810 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:30:25.050796    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxbpd\" (UniqueName: \"kubernetes.io/projected/77aadd78-b777-4086-906c-02db79588b83-kube-api-access-hxbpd\") pod \"77aadd78-b777-4086-906c-02db79588b83\" (UID: \"77aadd78-b777-4086-906c-02db79588b83\") "
May 21 21:30:25.052643 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:30:25.052621    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77aadd78-b777-4086-906c-02db79588b83-kube-api-access-hxbpd" (OuterVolumeSpecName: "kube-api-access-hxbpd") pod "77aadd78-b777-4086-906c-02db79588b83" (UID: "77aadd78-b777-4086-906c-02db79588b83"). InnerVolumeSpecName "kube-api-access-hxbpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:30:25.151788 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:30:25.151760    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxbpd\" (UniqueName: \"kubernetes.io/projected/77aadd78-b777-4086-906c-02db79588b83-kube-api-access-hxbpd\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\""
May 21 21:30:25.373810 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:30:25.373770    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-hldph"]
May 21 21:30:25.375633 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:30:25.375611    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-hldph"]
May 21 21:30:26.167480 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:30:26.167449    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77aadd78-b777-4086-906c-02db79588b83" path="/var/lib/kubelet/pods/77aadd78-b777-4086-906c-02db79588b83/volumes"
May 21 21:31:00.461725 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:00.461688    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:31:27.740341 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:27.740309    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:31:31.245636 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:31.245599    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:31:34.426762 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.426722    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"]
May 21 21:31:34.427206 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.427125    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77aadd78-b777-4086-906c-02db79588b83" containerName="authorino"
May 21 21:31:34.427206 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.427138    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="77aadd78-b777-4086-906c-02db79588b83" containerName="authorino"
May 21 21:31:34.427279 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.427221    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="77aadd78-b777-4086-906c-02db79588b83" containerName="authorino"
May 21 21:31:34.429370 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.429350    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:34.433488 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.433293    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-p5j97\""
May 21 21:31:34.433488 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.433304    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 21 21:31:34.433488 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.433300    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 21 21:31:34.433488 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.433308    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 21 21:31:34.440413 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.440259    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"]
May 21 21:31:34.556753 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.556723    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e0da236-f897-4e58-813a-4b3d9e33750a-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-f59kn\" (UID: \"5e0da236-f897-4e58-813a-4b3d9e33750a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:34.556952 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.556785    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e0da236-f897-4e58-813a-4b3d9e33750a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-f59kn\" (UID: \"5e0da236-f897-4e58-813a-4b3d9e33750a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:34.556952 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.556806    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbm6r\" (UniqueName: \"kubernetes.io/projected/5e0da236-f897-4e58-813a-4b3d9e33750a-kube-api-access-xbm6r\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-f59kn\" (UID: \"5e0da236-f897-4e58-813a-4b3d9e33750a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:34.556952 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.556829    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5e0da236-f897-4e58-813a-4b3d9e33750a-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-f59kn\" (UID: \"5e0da236-f897-4e58-813a-4b3d9e33750a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:34.556952 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.556846    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e0da236-f897-4e58-813a-4b3d9e33750a-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-f59kn\" (UID: \"5e0da236-f897-4e58-813a-4b3d9e33750a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:34.556952 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.556868    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e0da236-f897-4e58-813a-4b3d9e33750a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-f59kn\" (UID: \"5e0da236-f897-4e58-813a-4b3d9e33750a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:34.657913 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.657881    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e0da236-f897-4e58-813a-4b3d9e33750a-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-f59kn\" (UID: \"5e0da236-f897-4e58-813a-4b3d9e33750a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:34.658089 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.657948    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e0da236-f897-4e58-813a-4b3d9e33750a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-f59kn\" (UID: \"5e0da236-f897-4e58-813a-4b3d9e33750a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:34.658089 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.657967    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbm6r\" (UniqueName: \"kubernetes.io/projected/5e0da236-f897-4e58-813a-4b3d9e33750a-kube-api-access-xbm6r\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-f59kn\" (UID: \"5e0da236-f897-4e58-813a-4b3d9e33750a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:34.658089 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.657988    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5e0da236-f897-4e58-813a-4b3d9e33750a-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-f59kn\" (UID: \"5e0da236-f897-4e58-813a-4b3d9e33750a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:34.658089 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.658008    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e0da236-f897-4e58-813a-4b3d9e33750a-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-f59kn\" (UID: \"5e0da236-f897-4e58-813a-4b3d9e33750a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:34.658089 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.658032    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e0da236-f897-4e58-813a-4b3d9e33750a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-f59kn\" (UID: \"5e0da236-f897-4e58-813a-4b3d9e33750a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:34.658408 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.658381    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5e0da236-f897-4e58-813a-4b3d9e33750a-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-f59kn\" (UID: \"5e0da236-f897-4e58-813a-4b3d9e33750a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:34.658408 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.658401    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e0da236-f897-4e58-813a-4b3d9e33750a-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-f59kn\" (UID: \"5e0da236-f897-4e58-813a-4b3d9e33750a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:34.658498 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.658442    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e0da236-f897-4e58-813a-4b3d9e33750a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-f59kn\" (UID: \"5e0da236-f897-4e58-813a-4b3d9e33750a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:34.660262 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.660246    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e0da236-f897-4e58-813a-4b3d9e33750a-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-f59kn\" (UID: \"5e0da236-f897-4e58-813a-4b3d9e33750a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:34.660672 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.660651    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e0da236-f897-4e58-813a-4b3d9e33750a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-f59kn\" (UID: \"5e0da236-f897-4e58-813a-4b3d9e33750a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:34.666816 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.666795    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbm6r\" (UniqueName: \"kubernetes.io/projected/5e0da236-f897-4e58-813a-4b3d9e33750a-kube-api-access-xbm6r\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-f59kn\" (UID: \"5e0da236-f897-4e58-813a-4b3d9e33750a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:34.740846 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.740773    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:34.866263 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:34.866174    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"]
May 21 21:31:34.869041 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:31:34.869010    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e0da236_f897_4e58_813a_4b3d9e33750a.slice/crio-e2d9bb5d1daf70ca235c7e1610634f71120f4119fa1baa6a2464e7eb1b82c74d WatchSource:0}: Error finding container e2d9bb5d1daf70ca235c7e1610634f71120f4119fa1baa6a2464e7eb1b82c74d: Status 404 returned error can't find the container with id e2d9bb5d1daf70ca235c7e1610634f71120f4119fa1baa6a2464e7eb1b82c74d
May 21 21:31:35.245532 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:35.245499    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:31:35.276027 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:35.275996    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn" event={"ID":"5e0da236-f897-4e58-813a-4b3d9e33750a","Type":"ContainerStarted","Data":"e2d9bb5d1daf70ca235c7e1610634f71120f4119fa1baa6a2464e7eb1b82c74d"}
May 21 21:31:40.299319 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:40.299275    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn" event={"ID":"5e0da236-f897-4e58-813a-4b3d9e33750a","Type":"ContainerStarted","Data":"ef9d1dc468874eb939559bd0b3a58b095b26b956e7d46859a144eaaeaacff9f5"}
May 21 21:31:48.333435 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:48.333333    2559 generic.go:358] "Generic (PLEG): container finished" podID="5e0da236-f897-4e58-813a-4b3d9e33750a" containerID="ef9d1dc468874eb939559bd0b3a58b095b26b956e7d46859a144eaaeaacff9f5" exitCode=0
May 21 21:31:48.333435 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:48.333414    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn" event={"ID":"5e0da236-f897-4e58-813a-4b3d9e33750a","Type":"ContainerDied","Data":"ef9d1dc468874eb939559bd0b3a58b095b26b956e7d46859a144eaaeaacff9f5"}
May 21 21:31:49.545685 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:49.545649    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:31:50.342655 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:50.342613    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn" event={"ID":"5e0da236-f897-4e58-813a-4b3d9e33750a","Type":"ContainerStarted","Data":"3231ff6167c9653dd0ebaf3f2551aeab9effc7a6d983f19736ef5accd7914d1a"}
May 21 21:31:50.342829 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:50.342810    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:31:50.363574 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:50.363526    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn" podStartSLOduration=1.8343658729999999 podStartE2EDuration="16.36351339s" podCreationTimestamp="2026-05-21 21:31:34 +0000 UTC" firstStartedPulling="2026-05-21 21:31:34.870780528 +0000 UTC m=+607.303792001" lastFinishedPulling="2026-05-21 21:31:49.39992803 +0000 UTC m=+621.832939518" observedRunningTime="2026-05-21 21:31:50.362396278 +0000 UTC m=+622.795407771" watchObservedRunningTime="2026-05-21 21:31:50.36351339 +0000 UTC m=+622.796524885"
May 21 21:31:53.744245 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:31:53.744207    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:32:01.359052 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:32:01.359020    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-f59kn"
May 21 21:32:24.648210 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:32:24.648166    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84b6fcb79c-zn7l5"]
May 21 21:32:24.654685 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:32:24.654652    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84b6fcb79c-zn7l5"
May 21 21:32:24.658927 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:32:24.658903    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 21 21:32:24.660336 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:32:24.660311    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rsqsc\""
May 21 21:32:24.661035 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:32:24.661009    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84b6fcb79c-zn7l5"]
May 21 21:32:24.703464 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:32:24.703426    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zcrb\" (UniqueName: \"kubernetes.io/projected/37a578cf-9250-4995-8b08-c74889af93d8-kube-api-access-4zcrb\") pod \"authorino-84b6fcb79c-zn7l5\" (UID: \"37a578cf-9250-4995-8b08-c74889af93d8\") " pod="kuadrant-system/authorino-84b6fcb79c-zn7l5"
May 21 21:32:24.703662 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:32:24.703493    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/37a578cf-9250-4995-8b08-c74889af93d8-tls-cert\") pod \"authorino-84b6fcb79c-zn7l5\" (UID: \"37a578cf-9250-4995-8b08-c74889af93d8\") " pod="kuadrant-system/authorino-84b6fcb79c-zn7l5"
May 21 21:32:24.804920 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:32:24.804880    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zcrb\" (UniqueName: \"kubernetes.io/projected/37a578cf-9250-4995-8b08-c74889af93d8-kube-api-access-4zcrb\") pod \"authorino-84b6fcb79c-zn7l5\" (UID: \"37a578cf-9250-4995-8b08-c74889af93d8\") " pod="kuadrant-system/authorino-84b6fcb79c-zn7l5"
May 21 21:32:24.805110 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:32:24.804950    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/37a578cf-9250-4995-8b08-c74889af93d8-tls-cert\") pod \"authorino-84b6fcb79c-zn7l5\" (UID: \"37a578cf-9250-4995-8b08-c74889af93d8\") " pod="kuadrant-system/authorino-84b6fcb79c-zn7l5"
May 21 21:32:24.807421 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:32:24.807392    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/37a578cf-9250-4995-8b08-c74889af93d8-tls-cert\") pod \"authorino-84b6fcb79c-zn7l5\" (UID: \"37a578cf-9250-4995-8b08-c74889af93d8\") " pod="kuadrant-system/authorino-84b6fcb79c-zn7l5"
May 21 21:32:24.813920 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:32:24.813889    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zcrb\" (UniqueName: \"kubernetes.io/projected/37a578cf-9250-4995-8b08-c74889af93d8-kube-api-access-4zcrb\") pod \"authorino-84b6fcb79c-zn7l5\" (UID: \"37a578cf-9250-4995-8b08-c74889af93d8\") " pod="kuadrant-system/authorino-84b6fcb79c-zn7l5"
May 21 21:32:24.966228 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:32:24.966148    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84b6fcb79c-zn7l5"
May 21 21:32:25.102983 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:32:25.102958    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84b6fcb79c-zn7l5"]
May 21 21:32:25.104971 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:32:25.104922    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37a578cf_9250_4995_8b08_c74889af93d8.slice/crio-f38347b14da04e81e7bf4dd169ef9f3df67b8a95342de7432ad5cae8b1e850d4 WatchSource:0}: Error finding container f38347b14da04e81e7bf4dd169ef9f3df67b8a95342de7432ad5cae8b1e850d4: Status 404 returned error can't find the container with id f38347b14da04e81e7bf4dd169ef9f3df67b8a95342de7432ad5cae8b1e850d4
May 21 21:32:25.106340 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:32:25.106320    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 21:32:25.473083 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:32:25.473045    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84b6fcb79c-zn7l5" event={"ID":"37a578cf-9250-4995-8b08-c74889af93d8","Type":"ContainerStarted","Data":"f38347b14da04e81e7bf4dd169ef9f3df67b8a95342de7432ad5cae8b1e850d4"}
May 21 21:32:26.479605 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:32:26.479554    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84b6fcb79c-zn7l5" event={"ID":"37a578cf-9250-4995-8b08-c74889af93d8","Type":"ContainerStarted","Data":"a0199d71092a3b6480b0062efb0f083670606c7b30141354ba423652947993e5"}
May 21 21:32:26.497928 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:32:26.497883    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-84b6fcb79c-zn7l5" podStartSLOduration=2.031654996 podStartE2EDuration="2.497869517s" podCreationTimestamp="2026-05-21 21:32:24 +0000 UTC" firstStartedPulling="2026-05-21 21:32:25.106495511 +0000 UTC m=+657.539506987" lastFinishedPulling="2026-05-21 21:32:25.572710035 +0000 UTC m=+658.005721508" observedRunningTime="2026-05-21 21:32:26.495837822 +0000 UTC m=+658.928849309" watchObservedRunningTime="2026-05-21 21:32:26.497869517 +0000 UTC m=+658.930881012"
May 21 21:32:34.738579 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:32:34.738542    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:32:51.734360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:32:51.734325    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:33:02.735383 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:33:02.735340    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:33:10.846618 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:33:10.846522    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:33:22.133529 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:33:22.133494    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:33:30.433791 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:33:30.433755    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:33:40.939854 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:33:40.939811    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:34:53.540937 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:34:53.540852    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:35:09.353088 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:35:09.353047    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:35:47.739786 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:35:47.739746    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:36:04.330901 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:36:04.330859    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:36:19.343669 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:36:19.343575    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:36:35.743178 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:36:35.743138    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:36:40.647277 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:36:40.647237    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:37:31.047022 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:37:31.046986    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:37:39.643147 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:37:39.643070    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:37:57.129325 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:37:57.129286    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:38:05.434947 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:38:05.434908    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:38:22.739088 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:38:22.739053    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:38:30.551019 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:38:30.550973    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:39:03.629613 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:39:03.629566    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:39:11.633243 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:39:11.633167    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:39:20.031858 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:39:20.031825    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:39:28.937160 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:39:28.937127    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:39:36.641469 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:39:36.641435    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:39:54.739007 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:39:54.738974    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:40:04.841633 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:40:04.841581    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:40:51.837360 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:40:51.837278    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:40:56.565018 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:40:56.564984    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:41:03.045186 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:41:03.045147    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:41:12.368047 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:41:12.368006    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:41:21.944923 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:41:21.944885    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:41:29.144010 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:41:29.143963    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:41:39.035659 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:41:39.035621    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:41:47.147314 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:41:47.147273    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:41:56.034352 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:41:56.034312    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:42:04.538912 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:42:04.538876    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:42:14.832183 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:42:14.832103    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:42:22.058069 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:42:22.058031    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:42:30.646458 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:42:30.646423    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:42:39.339807 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:42:39.339771    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:42:48.445348 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:42:48.445312    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:42:56.136722 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:42:56.136686    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:43:05.438955 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:43:05.438918    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:43:13.643659 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:43:13.643617    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:45:33.938577 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:45:33.938539    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:45:40.134834 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:45:40.134796    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:46:04.187163 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:46:04.187128    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:46:09.944942 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:46:09.944906    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:46:19.139532 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:46:19.139498    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:46:29.433053 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:46:29.433009    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:46:38.642506 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:46:38.642416    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:46:49.337237 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:46:49.337198    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:46:57.731163 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:46:57.731130    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:47:08.843087 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:47:08.843052    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:47:16.641076 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:47:16.641040    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:47:27.739227 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:47:27.739194    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:47:37.435447 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:47:37.435409    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:48:11.835689 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:48:11.835609    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:48:54.240019 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:48:54.239979    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:49:02.736762 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:49:02.736720    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:49:11.937726 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:49:11.937680    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:49:20.633568 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:49:20.633533    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:49:28.940607 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:49:28.940547    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:49:42.137700 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:49:42.137614    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:49:51.337647 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:49:51.337606    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:49:57.736023 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:49:57.735985    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:50:06.646986 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:50:06.646951    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:50:15.230157 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:50:15.230123    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:50:24.440078 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:50:24.440040    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:50:37.058783 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:50:37.058746    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:50:54.247721 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:50:54.247683    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:51:02.732729 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:51:02.732691    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:51:12.344531 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:51:12.344451    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:51:20.533067 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:51:20.533029    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:51:37.659335 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:51:37.659302    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:51:45.538008 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:51:45.537972    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:51:55.234901 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:51:55.234864    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:52:01.949680 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:52:01.949641    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:52:10.848008 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:52:10.847976    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:52:19.944514 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:52:19.944475    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:52:29.442959 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:52:29.442919    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:52:39.733914 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:52:39.733838    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:52:48.750278 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:52:48.750235    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:53:02.448409 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:53:02.448370    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:53:11.732021 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:53:11.731989    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:53:17.928925 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:53:17.928891    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:53:27.547355 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:53:27.547315    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:53:35.929986 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:53:35.929943    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:53:52.041221 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:53:52.041179    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:54:00.935202 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:54:00.935161    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:54:09.341513 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:54:09.341429    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:54:16.546796 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:54:16.546759    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:54:42.230960 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:54:42.230922    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:54:53.737889 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:54:53.737847    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-s2x2z"]
May 21 21:54:57.561007 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:54:57.560972    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84b6fcb79c-zn7l5_37a578cf-9250-4995-8b08-c74889af93d8/authorino/0.log"
May 21 21:55:02.589575 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:02.589541    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79646d69f8-xtrvd_cb5739e3-e675-4742-998a-7328d2b119bf/manager/0.log"
May 21 21:55:03.932612 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:03.932555    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84b6fcb79c-zn7l5_37a578cf-9250-4995-8b08-c74889af93d8/authorino/0.log"
May 21 21:55:04.152413 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:04.152381    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-hf7tr_83b44eca-83ad-4641-b4e7-df584f6ab18e/manager/0.log"
May 21 21:55:04.261414 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:04.261341    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-m4mcm_81811d59-4b17-4b88-8c1f-df0c4d2aa6ad/kuadrant-console-plugin/0.log"
May 21 21:55:04.376646 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:04.376620    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wmfxw_20801671-9cc5-40fe-bbef-80df1710c3a6/registry-server/0.log"
May 21 21:55:04.619361 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:04.619328    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-s2x2z_e640c9bc-7604-4ea2-a674-cde5d30234f7/limitador/0.log"
May 21 21:55:04.732129 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:04.732102    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-xn7mb_1d2b719c-bd99-4d46-ad3b-57931b31458a/manager/0.log"
May 21 21:55:05.058909 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:05.058877    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5_155d2de4-b654-4274-8ab3-bff34f3e1a8e/istio-proxy/0.log"
May 21 21:55:05.498844 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:05.498768    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-ht8d5_e02c4ef8-59b1-4d27-9850-d3c4b0c070ba/istio-proxy/0.log"
May 21 21:55:06.627130 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:06.627098    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-f59kn_5e0da236-f897-4e58-813a-4b3d9e33750a/storage-initializer/0.log"
May 21 21:55:06.634286 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:06.634259    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-f59kn_5e0da236-f897-4e58-813a-4b3d9e33750a/main/0.log"
May 21 21:55:10.123347 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:10.123316    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zzm8x/must-gather-9cqdd"]
May 21 21:55:10.126867 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:10.126850    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zzm8x/must-gather-9cqdd"
May 21 21:55:10.129940 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:10.129918    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zzm8x\"/\"kube-root-ca.crt\""
May 21 21:55:10.131091 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:10.131066    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zzm8x\"/\"openshift-service-ca.crt\""
May 21 21:55:10.131091 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:10.131078    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zzm8x\"/\"default-dockercfg-jrd2s\""
May 21 21:55:10.149375 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:10.149346    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zzm8x/must-gather-9cqdd"]
May 21 21:55:10.254270 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:10.254241    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7a4a5943-3e56-4bdf-a1b0-540cfcf7a92a-must-gather-output\") pod \"must-gather-9cqdd\" (UID: \"7a4a5943-3e56-4bdf-a1b0-540cfcf7a92a\") " pod="openshift-must-gather-zzm8x/must-gather-9cqdd"
May 21 21:55:10.254270 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:10.254272    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtjhs\" (UniqueName: \"kubernetes.io/projected/7a4a5943-3e56-4bdf-a1b0-540cfcf7a92a-kube-api-access-jtjhs\") pod \"must-gather-9cqdd\" (UID: \"7a4a5943-3e56-4bdf-a1b0-540cfcf7a92a\") " pod="openshift-must-gather-zzm8x/must-gather-9cqdd"
May 21 21:55:10.355071 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:10.355027    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7a4a5943-3e56-4bdf-a1b0-540cfcf7a92a-must-gather-output\") pod \"must-gather-9cqdd\" (UID: \"7a4a5943-3e56-4bdf-a1b0-540cfcf7a92a\") " pod="openshift-must-gather-zzm8x/must-gather-9cqdd"
May 21 21:55:10.355071 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:10.355069    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtjhs\" (UniqueName: \"kubernetes.io/projected/7a4a5943-3e56-4bdf-a1b0-540cfcf7a92a-kube-api-access-jtjhs\") pod \"must-gather-9cqdd\" (UID: \"7a4a5943-3e56-4bdf-a1b0-540cfcf7a92a\") " pod="openshift-must-gather-zzm8x/must-gather-9cqdd"
May 21 21:55:10.355426 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:10.355404    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7a4a5943-3e56-4bdf-a1b0-540cfcf7a92a-must-gather-output\") pod \"must-gather-9cqdd\" (UID: \"7a4a5943-3e56-4bdf-a1b0-540cfcf7a92a\") " pod="openshift-must-gather-zzm8x/must-gather-9cqdd"
May 21 21:55:10.367166 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:10.367141    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtjhs\" (UniqueName: \"kubernetes.io/projected/7a4a5943-3e56-4bdf-a1b0-540cfcf7a92a-kube-api-access-jtjhs\") pod \"must-gather-9cqdd\" (UID: \"7a4a5943-3e56-4bdf-a1b0-540cfcf7a92a\") " pod="openshift-must-gather-zzm8x/must-gather-9cqdd"
May 21 21:55:10.436269 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:10.436177    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zzm8x/must-gather-9cqdd"
May 21 21:55:10.579522 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:10.579496    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zzm8x/must-gather-9cqdd"]
May 21 21:55:10.581007 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:55:10.580981    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a4a5943_3e56_4bdf_a1b0_540cfcf7a92a.slice/crio-bf70a5563c8346d5f3d601dc1a9ffffb11bd3057224aa25523a98430a70bcad9 WatchSource:0}: Error finding container bf70a5563c8346d5f3d601dc1a9ffffb11bd3057224aa25523a98430a70bcad9: Status 404 returned error can't find the container with id bf70a5563c8346d5f3d601dc1a9ffffb11bd3057224aa25523a98430a70bcad9
May 21 21:55:10.582806 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:10.582790    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 21:55:11.236581 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:11.236534    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zzm8x/must-gather-9cqdd" event={"ID":"7a4a5943-3e56-4bdf-a1b0-540cfcf7a92a","Type":"ContainerStarted","Data":"bf70a5563c8346d5f3d601dc1a9ffffb11bd3057224aa25523a98430a70bcad9"}
May 21 21:55:12.242218 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:12.242181    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zzm8x/must-gather-9cqdd" event={"ID":"7a4a5943-3e56-4bdf-a1b0-540cfcf7a92a","Type":"ContainerStarted","Data":"161291b849b91916723d1de2110c47b40589e873cf9fccec1a48d5f03247c0db"}
May 21 21:55:12.242675 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:12.242225    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zzm8x/must-gather-9cqdd" event={"ID":"7a4a5943-3e56-4bdf-a1b0-540cfcf7a92a","Type":"ContainerStarted","Data":"3cc5610081ff8bde7c97587ecbeea04b12ca6021b1cc6b55bbf7ff8c6b0eb6b1"}
May 21 21:55:12.260525 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:12.260460    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-zzm8x/must-gather-9cqdd" podStartSLOduration=1.585690142 podStartE2EDuration="2.260439493s" podCreationTimestamp="2026-05-21 21:55:10 +0000 UTC" firstStartedPulling="2026-05-21 21:55:10.582919889 +0000 UTC m=+2023.015931363" lastFinishedPulling="2026-05-21 21:55:11.257669231 +0000 UTC m=+2023.690680714" observedRunningTime="2026-05-21 21:55:12.258034083 +0000 UTC m=+2024.691045578" watchObservedRunningTime="2026-05-21 21:55:12.260439493 +0000 UTC m=+2024.693450989"
May 21 21:55:12.790004 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:12.789975    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-h7cgl_4285aeb8-6c9f-42ea-b53b-036cd8edb18d/global-pull-secret-syncer/0.log"
May 21 21:55:12.986892 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:12.986849    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5s5xc_56805f88-45e2-41c0-ac11-aa92e3f555ca/konnectivity-agent/0.log"
May 21 21:55:13.142485 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:13.142410    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-28.ec2.internal_3b2a50c1e9e4450e9a9c6602d61d82b0/haproxy/0.log"
May 21 21:55:16.908606 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:16.907296    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84b6fcb79c-zn7l5_37a578cf-9250-4995-8b08-c74889af93d8/authorino/0.log"
May 21 21:55:16.973819 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:16.973777    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-hf7tr_83b44eca-83ad-4641-b4e7-df584f6ab18e/manager/0.log"
May 21 21:55:17.012031 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:17.011999    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-m4mcm_81811d59-4b17-4b88-8c1f-df0c4d2aa6ad/kuadrant-console-plugin/0.log"
May 21 21:55:17.074995 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:17.074958    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wmfxw_20801671-9cc5-40fe-bbef-80df1710c3a6/registry-server/0.log"
May 21 21:55:17.203396 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:17.203318    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-s2x2z_e640c9bc-7604-4ea2-a674-cde5d30234f7/limitador/0.log"
May 21 21:55:17.292131 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:17.292090    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-xn7mb_1d2b719c-bd99-4d46-ad3b-57931b31458a/manager/0.log"
May 21 21:55:18.738089 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:18.738031    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b0ca7db-e160-4c29-91b4-315a84f1d476/alertmanager/0.log"
May 21 21:55:18.772619 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:18.772581    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b0ca7db-e160-4c29-91b4-315a84f1d476/config-reloader/0.log"
May 21 21:55:18.815745 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:18.815712    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b0ca7db-e160-4c29-91b4-315a84f1d476/kube-rbac-proxy-web/0.log"
May 21 21:55:18.848967 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:18.848911    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b0ca7db-e160-4c29-91b4-315a84f1d476/kube-rbac-proxy/0.log"
May 21 21:55:18.884390 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:18.884352    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b0ca7db-e160-4c29-91b4-315a84f1d476/kube-rbac-proxy-metric/0.log"
May 21 21:55:18.928900 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:18.928308    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b0ca7db-e160-4c29-91b4-315a84f1d476/prom-label-proxy/0.log"
May 21 21:55:18.965732 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:18.965698    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b0ca7db-e160-4c29-91b4-315a84f1d476/init-config-reloader/0.log"
May 21 21:55:19.013806 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:19.013559    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-8xcxc_56955214-c7d1-4bda-9f1e-2abd74ff1f85/cluster-monitoring-operator/0.log"
May 21 21:55:19.278350 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:19.278258    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-68fw8_14585704-8772-492e-8098-098dba235451/node-exporter/0.log"
May 21 21:55:19.303918 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:19.303887    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-68fw8_14585704-8772-492e-8098-098dba235451/kube-rbac-proxy/0.log"
May 21 21:55:19.326892 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:19.326861    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-68fw8_14585704-8772-492e-8098-098dba235451/init-textfile/0.log"
May 21 21:55:19.821018 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:19.820989    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-645865f8c5-tns8l_a090f7d1-91b5-415e-ae5a-a219a6fb6adb/thanos-query/0.log"
May 21 21:55:19.844183 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:19.844141    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-645865f8c5-tns8l_a090f7d1-91b5-415e-ae5a-a219a6fb6adb/kube-rbac-proxy-web/0.log"
May 21 21:55:19.886855 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:19.886781    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-645865f8c5-tns8l_a090f7d1-91b5-415e-ae5a-a219a6fb6adb/kube-rbac-proxy/0.log"
May 21 21:55:19.910856 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:19.910766    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-645865f8c5-tns8l_a090f7d1-91b5-415e-ae5a-a219a6fb6adb/prom-label-proxy/0.log"
May 21 21:55:19.936929 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:19.936901    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-645865f8c5-tns8l_a090f7d1-91b5-415e-ae5a-a219a6fb6adb/kube-rbac-proxy-rules/0.log"
May 21 21:55:19.960698 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:19.960663    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-645865f8c5-tns8l_a090f7d1-91b5-415e-ae5a-a219a6fb6adb/kube-rbac-proxy-metrics/0.log"
May 21 21:55:21.071644 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:21.071608    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-twvxh_6b67a174-68c4-4ddf-94c1-6c5d6ffd57b1/networking-console-plugin/0.log"
May 21 21:55:21.558973 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:21.558937    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"]
May 21 21:55:21.565032 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:21.564996    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"
May 21 21:55:21.573376 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:21.573304    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"]
May 21 21:55:21.677800 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:21.677763    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/576dbd51-de65-40de-a522-ad423d59ec92-proc\") pod \"perf-node-gather-daemonset-g97nh\" (UID: \"576dbd51-de65-40de-a522-ad423d59ec92\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"
May 21 21:55:21.677993 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:21.677836    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/576dbd51-de65-40de-a522-ad423d59ec92-lib-modules\") pod \"perf-node-gather-daemonset-g97nh\" (UID: \"576dbd51-de65-40de-a522-ad423d59ec92\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"
May 21 21:55:21.677993 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:21.677935    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/576dbd51-de65-40de-a522-ad423d59ec92-podres\") pod \"perf-node-gather-daemonset-g97nh\" (UID: \"576dbd51-de65-40de-a522-ad423d59ec92\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"
May 21 21:55:21.678104 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:21.678001    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/576dbd51-de65-40de-a522-ad423d59ec92-sys\") pod \"perf-node-gather-daemonset-g97nh\" (UID: \"576dbd51-de65-40de-a522-ad423d59ec92\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"
May 21 21:55:21.678104 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:21.678032    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zbw7\" (UniqueName: \"kubernetes.io/projected/576dbd51-de65-40de-a522-ad423d59ec92-kube-api-access-4zbw7\") pod \"perf-node-gather-daemonset-g97nh\" (UID: \"576dbd51-de65-40de-a522-ad423d59ec92\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"
May 21 21:55:21.778715 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:21.778675    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/576dbd51-de65-40de-a522-ad423d59ec92-proc\") pod \"perf-node-gather-daemonset-g97nh\" (UID: \"576dbd51-de65-40de-a522-ad423d59ec92\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"
May 21 21:55:21.778889 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:21.778734    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/576dbd51-de65-40de-a522-ad423d59ec92-lib-modules\") pod \"perf-node-gather-daemonset-g97nh\" (UID: \"576dbd51-de65-40de-a522-ad423d59ec92\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"
May 21 21:55:21.778889 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:21.778766    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/576dbd51-de65-40de-a522-ad423d59ec92-podres\") pod \"perf-node-gather-daemonset-g97nh\" (UID: \"576dbd51-de65-40de-a522-ad423d59ec92\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"
May 21 21:55:21.778889 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:21.778792    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/576dbd51-de65-40de-a522-ad423d59ec92-sys\") pod \"perf-node-gather-daemonset-g97nh\" (UID: \"576dbd51-de65-40de-a522-ad423d59ec92\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"
May 21 21:55:21.778889 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:21.778815    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zbw7\" (UniqueName: \"kubernetes.io/projected/576dbd51-de65-40de-a522-ad423d59ec92-kube-api-access-4zbw7\") pod \"perf-node-gather-daemonset-g97nh\" (UID: \"576dbd51-de65-40de-a522-ad423d59ec92\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"
May 21 21:55:21.778889 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:21.778811    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/576dbd51-de65-40de-a522-ad423d59ec92-proc\") pod \"perf-node-gather-daemonset-g97nh\" (UID: \"576dbd51-de65-40de-a522-ad423d59ec92\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"
May 21 21:55:21.779079 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:21.778912    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/576dbd51-de65-40de-a522-ad423d59ec92-lib-modules\") pod \"perf-node-gather-daemonset-g97nh\" (UID: \"576dbd51-de65-40de-a522-ad423d59ec92\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"
May 21 21:55:21.779079 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:21.778941    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/576dbd51-de65-40de-a522-ad423d59ec92-podres\") pod \"perf-node-gather-daemonset-g97nh\" (UID: \"576dbd51-de65-40de-a522-ad423d59ec92\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"
May 21 21:55:21.779079 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:21.778941    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/576dbd51-de65-40de-a522-ad423d59ec92-sys\") pod \"perf-node-gather-daemonset-g97nh\" (UID: \"576dbd51-de65-40de-a522-ad423d59ec92\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"
May 21 21:55:21.787619 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:21.787563    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zbw7\" (UniqueName: \"kubernetes.io/projected/576dbd51-de65-40de-a522-ad423d59ec92-kube-api-access-4zbw7\") pod \"perf-node-gather-daemonset-g97nh\" (UID: \"576dbd51-de65-40de-a522-ad423d59ec92\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"
May 21 21:55:21.881524 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:21.881440    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"
May 21 21:55:22.066149 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:22.066111    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"]
May 21 21:55:22.069493 ip-10-0-129-28 kubenswrapper[2559]: W0521 21:55:22.069463    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod576dbd51_de65_40de_a522_ad423d59ec92.slice/crio-c92f77d74fdaa23d763df91c45cc0d00784c79aef2c122291ca9a980fa3e6b9f WatchSource:0}: Error finding container c92f77d74fdaa23d763df91c45cc0d00784c79aef2c122291ca9a980fa3e6b9f: Status 404 returned error can't find the container with id c92f77d74fdaa23d763df91c45cc0d00784c79aef2c122291ca9a980fa3e6b9f
May 21 21:55:22.170990 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:22.170918    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-9nqr7_7ccccd1d-a4de-4db7-a58e-021d0397f81e/download-server/0.log"
May 21 21:55:22.290103 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:22.290064    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh" event={"ID":"576dbd51-de65-40de-a522-ad423d59ec92","Type":"ContainerStarted","Data":"c92f77d74fdaa23d763df91c45cc0d00784c79aef2c122291ca9a980fa3e6b9f"}
May 21 21:55:23.295720 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:23.295682    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh" event={"ID":"576dbd51-de65-40de-a522-ad423d59ec92","Type":"ContainerStarted","Data":"603d2f794d33217dba2ace8b825e48412930bb12208c28088dc02cfdc1ca2e2f"}
May 21 21:55:23.296086 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:23.295766    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"
May 21 21:55:23.314167 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:23.314117    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh" podStartSLOduration=2.314103666 podStartE2EDuration="2.314103666s" podCreationTimestamp="2026-05-21 21:55:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:55:23.313437253 +0000 UTC m=+2035.746448751" watchObservedRunningTime="2026-05-21 21:55:23.314103666 +0000 UTC m=+2035.747115161"
May 21 21:55:23.623252 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:23.623182    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kp68l_78c14074-82e5-4559-94e6-79a10e02938d/dns/0.log"
May 21 21:55:23.643187 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:23.643157    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kp68l_78c14074-82e5-4559-94e6-79a10e02938d/kube-rbac-proxy/0.log"
May 21 21:55:23.665051 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:23.665030    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4hz2n_3c1ce8fc-42cb-44ed-8b20-e3d6c2e3c2c9/dns-node-resolver/0.log"
May 21 21:55:24.182102 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:24.182070    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-689f899957-lx6ml_4c5066d9-fc99-4e63-b377-ae84fb797414/registry/0.log"
May 21 21:55:24.259251 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:24.259225    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s57t7_909a645a-db62-4ce2-8e92-c7d2380eb4dc/node-ca/0.log"
May 21 21:55:25.088259 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:25.088227    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bmdrk5_155d2de4-b654-4274-8ab3-bff34f3e1a8e/istio-proxy/0.log"
May 21 21:55:25.286882 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:25.286850    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-ht8d5_e02c4ef8-59b1-4d27-9850-d3c4b0c070ba/istio-proxy/0.log"
May 21 21:55:25.909636 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:25.909579    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jrlsm_0f00757c-1b31-47a9-8bf6-49cd582be267/serve-healthcheck-canary/0.log"
May 21 21:55:26.473070 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:26.473043    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c4996_cf88c648-0ca7-4f80-9195-ae681ff43589/kube-rbac-proxy/0.log"
May 21 21:55:26.496370 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:26.496338    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c4996_cf88c648-0ca7-4f80-9195-ae681ff43589/exporter/0.log"
May 21 21:55:26.517572 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:26.517546    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c4996_cf88c648-0ca7-4f80-9195-ae681ff43589/extractor/0.log"
May 21 21:55:28.654904 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:28.654876    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79646d69f8-xtrvd_cb5739e3-e675-4742-998a-7328d2b119bf/manager/0.log"
May 21 21:55:29.311630 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:29.311572    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-g97nh"
May 21 21:55:29.988672 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:29.988646    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c58594cc-pp9wm_763aec9d-c6f3-46d1-af53-8f3ab126b50f/manager/0.log"
May 21 21:55:34.383513 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:34.383474    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-nlf5h_cf1102a0-a05e-4d76-9d58-4fdd9c2d666b/migrator/0.log"
May 21 21:55:34.408699 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:34.408667    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-nlf5h_cf1102a0-a05e-4d76-9d58-4fdd9c2d666b/graceful-termination/0.log"
May 21 21:55:34.759900 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:34.759821    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-pvsqr_4e696e0a-7b15-4b92-bd3a-4bd085747ecf/kube-storage-version-migrator-operator/1.log"
May 21 21:55:34.760542 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:34.760523    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-pvsqr_4e696e0a-7b15-4b92-bd3a-4bd085747ecf/kube-storage-version-migrator-operator/0.log"
May 21 21:55:35.929647 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:35.929621    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v5cj2_db2f2e21-2561-411b-aedf-e1bcdbf66560/kube-multus-additional-cni-plugins/0.log"
May 21 21:55:35.950911 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:35.950886    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v5cj2_db2f2e21-2561-411b-aedf-e1bcdbf66560/egress-router-binary-copy/0.log"
May 21 21:55:35.974996 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:35.974974    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v5cj2_db2f2e21-2561-411b-aedf-e1bcdbf66560/cni-plugins/0.log"
May 21 21:55:36.005570 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:36.005548    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v5cj2_db2f2e21-2561-411b-aedf-e1bcdbf66560/bond-cni-plugin/0.log"
May 21 21:55:36.030074 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:36.030049    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v5cj2_db2f2e21-2561-411b-aedf-e1bcdbf66560/routeoverride-cni/0.log"
May 21 21:55:36.053494 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:36.053473    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v5cj2_db2f2e21-2561-411b-aedf-e1bcdbf66560/whereabouts-cni-bincopy/0.log"
May 21 21:55:36.085899 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:36.085873    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v5cj2_db2f2e21-2561-411b-aedf-e1bcdbf66560/whereabouts-cni/0.log"
May 21 21:55:36.277098 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:36.277018    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bdchd_92a208e0-b4da-41b0-85e2-a5db658ee178/kube-multus/0.log"
May 21 21:55:36.403928 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:36.403897    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kj49t_7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd/network-metrics-daemon/0.log"
May 21 21:55:36.423417 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:36.423390    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kj49t_7cfa6b5d-c8d3-4388-85a1-5c9105cc54fd/kube-rbac-proxy/0.log"
May 21 21:55:37.603535 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:37.603462    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdmjr_bacb9d64-b7a0-4535-adae-872327dd1f03/ovn-controller/0.log"
May 21 21:55:37.633885 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:37.633858    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdmjr_bacb9d64-b7a0-4535-adae-872327dd1f03/ovn-acl-logging/0.log"
May 21 21:55:37.651943 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:37.651918    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdmjr_bacb9d64-b7a0-4535-adae-872327dd1f03/kube-rbac-proxy-node/0.log"
May 21 21:55:37.673167 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:37.673145    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdmjr_bacb9d64-b7a0-4535-adae-872327dd1f03/kube-rbac-proxy-ovn-metrics/0.log"
May 21 21:55:37.694201 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:37.694180    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdmjr_bacb9d64-b7a0-4535-adae-872327dd1f03/northd/0.log"
May 21 21:55:37.715345 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:37.715321    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdmjr_bacb9d64-b7a0-4535-adae-872327dd1f03/nbdb/0.log"
May 21 21:55:37.737358 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:37.737336    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdmjr_bacb9d64-b7a0-4535-adae-872327dd1f03/sbdb/0.log"
May 21 21:55:37.852480 ip-10-0-129-28 kubenswrapper[2559]: I0521 21:55:37.852452    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdmjr_bacb9d64-b7a0-4535-adae-872327dd1f03/ovnkube-controller/0.log"